-- Logs begin at Wed 2022-04-06 10:08:08 UTC, end at Wed 2022-04-06 11:36:45 UTC. -- Apr 06 10:47:51.830065 dv-cinder-836072-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 06 10:47:51.839292 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 06 10:47:51.841372 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Apr 6 10:47:51 2022] *** Apr 06 10:47:51.841372 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 06 10:47:51.841372 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 06 10:47:51.841372 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: nodename: dv-cinder-836072-2-iscsi Apr 06 10:47:51.841372 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: machine: x86_64 Apr 06 10:47:51.841372 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: clock source: unix Apr 06 10:47:51.841372 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: pcre jit disabled Apr 06 10:47:51.841372 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: detected number of CPU cores: 4 Apr 06 10:47:51.841372 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: current working directory: / Apr 06 10:47:51.841372 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: detected binary path: /usr/bin/uwsgi-core Apr 06 10:47:51.841372 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: your processes number limit is 47680 Apr 06 10:47:51.841372 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: your memory page size is 4096 bytes Apr 06 10:47:51.841372 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: detected max file descriptor number: 2048 Apr 06 10:47:51.841372 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: lock engine: pthread robust mutexes Apr 06 10:47:51.842169 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: thunder lock: enabled Apr 06 10:47:51.842169 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 06 10:47:51.842169 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 06 10:47:51.887610 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: Python main interpreter initialized at 0x563a766f99c0 Apr 06 10:47:51.887610 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: python threads support enabled Apr 06 10:47:51.887610 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: your server socket listen backlog is limited to 100 connections Apr 06 10:47:51.887610 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: your mercy for graceful operations on workers is 90 seconds Apr 06 10:47:51.887988 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: mapped 403077 bytes (393 KB) for 2 cores Apr 06 10:47:51.888073 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: *** Operational MODE: preforking *** Apr 06 10:47:51.888313 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: *** uWSGI is running in multiple interpreter mode *** Apr 06 10:47:51.888313 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: spawned uWSGI master process (pid: 80189) Apr 06 10:47:51.888524 dv-cinder-836072-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 06 10:47:51.889380 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: spawned uWSGI worker 1 (pid: 80201, cores: 1) Apr 06 10:47:51.889475 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: spawned uWSGI worker 2 (pid: 80202, cores: 1) Apr 06 10:47:51.890883 dv-cinder-836072-2-iscsi devstack@keystone.service[80189]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 06 10:47:57.733289 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 10:47:57.733289 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: from cryptography.utils import int_from_bytes Apr 06 10:47:57.734036 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 10:47:57.734036 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: from cryptography.utils import int_from_bytes Apr 06 10:47:57.734477 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 10:47:57.734477 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: from cryptography.utils import int_from_bytes Apr 06 10:47:57.734903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 10:47:57.734903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: from cryptography.utils import int_from_bytes Apr 06 10:47:57.784719 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 06 10:47:57.784918 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 06 10:47:57.785146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] command line args: [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 06 10:47:57.785427 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 06 10:47:57.785504 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 06 10:47:57.785609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ================================================================================ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 06 10:47:57.785695 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 06 10:47:57.785806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] command line args: [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 06 10:47:57.785890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] admin_token = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.786083 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 06 10:47:57.786170 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] config_dir = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.786252 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ================================================================================ {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 06 10:47:57.786329 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.786455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] config_source = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.786531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] admin_token = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.786636 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] debug = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.786741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] config_dir = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.786825 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.787072 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.787148 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] config_source = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.787212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.787275 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] debug = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.787415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.787499 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.787640 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.787743 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.787840 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.787932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.788083 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.788185 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.788280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_config_append = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.788373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.788478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.788584 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] list_limit = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.788686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_dir = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.788864 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] log_config_append = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.789030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_file = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.789188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.789265 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.789394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] log_dir = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.789394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] log_file = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.789579 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.789654 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.789801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.789878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.790510 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.790510 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.790701 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.790782 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.790859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.790936 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.791065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.791065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.791206 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.791312 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.791434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.791578 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.791658 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.791804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.791897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.792002 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.792120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.792243 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.792395 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.792514 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.792629 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.792753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.792888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.793014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.793241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.793367 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.793483 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] publish_errors = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.793656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.793774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.793888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.794020 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] publish_errors = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.794145 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.794259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.794432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.794558 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.794558 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.794790 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.794790 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] standard_threads = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.795085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.795205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.795318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.795318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] standard_threads = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.795543 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.795543 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.795762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.795881 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_journal = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.796001 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.796127 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_json = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.796242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.796355 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_stderr = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.796474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] use_journal = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.796594 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_syslog = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.796715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] use_json = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.796840 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.796961 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] use_stderr = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.796961 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] use_syslog = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.797204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.797329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 10:47:57.797444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.797568 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.797683 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.797804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.797919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.798031 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.798150 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.798272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.798393 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.798507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.798620 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.798733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.798847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.798968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.799089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.799202 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.799315 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.799427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.799540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.799664 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.799785 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.799907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.800021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.800140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.800260 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.800453 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.800569 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.800688 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.800813 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.800929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.801041 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.801189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.801305 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.801418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.801564 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.801680 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.801794 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.801915 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.802031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.802144 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.802262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.802382 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.802495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.802617 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.802742 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.802863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.802977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.803091 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.803215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.803215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.803429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.803548 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.803668 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.803782 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.803903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.803903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.804117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.804229 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.804348 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.804348 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.804582 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.804697 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.804809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.804906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.804999 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.804999 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.805222 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.805319 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.805419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.805514 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.805614 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.805614 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.805827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.805937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.806041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.806161 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.806282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.806397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.806523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.806639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.806742 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.806861 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.806987 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.807098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.807220 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.807336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.807450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.807450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.807670 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.807782 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.807897 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.807897 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.808134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.808250 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.808364 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.808478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.808591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.808716 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.808829 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.808829 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.809070 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.809188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.809304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.809304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.809536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.809649 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.809762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.809876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.810047 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.810168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.810285 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.810401 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.810515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.810629 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.810743 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.810865 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.810987 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.810987 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.811210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.811324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.811440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.811440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.811668 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.811668 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.811904 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.812020 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.812211 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.812211 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.812436 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.812553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.812671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.812817 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.812934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.812934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.813445 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.813561 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.813683 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.813798 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.813912 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.814035 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.814151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.814265 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.814380 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.814494 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.814610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.814733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.814850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.814964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.815079 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.815194 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.815317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.815441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.815563 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.815691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.815807 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.815928 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.816044 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.816159 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.816283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.816410 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.816526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.816642 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.816756 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.816877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.816993 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.817144 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.817262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.817378 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.817498 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.817613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.817736 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.817860 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.817977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.818092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.818206 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.818319 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.818434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.818556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.818673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.818788 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.818909 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.819025 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.819139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.819262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.819378 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.819492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.819607 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.819720 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.819835 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.819958 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.820080 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.820196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.820310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.820424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.820550 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.820667 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.820782 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.820897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.821021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.821208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.821340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.821458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.821573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.821688 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.821802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.821918 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.822045 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.external = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.822045 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.822268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.822268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] auth.external = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.822485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.822613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.822764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.822764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.password = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.823001 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.823119 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.token = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.823235 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.823350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.823466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] auth.password = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.823466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] auth.token = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.823691 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.823808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.823924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.824040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.824168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.824285 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.824409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.824526 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.824642 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.824757 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.824874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.824874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.825116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.825116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.825336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.825451 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] credential.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.825595 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.825741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.825936 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.826055 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.826172 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.826300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.826417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.826533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.826657 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.826774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.826890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.827007 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.827124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.827240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.827364 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.827482 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.827597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.827713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.827835 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.827958 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.828083 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.828201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.828317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.828433 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.828549 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.828670 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.828795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.828912 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.829027 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.829158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.829275 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.829390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.829518 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.829636 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.829752 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.829867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.829982 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.830097 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.830223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.830354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.830469 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.830585 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.830700 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.830816 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.830939 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.831057 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.831172 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.831288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.831404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.831528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.831645 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.831760 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.831882 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.831999 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.832114 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.832237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.832355 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.832471 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.832597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.832597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.832815 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.832815 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.833041 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.833210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.833326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.833326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.833544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.833544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.833776 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.833892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.834007 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.834122 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.834245 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.834245 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.834476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.834592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.834707 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.834822 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.834937 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.834937 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.835163 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.835279 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.835394 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.835511 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.835633 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.835762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.835878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.835995 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.836111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.836227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.836342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.836342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.836572 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.837202 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.837319 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.837434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.837549 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.837678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.837796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.837911 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.838026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.838142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.838257 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.838381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.838497 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.838497 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.838714 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.838714 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.838930 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.839053 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.839170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.839170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.839387 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.839387 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.839602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.839727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.839844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.839844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.840060 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.840060 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.840275 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.840404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.840522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.840638 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.840754 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.840870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.840985 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.841125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.841298 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.841420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.841536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.841651 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.841767 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.841893 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.842010 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.842010 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.842226 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.842341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.842456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.842456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.842693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.842810 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.842926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.843042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.843165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.843165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.843383 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.843383 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.843598 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.843713 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.843836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.843954 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.844069 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.844184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.844300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.844415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.844538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.844538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.844756 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.844872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.844988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.844988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.845233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.845233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.845452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.845568 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.845682 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.845682 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.845907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.846031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.846148 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.846263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.846378 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.846500 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.846624 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.846747 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.846864 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.846980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.847096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.847096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.847320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.847437 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.847552 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.847668 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.847783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.847899 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.848022 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.848140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.848255 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.848370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.848485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.848600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.848787 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.848906 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.849021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.849158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.849274 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.849390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.849517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.849634 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.849750 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.849865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.849980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.850095 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.850220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.850336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.850450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.850566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.850680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.850795 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.850919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.851035 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.851151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.851266 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.851381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.851381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.851605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.851722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.851837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.851837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.852053 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.852168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.852321 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.853001 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.853165 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.853165 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.853386 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.853386 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.853616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.853734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.853850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.853965 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.854081 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.854196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.854320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.854438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.854553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.854668 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.854783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.854899 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.855023 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.855139 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.855255 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.855370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.855487 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.855602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.855725 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.855842 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.855957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] role.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.856073 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.856281 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] role.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.856427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] role.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.856556 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.856674 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] role.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.856789 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.856904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.857020 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.857176 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.857294 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.857410 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.857526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.857642 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.857757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.857880 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.857997 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.858112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.858227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.858341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.858456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.858580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.858697 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.858818 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.858940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.859057 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.859171 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.859295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.859411 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.859527 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.859644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.859759 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.859874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.859997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.860114 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.860240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.860355 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.860470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.860585 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.860709 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.860826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.860942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.861118 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.861238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.861344 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.861470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.861587 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.861702 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.861818 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.861933 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.862055 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.862172 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.862287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.862401 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.862516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.862630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.862752 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.862873 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.862988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.863103 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.863218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.863332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.863455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.863572 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.863687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.863802 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.863917 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.864031 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.864153 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.864270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.864385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.864499 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.864614 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.864728 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.864851 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.864968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.865097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.865214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.865330 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.865444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.865571 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.865689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.865804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.865920 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.866035 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.866150 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.866273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.866389 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.866505 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.866620 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.866735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.866849 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.866973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.867090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.867205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.867327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.867443 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.867557 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.867680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.867797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.867934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.868050 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.868165 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.868279 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.868406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.868524 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.868638 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.868761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.868886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.869003 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.connection = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.869215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.869344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.869461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.869461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.869687 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.869803 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.869918 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.870033 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.870149 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.870273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.870389 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.870504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.870619 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.870734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.870849 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.870972 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.871089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.871205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.871320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.871435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.871550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.871672 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.871797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.871913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.872028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.872143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.872258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.872382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.872553 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.872677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.872793 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.872913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.873028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.873233 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 06 10:47:57.873353 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.873353 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 10:47:57.873353 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 06 10:47:57.902000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:57.902198 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:57.902287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:57.902437 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:57.902519 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:57.902671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:57.911323 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:57.911574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:57.941504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:57.941670 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:57.941751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:57.941892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:57.997551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:57.997801 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.047733 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.047964 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.048149 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.048390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.115213 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.115446 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.115671 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.115892 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.115990 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.116113 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.116194 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.116331 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.116412 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.116585 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.116805 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.117023 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.140635 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.140867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.140949 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.141125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.141210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.141355 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.141436 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.141580 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.141674 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.141802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.141883 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.142024 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.142102 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.142240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.153435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.155093 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.166560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.166793 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.166874 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.167023 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.167106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.167253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.167333 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.167473 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.167562 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.167693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.167774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.167909 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.167989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.168128 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 10:47:58.185628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.185734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.185870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 06 10:47:58.186041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 06 10:47:58.186215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.186368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.186504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 06 10:47:58.186631 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 06 10:47:58.186764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.186895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.187034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.187164 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.187293 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.187424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.187554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.187683 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.198837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.198981 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.199110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.199240 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.199371 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.199513 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.199644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.199777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.207781 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.207924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.211113 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.211246 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.211373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.211499 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.211682 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.211812 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.211949 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.212076 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.212343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.212472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.212597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.212740 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.212868 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.212994 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.213154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.213283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.213419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.213546 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.213672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.213797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.213923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.214049 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.241097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.241245 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.242713 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.242844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.247483 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.247630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.248841 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.248971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.249145 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.249276 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.249423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.249556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.256767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.256905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.257070 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.257192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.261797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.262084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.262210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.262313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.262426 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.262617 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.262720 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.262819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.262918 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.263326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.263469 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.263581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.263685 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.263784 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.263889 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.263988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.283256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.283683 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.284248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.284553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.288457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.289202 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.293027 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.293349 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.297175 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.297485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.298867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.302668 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.302841 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.306951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.309406 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.309715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.310006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.310290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.310671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.310853 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.312423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.312727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.313283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.313576 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.313857 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.314136 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.330633 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.330922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.334447 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.334776 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.433003 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.433321 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.441869 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.443614 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.443896 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.444568 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.444861 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.447020 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.447308 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.447593 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.448043 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.448326 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.453151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.454818 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.455094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.458163 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.458450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.458736 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.459178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.459461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.461882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.462163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.462443 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.462726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.463009 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.463286 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.463570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.472874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.473177 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.473463 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.473762 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.474029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.474304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.474593 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.483281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.486616 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.489989 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.491613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.493942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.494037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.494223 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.494515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.497283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.500645 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.501922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.502299 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.503546 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.504060 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.504338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.504630 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.506820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.507108 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.507397 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.507671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.512048 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.513695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.516923 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.517018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.517241 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.517324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.517541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.517623 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.517820 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.526070 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.526353 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.526637 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.526917 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.527188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.527486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.527628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.527772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.527916 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.528051 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.528200 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.528320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.528699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.528984 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.529284 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.529556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.529836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.536359 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 10:47:58.536645 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.536928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.537231 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.537507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.537799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.538086 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.538365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.538644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.539021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.539300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.539577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.540409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.540691 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 10:47:58.569037 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563a766f99c0 pid: 80201 (default app) Apr 06 10:47:58.573230 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d27e8f-e46e-4135-85e2-f5b6cbd15ee6 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:47:58.573524 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d27e8f-e46e-4135-85e2-f5b6cbd15ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:47:58.573806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d27e8f-e46e-4135-85e2-f5b6cbd15ee6 None None] PATH_INFO: `/v3` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:47:58.578205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Wed Apr 6 10:47:58 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:47:58.579989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563a766f99c0 pid: 80202 (default app) Apr 06 10:48:07.647742 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725383-163b-4af4-ae2a-b4e5dd56c934 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:07.648315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725383-163b-4af4-ae2a-b4e5dd56c934 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:07.648315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725383-163b-4af4-ae2a-b4e5dd56c934 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:07.649704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:48:07.657507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0466754-87d2-49e0-adc6-aae12bc2dc88 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:07.657932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0466754-87d2-49e0-adc6-aae12bc2dc88 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:07.658062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0466754-87d2-49e0-adc6-aae12bc2dc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:07.689211 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG oslo_db.sqlalchemy.engines [None req-a0466754-87d2-49e0-adc6-aae12bc2dc88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80202) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 10:48:07.874592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG passlib.handlers.bcrypt [None req-a0466754-87d2-49e0-adc6-aae12bc2dc88 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80202) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 06 10:48:07.875628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG passlib.handlers.bcrypt [None req-a0466754-87d2-49e0-adc6-aae12bc2dc88 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80202) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 06 10:48:07.931327 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a0466754-87d2-49e0-adc6-aae12bc2dc88 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:07.932899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a0466754-87d2-49e0-adc6-aae12bc2dc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:08.055118 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1/3] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 06 10:48:08.200877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725383-163b-4af4-ae2a-b4e5dd56c934 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:08.234132 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG oslo_db.sqlalchemy.engines [None req-bb725383-163b-4af4-ae2a-b4e5dd56c934 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 10:48:08.361187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725383-163b-4af4-ae2a-b4e5dd56c934 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:08.365440 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa1fb1-55f7-4865-9ec8-8eb7de89bcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:08.366094 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1fb1-55f7-4865-9ec8-8eb7de89bcc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:08.366376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1fb1-55f7-4865-9ec8-8eb7de89bcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:08.366649 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1fb1-55f7-4865-9ec8-8eb7de89bcc2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:08.375892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa1fb1-55f7-4865-9ec8-8eb7de89bcc2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:08.425872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b5aa1fb1-55f7-4865-9ec8-8eb7de89bcc2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 06 10:48:08.426209 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa1fb1-55f7-4865-9ec8-8eb7de89bcc2 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:08.436327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 3/4] 10.222.0.62 () {58 vars in 1324 bytes} [Wed Apr 6 10:48:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 06 10:48:08.443974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0466754-87d2-49e0-adc6-aae12bc2dc88 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:08.458777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0466754-87d2-49e0-adc6-aae12bc2dc88 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:08.463158 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4989f-c4fa-4a36-b12c-984f35de37f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:08.464265 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4989f-c4fa-4a36-b12c-984f35de37f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:08.464551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4989f-c4fa-4a36-b12c-984f35de37f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:08.464859 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4989f-c4fa-4a36-b12c-984f35de37f6 admin admin] PATH_INFO: `/v3/projects/279d4a89a1294ac096e396e32f9abd36` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:08.466508 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4989f-c4fa-4a36-b12c-984f35de37f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=279d4a89a1294ac096e396e32f9abd36)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:08.519785 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.common.rbac_enforcer.enforcer [None req-84d4989f-c4fa-4a36-b12c-984f35de37f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 06 10:48:08.520124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4989f-c4fa-4a36-b12c-984f35de37f6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:08.524758 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 2/5] 10.222.0.62 () {56 vars in 1207 bytes} [Wed Apr 6 10:48:08 2022] GET /identity/v3/projects/279d4a89a1294ac096e396e32f9abd36 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:10.781686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2da9d-8cb1-476f-b80c-c9017bd52005 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:10.782255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2da9d-8cb1-476f-b80c-c9017bd52005 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:10.782255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2da9d-8cb1-476f-b80c-c9017bd52005 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:10.786468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 4/6] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:48:10.792381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3309860-a2bf-4da2-a204-efee6c29222e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:10.792796 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3309860-a2bf-4da2-a204-efee6c29222e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:10.792934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3309860-a2bf-4da2-a204-efee6c29222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:10.811088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b3309860-a2bf-4da2-a204-efee6c29222e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:10.812623 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b3309860-a2bf-4da2-a204-efee6c29222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:10.820683 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 3/7] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 06 10:48:10.842769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2da9d-8cb1-476f-b80c-c9017bd52005 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:10.855198 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2da9d-8cb1-476f-b80c-c9017bd52005 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:10.859452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91c966-6bbf-45d5-84dd-38e059a5b854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:10.860080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91c966-6bbf-45d5-84dd-38e059a5b854 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:10.860364 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91c966-6bbf-45d5-84dd-38e059a5b854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:10.860643 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91c966-6bbf-45d5-84dd-38e059a5b854 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:10.868345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91c966-6bbf-45d5-84dd-38e059a5b854 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:10.870156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91c966-6bbf-45d5-84dd-38e059a5b854 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:10.878806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 5/8] 10.222.0.62 () {58 vars in 1324 bytes} [Wed Apr 6 10:48:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 10:48:10.885179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3309860-a2bf-4da2-a204-efee6c29222e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:10.893992 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3309860-a2bf-4da2-a204-efee6c29222e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:10.898303 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70cdb5-4b1e-48f1-aa38-14d9835d7e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:10.899722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70cdb5-4b1e-48f1-aa38-14d9835d7e5c admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:10.900004 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70cdb5-4b1e-48f1-aa38-14d9835d7e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:10.900278 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70cdb5-4b1e-48f1-aa38-14d9835d7e5c admin admin] PATH_INFO: `/v3/users/2081d2092d1f43b39f058ddf8338a375` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:10.901701 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70cdb5-4b1e-48f1-aa38-14d9835d7e5c admin admin] RBAC: Authorizing `identity:get_user(user_id=2081d2092d1f43b39f058ddf8338a375)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:10.903541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70cdb5-4b1e-48f1-aa38-14d9835d7e5c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:10.905095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 4/9] 10.222.0.62 () {56 vars in 1198 bytes} [Wed Apr 6 10:48:10 2022] GET /identity/v3/users/2081d2092d1f43b39f058ddf8338a375 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:13.240147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f32f94-9e6b-40e8-9395-9ca2ce6965ad None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:13.240685 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f32f94-9e6b-40e8-9395-9ca2ce6965ad None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:13.240685 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f32f94-9e6b-40e8-9395-9ca2ce6965ad None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:13.242109 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:13.247251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48947960-59be-4f9b-91a6-8f0c85acf21f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:13.247631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48947960-59be-4f9b-91a6-8f0c85acf21f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:13.247905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48947960-59be-4f9b-91a6-8f0c85acf21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:13.264490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-48947960-59be-4f9b-91a6-8f0c85acf21f None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:13.265680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-48947960-59be-4f9b-91a6-8f0c85acf21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:13.287051 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0800a-b5c8-4057-b96e-60abdfc5b8f7 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:13.287341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0800a-b5c8-4057-b96e-60abdfc5b8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:13.287624 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0800a-b5c8-4057-b96e-60abdfc5b8f7 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:13.288978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 7/11] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:48:13.293991 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f1e98-ae78-4384-89ea-ad227c4fdda7 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:13.294281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f1e98-ae78-4384-89ea-ad227c4fdda7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:13.294559 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f1e98-ae78-4384-89ea-ad227c4fdda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:13.335400 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG passlib.handlers.bcrypt [None req-fc8f1e98-ae78-4384-89ea-ad227c4fdda7 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80201) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 06 10:48:13.335818 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG passlib.handlers.bcrypt [None req-fc8f1e98-ae78-4384-89ea-ad227c4fdda7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80201) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 06 10:48:13.348821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 5/12] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:13.373192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48947960-59be-4f9b-91a6-8f0c85acf21f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:13.383741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-fc8f1e98-ae78-4384-89ea-ad227c4fdda7 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:13.385409 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fc8f1e98-ae78-4384-89ea-ad227c4fdda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:13.470011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48947960-59be-4f9b-91a6-8f0c85acf21f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:13.481618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 8/13] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:48:13.503586 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1932-e748-4a28-8720-04ef2e02b570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:13.504327 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1932-e748-4a28-8720-04ef2e02b570 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:13.504616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1932-e748-4a28-8720-04ef2e02b570 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:13.504894 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1932-e748-4a28-8720-04ef2e02b570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:13.505028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f1e98-ae78-4384-89ea-ad227c4fdda7 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:13.515777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa1932-e748-4a28-8720-04ef2e02b570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:13.522694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-d6aa1932-e748-4a28-8720-04ef2e02b570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:48:13.524425 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 6/14] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:48:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:13.530031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1932-e748-4a28-8720-04ef2e02b570 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:13.600424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f1e98-ae78-4384-89ea-ad227c4fdda7 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:13.623782 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1932-e748-4a28-8720-04ef2e02b570 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:13.631859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711a78-83b6-45ea-a123-0d071b63252b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:13.632748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711a78-83b6-45ea-a123-0d071b63252b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:13.633048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711a78-83b6-45ea-a123-0d071b63252b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:13.633365 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711a78-83b6-45ea-a123-0d071b63252b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:13.656859 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321e724-0c1e-4804-b998-7249ff743dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:13.657578 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321e724-0c1e-4804-b998-7249ff743dbe None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:13.657872 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321e724-0c1e-4804-b998-7249ff743dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:13.658146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321e724-0c1e-4804-b998-7249ff743dbe None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:13.658905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321e724-0c1e-4804-b998-7249ff743dbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:13.659216 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321e724-0c1e-4804-b998-7249ff743dbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:13.660656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321e724-0c1e-4804-b998-7249ff743dbe None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:13.672492 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 7/15] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:13.678174 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321e724-0c1e-4804-b998-7249ff743dbe None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:13.700947 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711a78-83b6-45ea-a123-0d071b63252b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:13.702515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711a78-83b6-45ea-a123-0d071b63252b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:13.780472 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321e724-0c1e-4804-b998-7249ff743dbe None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:13.796835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 9/16] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 10:48:13.803662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711a78-83b6-45ea-a123-0d071b63252b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:13.812832 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50b11e-2a64-43ce-8129-d4554fabfc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:13.813977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b11e-2a64-43ce-8129-d4554fabfc9f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:13.814269 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b11e-2a64-43ce-8129-d4554fabfc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:13.814541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b11e-2a64-43ce-8129-d4554fabfc9f None admin] PATH_INFO: `/v3/users/2081d2092d1f43b39f058ddf8338a375` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:13.815802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50b11e-2a64-43ce-8129-d4554fabfc9f None admin] RBAC: Authorizing `identity:get_user(user_id=2081d2092d1f43b39f058ddf8338a375)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:13.817350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50b11e-2a64-43ce-8129-d4554fabfc9f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:13.818984 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 8/17] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:13 2022] GET /identity/v3/users/2081d2092d1f43b39f058ddf8338a375 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:13.824182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50b11e-2a64-43ce-8129-d4554fabfc9f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:13.895652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711a78-83b6-45ea-a123-0d071b63252b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:13.916254 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50b11e-2a64-43ce-8129-d4554fabfc9f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:13.928454 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b26f42-35ab-4181-b20a-2683fa2ebe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:13.929290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b26f42-35ab-4181-b20a-2683fa2ebe1d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:13.929573 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b26f42-35ab-4181-b20a-2683fa2ebe1d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:13.929851 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b26f42-35ab-4181-b20a-2683fa2ebe1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:13.948323 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02210f6e-5e60-4ff6-90a9-5730b9b1bc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:13.948481 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b26f42-35ab-4181-b20a-2683fa2ebe1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:13.949117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02210f6e-5e60-4ff6-90a9-5730b9b1bc94 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:13.949400 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02210f6e-5e60-4ff6-90a9-5730b9b1bc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:13.949672 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02210f6e-5e60-4ff6-90a9-5730b9b1bc94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:13.949931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b26f42-35ab-4181-b20a-2683fa2ebe1d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:13.950833 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02210f6e-5e60-4ff6-90a9-5730b9b1bc94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:13.952310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02210f6e-5e60-4ff6-90a9-5730b9b1bc94 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:13.953927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 9/18] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:13.959527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02210f6e-5e60-4ff6-90a9-5730b9b1bc94 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:13.967112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-e2b26f42-35ab-4181-b20a-2683fa2ebe1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:48:13.968330 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 10/19] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:48:13.973725 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b26f42-35ab-4181-b20a-2683fa2ebe1d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:14.065690 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02210f6e-5e60-4ff6-90a9-5730b9b1bc94 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:14.071002 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b26f42-35ab-4181-b20a-2683fa2ebe1d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:14.096642 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded6fe4-1f71-44fd-991c-04134b971f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:14.097312 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded6fe4-1f71-44fd-991c-04134b971f0e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:14.097594 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded6fe4-1f71-44fd-991c-04134b971f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:14.097864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded6fe4-1f71-44fd-991c-04134b971f0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:14.098681 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded6fe4-1f71-44fd-991c-04134b971f0e None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.domain.id=default, user.id=2081d2092d1f43b39f058ddf8338a375) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:14.098992 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded6fe4-1f71-44fd-991c-04134b971f0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:14.100473 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded6fe4-1f71-44fd-991c-04134b971f0e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:14.102830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d443ad-066c-4fdd-bc16-7d540299466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:14.103496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d443ad-066c-4fdd-bc16-7d540299466c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:14.103782 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d443ad-066c-4fdd-bc16-7d540299466c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:14.104059 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d443ad-066c-4fdd-bc16-7d540299466c None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:14.104786 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d443ad-066c-4fdd-bc16-7d540299466c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:14.105123 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d443ad-066c-4fdd-bc16-7d540299466c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:14.106497 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d443ad-066c-4fdd-bc16-7d540299466c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:14.107398 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 10/20] 10.222.0.62 () {56 vars in 1322 bytes} [Wed Apr 6 10:48:13 2022] GET /identity/v3/role_assignments?user.id=2081d2092d1f43b39f058ddf8338a375&scope.domain.id=default&role.id=090ba4d1ae32495289276665920d4a2c => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:14.125378 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 11/21] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:16.930532 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91c7cc-ef93-4069-8939-6dd8cd98f201 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:16.931031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91c7cc-ef93-4069-8939-6dd8cd98f201 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:16.931031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91c7cc-ef93-4069-8939-6dd8cd98f201 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:16.932692 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 11/22] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:16.938378 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c47ec-214c-4e17-9bfe-f26e43dbb632 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:16.938779 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c47ec-214c-4e17-9bfe-f26e43dbb632 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:16.939005 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c47ec-214c-4e17-9bfe-f26e43dbb632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:16.962605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0c1c47ec-214c-4e17-9bfe-f26e43dbb632 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:16.963831 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0c1c47ec-214c-4e17-9bfe-f26e43dbb632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:17.049736 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 12/23] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:17.098555 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91c7cc-ef93-4069-8939-6dd8cd98f201 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:17.204470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8fd5e-002f-46b5-ae3c-d453903922f3 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:17.205118 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8fd5e-002f-46b5-ae3c-d453903922f3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:17.205761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8fd5e-002f-46b5-ae3c-d453903922f3 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:17.207332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:17.218495 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360cc27-f81c-4fd9-a664-7f63a8bbfc49 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:17.218785 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360cc27-f81c-4fd9-a664-7f63a8bbfc49 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:17.219060 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360cc27-f81c-4fd9-a664-7f63a8bbfc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:17.231946 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91c7cc-ef93-4069-8939-6dd8cd98f201 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:17.246816 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-2360cc27-f81c-4fd9-a664-7f63a8bbfc49 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:17.248029 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2360cc27-f81c-4fd9-a664-7f63a8bbfc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:17.270698 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce6f0d-2a3b-4986-8d92-3472ede0d98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:17.271495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce6f0d-2a3b-4986-8d92-3472ede0d98c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:17.271769 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce6f0d-2a3b-4986-8d92-3472ede0d98c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:17.272037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce6f0d-2a3b-4986-8d92-3472ede0d98c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:17.290137 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce6f0d-2a3b-4986-8d92-3472ede0d98c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:17.294898 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce6f0d-2a3b-4986-8d92-3472ede0d98c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:17.327645 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-f3ce6f0d-2a3b-4986-8d92-3472ede0d98c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:48:17.333856 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 12/25] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:17.345446 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4d130-9225-4508-a977-259700d339f9 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:17.345731 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4d130-9225-4508-a977-259700d339f9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:17.346011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4d130-9225-4508-a977-259700d339f9 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:17.349446 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 13/26] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:17 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:17.351728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4d130-9225-4508-a977-259700d339f9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:17.390077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 14/27] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:17.391386 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becb663-8223-4666-914e-18937663c980 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:17.391682 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becb663-8223-4666-914e-18937663c980 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:17.391960 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becb663-8223-4666-914e-18937663c980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:17.430979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-9becb663-8223-4666-914e-18937663c980 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:17.432239 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9becb663-8223-4666-914e-18937663c980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:17.467769 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4d130-9225-4508-a977-259700d339f9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:17.500306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 15/28] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:17.501368 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafa9ef-d010-4a2c-a53e-465aa430b318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:17.501750 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bada1a-c6ff-4773-b586-62695971a236 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:17.502031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafa9ef-d010-4a2c-a53e-465aa430b318 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:17.502134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bada1a-c6ff-4773-b586-62695971a236 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:17.502301 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafa9ef-d010-4a2c-a53e-465aa430b318 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:17.502397 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bada1a-c6ff-4773-b586-62695971a236 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:17.502576 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafa9ef-d010-4a2c-a53e-465aa430b318 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:17.503299 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafa9ef-d010-4a2c-a53e-465aa430b318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:17.503732 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 16/29] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:17.503896 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafa9ef-d010-4a2c-a53e-465aa430b318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:17.504246 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bada1a-c6ff-4773-b586-62695971a236 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:17.505083 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafa9ef-d010-4a2c-a53e-465aa430b318 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:17.523191 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 14/30] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:17.524649 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7e992-0da4-44a8-8e10-be2ec920bc99 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:17.524931 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7e992-0da4-44a8-8e10-be2ec920bc99 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:17.525233 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7e992-0da4-44a8-8e10-be2ec920bc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:17.541747 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6ae7e992-0da4-44a8-8e10-be2ec920bc99 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:17.542998 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6ae7e992-0da4-44a8-8e10-be2ec920bc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:17.610845 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 15/31] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:17.611744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7e992-0da4-44a8-8e10-be2ec920bc99 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:17.619304 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bada1a-c6ff-4773-b586-62695971a236 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:17.679170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039521d1-66d6-4760-a471-0178480bc7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:17.680231 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039521d1-66d6-4760-a471-0178480bc7f7 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:17.680552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039521d1-66d6-4760-a471-0178480bc7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:17.681188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039521d1-66d6-4760-a471-0178480bc7f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:17.682472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039521d1-66d6-4760-a471-0178480bc7f7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:17.684212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039521d1-66d6-4760-a471-0178480bc7f7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:17.733761 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7e992-0da4-44a8-8e10-be2ec920bc99 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:17.767639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1275b3-bf1c-4b7e-a772-81c2ec06b830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:17.768322 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1275b3-bf1c-4b7e-a772-81c2ec06b830 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:17.768608 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1275b3-bf1c-4b7e-a772-81c2ec06b830 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:17.768881 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1275b3-bf1c-4b7e-a772-81c2ec06b830 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:17.769628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1275b3-bf1c-4b7e-a772-81c2ec06b830 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:17.771254 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1275b3-bf1c-4b7e-a772-81c2ec06b830 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:17.911879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 17/32] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Apr 6 10:48:17 2022] POST /identity/v3/roles => generated 225 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:48:17.912866 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039521d1-66d6-4760-a471-0178480bc7f7 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:17.982829 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 16/33] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Apr 6 10:48:17 2022] POST /identity/v3/projects => generated 301 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:48:17.985409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1275b3-bf1c-4b7e-a772-81c2ec06b830 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:18.120082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039521d1-66d6-4760-a471-0178480bc7f7 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:18.134716 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1275b3-bf1c-4b7e-a772-81c2ec06b830 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:18.176205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebef29c-a85f-4460-b201-cc06f9f52728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:18.177437 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebef29c-a85f-4460-b201-cc06f9f52728 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:18.177939 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebef29c-a85f-4460-b201-cc06f9f52728 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:18.178419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebef29c-a85f-4460-b201-cc06f9f52728 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:18.193482 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebef29c-a85f-4460-b201-cc06f9f52728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:18.199314 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d4962-15dd-4496-a548-b1f0f992314e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:18.200030 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d4962-15dd-4496-a548-b1f0f992314e None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:18.200317 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d4962-15dd-4496-a548-b1f0f992314e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:18.200599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d4962-15dd-4496-a548-b1f0f992314e None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:18.201435 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d4962-15dd-4496-a548-b1f0f992314e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:18.203019 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d4962-15dd-4496-a548-b1f0f992314e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:18.203749 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-4ebef29c-a85f-4460-b201-cc06f9f52728 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:48:18.205352 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 17/34] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:48:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:18.213094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f07b9-c9a8-4db7-a570-db3931ffef9f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:18.213094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f07b9-c9a8-4db7-a570-db3931ffef9f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:18.213094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f07b9-c9a8-4db7-a570-db3931ffef9f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:18.213094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 18/35] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:18.215513 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f07b9-c9a8-4db7-a570-db3931ffef9f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:18.284748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 18/36] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Apr 6 10:48:17 2022] POST /identity/v3/roles => generated 219 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:48:18.287790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a47e6-9d88-4748-a3ea-872c750d0e19 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:18.288356 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a47e6-9d88-4748-a3ea-872c750d0e19 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:18.288890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a47e6-9d88-4748-a3ea-872c750d0e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:18.318992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-388a47e6-9d88-4748-a3ea-872c750d0e19 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:18.321307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-388a47e6-9d88-4748-a3ea-872c750d0e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:18.332495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f07b9-c9a8-4db7-a570-db3931ffef9f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:18.377864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdba44-89d0-4ff6-9859-fbd0a7482957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:18.378860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdba44-89d0-4ff6-9859-fbd0a7482957 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:18.379358 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdba44-89d0-4ff6-9859-fbd0a7482957 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:18.379816 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdba44-89d0-4ff6-9859-fbd0a7482957 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:18.381032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdba44-89d0-4ff6-9859-fbd0a7482957 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:18.381496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdba44-89d0-4ff6-9859-fbd0a7482957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:18.383812 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdba44-89d0-4ff6-9859-fbd0a7482957 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:18.393742 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 19/37] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:18.401235 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdba44-89d0-4ff6-9859-fbd0a7482957 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:18.425221 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 19/38] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:18.454073 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a47e6-9d88-4748-a3ea-872c750d0e19 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:18.537867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdba44-89d0-4ff6-9859-fbd0a7482957 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:18.567694 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a47e6-9d88-4748-a3ea-872c750d0e19 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:18.579237 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548f163-b5ea-40b0-8f49-fece7035965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:18.580112 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548f163-b5ea-40b0-8f49-fece7035965d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:18.580393 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548f163-b5ea-40b0-8f49-fece7035965d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:18.580672 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548f163-b5ea-40b0-8f49-fece7035965d None admin] PATH_INFO: `/v3/users/2081d2092d1f43b39f058ddf8338a375` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:18.582024 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548f163-b5ea-40b0-8f49-fece7035965d None admin] RBAC: Authorizing `identity:get_user(user_id=2081d2092d1f43b39f058ddf8338a375)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:18.583498 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548f163-b5ea-40b0-8f49-fece7035965d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:18.585332 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 20/39] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:18 2022] GET /identity/v3/users/2081d2092d1f43b39f058ddf8338a375 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:18.590392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548f163-b5ea-40b0-8f49-fece7035965d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:18.604801 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29cedf-6e9a-4939-a616-0de70a5fd9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:18.605662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29cedf-6e9a-4939-a616-0de70a5fd9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:18.605951 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29cedf-6e9a-4939-a616-0de70a5fd9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:18.606229 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29cedf-6e9a-4939-a616-0de70a5fd9d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:18.607691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29cedf-6e9a-4939-a616-0de70a5fd9d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:18.609622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29cedf-6e9a-4939-a616-0de70a5fd9d9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:18.611154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 20/40] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:18.616530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29cedf-6e9a-4939-a616-0de70a5fd9d9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:18.703501 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548f163-b5ea-40b0-8f49-fece7035965d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:18.740817 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dccfd4-3670-455a-a9c8-1ec6942be67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:18.741654 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dccfd4-3670-455a-a9c8-1ec6942be67a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:18.741939 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dccfd4-3670-455a-a9c8-1ec6942be67a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:18.742212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dccfd4-3670-455a-a9c8-1ec6942be67a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:18.743106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29cedf-6e9a-4939-a616-0de70a5fd9d9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:18.744146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dccfd4-3670-455a-a9c8-1ec6942be67a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:18.745699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dccfd4-3670-455a-a9c8-1ec6942be67a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:18.747372 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 21/41] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:18.753140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dccfd4-3670-455a-a9c8-1ec6942be67a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:18.777150 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d3f25-dc25-4c5a-af12-b8b8d18df20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:18.777829 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d3f25-dc25-4c5a-af12-b8b8d18df20f None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:18.778112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d3f25-dc25-4c5a-af12-b8b8d18df20f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:18.778403 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d3f25-dc25-4c5a-af12-b8b8d18df20f None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:18.779135 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d3f25-dc25-4c5a-af12-b8b8d18df20f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:18.780667 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d3f25-dc25-4c5a-af12-b8b8d18df20f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:18.849460 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 21/42] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Apr 6 10:48:18 2022] POST /identity/v3/projects => generated 312 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:48:18.850155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dccfd4-3670-455a-a9c8-1ec6942be67a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:18.851016 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99154d9-17e2-41eb-b091-3a818603ebcc None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:18.851312 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99154d9-17e2-41eb-b091-3a818603ebcc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:18.851592 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99154d9-17e2-41eb-b091-3a818603ebcc None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:18.853522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 22/43] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:18.859327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee85cab-a8b5-4836-b1fe-3958c1aeb670 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:18.859629 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee85cab-a8b5-4836-b1fe-3958c1aeb670 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:18.859897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee85cab-a8b5-4836-b1fe-3958c1aeb670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:18.877808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-dee85cab-a8b5-4836-b1fe-3958c1aeb670 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:18.879065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-dee85cab-a8b5-4836-b1fe-3958c1aeb670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:18.887332 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c34f89-27b4-4d07-a377-c35e19f8eb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:18.888507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c34f89-27b4-4d07-a377-c35e19f8eb05 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:18.889160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c34f89-27b4-4d07-a377-c35e19f8eb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:18.889160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c34f89-27b4-4d07-a377-c35e19f8eb05 None admin] PATH_INFO: `/v3/domains/default/users/2081d2092d1f43b39f058ddf8338a375/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:18.891227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c34f89-27b4-4d07-a377-c35e19f8eb05 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2081d2092d1f43b39f058ddf8338a375, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:18.892766 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c34f89-27b4-4d07-a377-c35e19f8eb05 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:18.952145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 23/44] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:48:18.977611 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee85cab-a8b5-4836-b1fe-3958c1aeb670 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:18.986011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 22/45] 10.222.0.62 () {58 vars in 1361 bytes} [Wed Apr 6 10:48:18 2022] PUT /identity/v3/domains/default/users/2081d2092d1f43b39f058ddf8338a375/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:48:19.093106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee85cab-a8b5-4836-b1fe-3958c1aeb670 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:19.125453 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d17573-4feb-4bf0-8edf-24a320848d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:19.126099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d17573-4feb-4bf0-8edf-24a320848d03 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:19.126346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d17573-4feb-4bf0-8edf-24a320848d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:19.126605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d17573-4feb-4bf0-8edf-24a320848d03 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:19.127373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d17573-4feb-4bf0-8edf-24a320848d03 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:19.128865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d17573-4feb-4bf0-8edf-24a320848d03 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:19.208560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Apr 6 10:48:18 2022] POST /identity/v3/roles => generated 223 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:48:21.157976 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcb480-4b70-4b25-84ef-dc53581f1c74 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:21.158486 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcb480-4b70-4b25-84ef-dc53581f1c74 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:21.158566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcb480-4b70-4b25-84ef-dc53581f1c74 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:21.159940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 23/47] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:21.165728 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb2f3c-73c8-4633-8351-e3b313f7e729 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:21.166144 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb2f3c-73c8-4633-8351-e3b313f7e729 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:21.166290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb2f3c-73c8-4633-8351-e3b313f7e729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:21.182927 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-cafb2f3c-73c8-4633-8351-e3b313f7e729 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:21.184102 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-cafb2f3c-73c8-4633-8351-e3b313f7e729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:21.246755 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 25/48] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:21.270652 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcb480-4b70-4b25-84ef-dc53581f1c74 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:21.279314 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0db04-c95f-4104-86a2-e224f12183fb None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:21.279601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0db04-c95f-4104-86a2-e224f12183fb None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:21.279879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0db04-c95f-4104-86a2-e224f12183fb None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:21.281264 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 26/49] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:48:21.285982 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a3ffd-b07a-4a9d-a0eb-a67b2c1efb91 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:21.286267 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a3ffd-b07a-4a9d-a0eb-a67b2c1efb91 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:21.286542 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a3ffd-b07a-4a9d-a0eb-a67b2c1efb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:21.302549 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-025a3ffd-b07a-4a9d-a0eb-a67b2c1efb91 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:21.303749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-025a3ffd-b07a-4a9d-a0eb-a67b2c1efb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:21.365878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 27/50] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:48:21.368655 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcb480-4b70-4b25-84ef-dc53581f1c74 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:21.390274 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a3ffd-b07a-4a9d-a0eb-a67b2c1efb91 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:21.400305 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36924e2-7f98-454e-ac8f-4ae6adc19c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:21.401120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36924e2-7f98-454e-ac8f-4ae6adc19c20 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:21.401442 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36924e2-7f98-454e-ac8f-4ae6adc19c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:21.401726 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36924e2-7f98-454e-ac8f-4ae6adc19c20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:21.402937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36924e2-7f98-454e-ac8f-4ae6adc19c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:21.404433 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36924e2-7f98-454e-ac8f-4ae6adc19c20 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:21.406094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 24/51] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:21.411809 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36924e2-7f98-454e-ac8f-4ae6adc19c20 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:21.489314 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a3ffd-b07a-4a9d-a0eb-a67b2c1efb91 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:21.509196 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36924e2-7f98-454e-ac8f-4ae6adc19c20 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:21.522022 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01106877-9b2d-4689-bb7f-2e548b9f13e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:21.522828 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01106877-9b2d-4689-bb7f-2e548b9f13e8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:21.523109 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01106877-9b2d-4689-bb7f-2e548b9f13e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:21.523384 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01106877-9b2d-4689-bb7f-2e548b9f13e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:21.534292 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01106877-9b2d-4689-bb7f-2e548b9f13e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:21.540980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d4a83-b8f5-4fc5-98bd-611cb43a14a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:21.541681 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d4a83-b8f5-4fc5-98bd-611cb43a14a0 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:21.541774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-01106877-9b2d-4689-bb7f-2e548b9f13e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:48:21.541970 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d4a83-b8f5-4fc5-98bd-611cb43a14a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:21.542251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d4a83-b8f5-4fc5-98bd-611cb43a14a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:21.542917 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 28/52] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:48:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:48:21.543009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d4a83-b8f5-4fc5-98bd-611cb43a14a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:21.544599 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d4a83-b8f5-4fc5-98bd-611cb43a14a0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:21.548520 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01106877-9b2d-4689-bb7f-2e548b9f13e8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:21.640704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01106877-9b2d-4689-bb7f-2e548b9f13e8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:21.666590 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 25/53] 10.222.0.62 () {60 vars in 1140 bytes} [Wed Apr 6 10:48:21 2022] POST /identity/v3/projects => generated 298 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:48:21.673787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691fe97-edc4-44ab-a633-1dd6f533f58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:21.674483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691fe97-edc4-44ab-a633-1dd6f533f58d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:21.674767 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691fe97-edc4-44ab-a633-1dd6f533f58d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:21.675045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691fe97-edc4-44ab-a633-1dd6f533f58d None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:21.675847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691fe97-edc4-44ab-a633-1dd6f533f58d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:21.676156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691fe97-edc4-44ab-a633-1dd6f533f58d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:21.677641 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691fe97-edc4-44ab-a633-1dd6f533f58d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:21.694445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 29/54] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:21.700190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d4a83-b8f5-4fc5-98bd-611cb43a14a0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:21.809069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d4a83-b8f5-4fc5-98bd-611cb43a14a0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:21.844549 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7777a-f522-40cb-985b-185f1ed5bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:21.845465 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7777a-f522-40cb-985b-185f1ed5bef6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:21.845749 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7777a-f522-40cb-985b-185f1ed5bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:21.846036 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7777a-f522-40cb-985b-185f1ed5bef6 None admin] PATH_INFO: `/v3/users/2081d2092d1f43b39f058ddf8338a375` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:21.847234 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7777a-f522-40cb-985b-185f1ed5bef6 None admin] RBAC: Authorizing `identity:get_user(user_id=2081d2092d1f43b39f058ddf8338a375)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:21.848732 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7777a-f522-40cb-985b-185f1ed5bef6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:21.850714 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 26/55] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:21 2022] GET /identity/v3/users/2081d2092d1f43b39f058ddf8338a375 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:21.856838 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691fe97-edc4-44ab-a633-1dd6f533f58d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:21.954279 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691fe97-edc4-44ab-a633-1dd6f533f58d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:21.987285 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458487c-4b2c-458b-8b1d-d963e51e4045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:21.988081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458487c-4b2c-458b-8b1d-d963e51e4045 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:21.988371 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458487c-4b2c-458b-8b1d-d963e51e4045 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:21.988653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458487c-4b2c-458b-8b1d-d963e51e4045 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:21.990015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458487c-4b2c-458b-8b1d-d963e51e4045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:21.991349 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458487c-4b2c-458b-8b1d-d963e51e4045 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:21.993036 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 30/56] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:21.998812 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7777a-f522-40cb-985b-185f1ed5bef6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:22.094703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7777a-f522-40cb-985b-185f1ed5bef6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:22.126529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87008f-ba01-471e-88b4-0072abb2cde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:22.127183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87008f-ba01-471e-88b4-0072abb2cde9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:22.127474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87008f-ba01-471e-88b4-0072abb2cde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:22.127773 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87008f-ba01-471e-88b4-0072abb2cde9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:22.128577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87008f-ba01-471e-88b4-0072abb2cde9 None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.domain.id=default, user.id=2081d2092d1f43b39f058ddf8338a375) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:22.128892 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87008f-ba01-471e-88b4-0072abb2cde9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:22.130403 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87008f-ba01-471e-88b4-0072abb2cde9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:22.136752 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 27/57] 10.222.0.62 () {56 vars in 1322 bytes} [Wed Apr 6 10:48:21 2022] GET /identity/v3/role_assignments?user.id=2081d2092d1f43b39f058ddf8338a375&scope.domain.id=default&role.id=090ba4d1ae32495289276665920d4a2c => generated 530 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:23.961594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec8532-d133-44aa-9c64-3c80bf89cb72 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:23.962175 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec8532-d133-44aa-9c64-3c80bf89cb72 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:23.962175 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec8532-d133-44aa-9c64-3c80bf89cb72 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:23.963731 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 31/58] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:23.969560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c15408-c847-4874-8592-5639ef10862d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:23.969959 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c15408-c847-4874-8592-5639ef10862d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:23.970230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c15408-c847-4874-8592-5639ef10862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:23.988543 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c0c15408-c847-4874-8592-5639ef10862d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:23.990157 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c0c15408-c847-4874-8592-5639ef10862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:24.053319 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 28/59] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:24.078730 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec8532-d133-44aa-9c64-3c80bf89cb72 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:24.174243 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec8532-d133-44aa-9c64-3c80bf89cb72 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:24.206501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71555521-b476-4bc9-8212-d35706ea3f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:24.207276 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71555521-b476-4bc9-8212-d35706ea3f6d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:24.207565 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71555521-b476-4bc9-8212-d35706ea3f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:24.207840 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71555521-b476-4bc9-8212-d35706ea3f6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:24.209006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71555521-b476-4bc9-8212-d35706ea3f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:24.210466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71555521-b476-4bc9-8212-d35706ea3f6d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:24.212158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 32/60] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:24.217320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c15408-c847-4874-8592-5639ef10862d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:24.308155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c15408-c847-4874-8592-5639ef10862d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:24.339699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac91f0-74f4-48b8-82ea-e207f0d6b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:24.340348 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac91f0-74f4-48b8-82ea-e207f0d6b51c None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:24.340634 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac91f0-74f4-48b8-82ea-e207f0d6b51c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:24.340910 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac91f0-74f4-48b8-82ea-e207f0d6b51c None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:24.341645 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac91f0-74f4-48b8-82ea-e207f0d6b51c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:24.343212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac91f0-74f4-48b8-82ea-e207f0d6b51c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:24.447573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 29/61] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:48:24 2022] POST /identity/v3/users => generated 275 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:48:27.707213 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7bdbe-89a8-4d5b-b324-fc1c24bd82de None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:27.709859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7bdbe-89a8-4d5b-b324-fc1c24bd82de None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:27.709859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7bdbe-89a8-4d5b-b324-fc1c24bd82de None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:27.709859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 33/62] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:27.715520 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd8de3-688b-47aa-88ae-f13ba28a01c9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:27.716423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd8de3-688b-47aa-88ae-f13ba28a01c9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:27.716907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd8de3-688b-47aa-88ae-f13ba28a01c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:27.742044 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-cefd8de3-688b-47aa-88ae-f13ba28a01c9 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:27.744096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-cefd8de3-688b-47aa-88ae-f13ba28a01c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:27.832130 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 30/63] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:27.877285 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7bdbe-89a8-4d5b-b324-fc1c24bd82de None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:28.010911 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7bdbe-89a8-4d5b-b324-fc1c24bd82de None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:28.016747 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e6475-b387-46f0-b458-d3806ef25a6d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.017043 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e6475-b387-46f0-b458-d3806ef25a6d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.017367 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e6475-b387-46f0-b458-d3806ef25a6d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.018742 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 31/64] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:48:28.024465 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d95d1b-0a10-42d0-bea9-e17242d74489 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.025022 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d95d1b-0a10-42d0-bea9-e17242d74489 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.025542 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d95d1b-0a10-42d0-bea9-e17242d74489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.053095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-26d95d1b-0a10-42d0-bea9-e17242d74489 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:28.054754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-26d95d1b-0a10-42d0-bea9-e17242d74489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:28.074050 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fbd23-bd62-47b5-bb83-f8655728be21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:28.074637 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fbd23-bd62-47b5-bb83-f8655728be21 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.074927 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fbd23-bd62-47b5-bb83-f8655728be21 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.075207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fbd23-bd62-47b5-bb83-f8655728be21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.102332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355fbd23-bd62-47b5-bb83-f8655728be21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:28.109702 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-355fbd23-bd62-47b5-bb83-f8655728be21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:48:28.117429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 34/65] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:28.123296 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fbd23-bd62-47b5-bb83-f8655728be21 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:28.140933 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 32/66] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:48:28.186066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d95d1b-0a10-42d0-bea9-e17242d74489 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:28.239579 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fbd23-bd62-47b5-bb83-f8655728be21 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:28.273351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44016f7a-57b2-4c1d-930b-faab4760cac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:28.274612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016f7a-57b2-4c1d-930b-faab4760cac7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.274791 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016f7a-57b2-4c1d-930b-faab4760cac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.275051 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016f7a-57b2-4c1d-930b-faab4760cac7 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.275787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44016f7a-57b2-4c1d-930b-faab4760cac7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:28.276094 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44016f7a-57b2-4c1d-930b-faab4760cac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:28.277495 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44016f7a-57b2-4c1d-930b-faab4760cac7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:28.285820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 35/67] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:28.286932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bec0c2-6b39-47d0-9677-820d88c9b691 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.287221 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bec0c2-6b39-47d0-9677-820d88c9b691 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.287497 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bec0c2-6b39-47d0-9677-820d88c9b691 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.289010 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 36/68] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:28.291929 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d95d1b-0a10-42d0-bea9-e17242d74489 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:28.293819 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bec0c2-6b39-47d0-9677-820d88c9b691 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:28.327333 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fdae8-7ffa-4238-8b93-cd2ac9eca50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:28.328481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fdae8-7ffa-4238-8b93-cd2ac9eca50e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.328985 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fdae8-7ffa-4238-8b93-cd2ac9eca50e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.329491 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fdae8-7ffa-4238-8b93-cd2ac9eca50e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.340501 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fdae8-7ffa-4238-8b93-cd2ac9eca50e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:28.347705 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-967fdae8-7ffa-4238-8b93-cd2ac9eca50e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:48:28.349165 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 33/69] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:48:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:48:28.350551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435aa90-44b8-4614-a525-5bc37ab137c3 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.351036 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435aa90-44b8-4614-a525-5bc37ab137c3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.351511 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435aa90-44b8-4614-a525-5bc37ab137c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.367921 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8435aa90-44b8-4614-a525-5bc37ab137c3 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:28.369467 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8435aa90-44b8-4614-a525-5bc37ab137c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:28.396194 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bec0c2-6b39-47d0-9677-820d88c9b691 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:28.431843 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd60961-26b5-4eb7-b1b8-d694d0d334a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:28.432712 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60961-26b5-4eb7-b1b8-d694d0d334a8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.432996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60961-26b5-4eb7-b1b8-d694d0d334a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.433375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60961-26b5-4eb7-b1b8-d694d0d334a8 None admin] PATH_INFO: `/v3/users/0577dda6ef974bbbad9fda731e953d3b` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.438873 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 34/70] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:28.440026 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435aa90-44b8-4614-a525-5bc37ab137c3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:28.458931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd60961-26b5-4eb7-b1b8-d694d0d334a8 None admin] RBAC: Authorizing `identity:get_user(user_id=0577dda6ef974bbbad9fda731e953d3b)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:28.460439 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd60961-26b5-4eb7-b1b8-d694d0d334a8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:28.470548 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 37/71] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:28 2022] GET /identity/v3/users/0577dda6ef974bbbad9fda731e953d3b => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:28.476114 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd60961-26b5-4eb7-b1b8-d694d0d334a8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:28.544886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435aa90-44b8-4614-a525-5bc37ab137c3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:28.579935 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd60961-26b5-4eb7-b1b8-d694d0d334a8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:28.580305 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a3a3e-8316-4aa7-95a4-4075122f3b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:28.581222 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a3a3e-8316-4aa7-95a4-4075122f3b7b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.581647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a3a3e-8316-4aa7-95a4-4075122f3b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.582080 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a3a3e-8316-4aa7-95a4-4075122f3b7b None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.582840 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a3a3e-8316-4aa7-95a4-4075122f3b7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:28.583150 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a3a3e-8316-4aa7-95a4-4075122f3b7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:28.584581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a3a3e-8316-4aa7-95a4-4075122f3b7b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:28.592872 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 35/72] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:28.593559 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a3a3e-8316-4aa7-95a4-4075122f3b7b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:28.616891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c827afb-d787-4b60-961e-9ea5fe97ce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:28.618083 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c827afb-d787-4b60-961e-9ea5fe97ce45 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.618369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c827afb-d787-4b60-961e-9ea5fe97ce45 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.618645 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c827afb-d787-4b60-961e-9ea5fe97ce45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.688036 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c827afb-d787-4b60-961e-9ea5fe97ce45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:28.689543 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c827afb-d787-4b60-961e-9ea5fe97ce45 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:28.701715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a3a3e-8316-4aa7-95a4-4075122f3b7b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:28.733942 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a45382-3f94-41a9-91e4-79f21ea58f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:28.734755 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a45382-3f94-41a9-91e4-79f21ea58f76 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.735040 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a45382-3f94-41a9-91e4-79f21ea58f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.735311 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a45382-3f94-41a9-91e4-79f21ea58f76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.746490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a45382-3f94-41a9-91e4-79f21ea58f76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:28.753835 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-d5a45382-3f94-41a9-91e4-79f21ea58f76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 10:48:28.760181 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 36/73] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:48:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:28.760181 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f3408-1385-4a9b-b46f-5bcce3442510 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.760181 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f3408-1385-4a9b-b46f-5bcce3442510 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.760181 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f3408-1385-4a9b-b46f-5bcce3442510 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.760181 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 37/74] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:28.760181 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f3408-1385-4a9b-b46f-5bcce3442510 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:28.790983 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 38/75] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:48:28.791839 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c827afb-d787-4b60-961e-9ea5fe97ce45 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:28.892094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f3408-1385-4a9b-b46f-5bcce3442510 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:28.894844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c827afb-d787-4b60-961e-9ea5fe97ce45 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:28.927666 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b97bab-dc8f-48ab-b8aa-9c5f1bf0e40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:28.927896 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69a7b2-b816-495d-aab2-059e8a94d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:28.928370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b97bab-dc8f-48ab-b8aa-9c5f1bf0e40f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.928657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b97bab-dc8f-48ab-b8aa-9c5f1bf0e40f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.928754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69a7b2-b816-495d-aab2-059e8a94d968 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.928941 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b97bab-dc8f-48ab-b8aa-9c5f1bf0e40f None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.929037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69a7b2-b816-495d-aab2-059e8a94d968 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.929304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69a7b2-b816-495d-aab2-059e8a94d968 None admin] PATH_INFO: `/v3/users/2081d2092d1f43b39f058ddf8338a375` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.929781 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b97bab-dc8f-48ab-b8aa-9c5f1bf0e40f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:28.930592 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b97bab-dc8f-48ab-b8aa-9c5f1bf0e40f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:28.931085 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69a7b2-b816-495d-aab2-059e8a94d968 None admin] RBAC: Authorizing `identity:get_user(user_id=2081d2092d1f43b39f058ddf8338a375)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:28.931972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b97bab-dc8f-48ab-b8aa-9c5f1bf0e40f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:28.932560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69a7b2-b816-495d-aab2-059e8a94d968 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:28.934549 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 38/76] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:28 2022] GET /identity/v3/users/2081d2092d1f43b39f058ddf8338a375 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:28.935694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47576724-2a59-4a42-93dd-900f965d7c3d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:28.935979 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47576724-2a59-4a42-93dd-900f965d7c3d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:28.936256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47576724-2a59-4a42-93dd-900f965d7c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:28.944650 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 39/77] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:48:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:28.944650 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b97bab-dc8f-48ab-b8aa-9c5f1bf0e40f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:28.956407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-47576724-2a59-4a42-93dd-900f965d7c3d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:28.957633 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-47576724-2a59-4a42-93dd-900f965d7c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:29.019968 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 39/78] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:29.021515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36768cd-5486-491c-af48-bfd78890c46a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:29.021806 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36768cd-5486-491c-af48-bfd78890c46a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:29.022085 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36768cd-5486-491c-af48-bfd78890c46a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:29.023524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 40/79] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:29.024065 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36768cd-5486-491c-af48-bfd78890c46a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:29.037431 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b97bab-dc8f-48ab-b8aa-9c5f1bf0e40f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:29.071224 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3058a-ac9d-4f64-af94-a858ca81b61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:29.072091 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3058a-ac9d-4f64-af94-a858ca81b61b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:29.072378 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3058a-ac9d-4f64-af94-a858ca81b61b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:29.072660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3058a-ac9d-4f64-af94-a858ca81b61b None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:29.073906 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3058a-ac9d-4f64-af94-a858ca81b61b None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:29.075361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3058a-ac9d-4f64-af94-a858ca81b61b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:29.077076 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 40/80] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:28 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:29.078984 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3058a-ac9d-4f64-af94-a858ca81b61b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:29.132489 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36768cd-5486-491c-af48-bfd78890c46a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:29.163938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652a6d0-4090-4c06-b884-ea4f5c76f764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:29.165042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652a6d0-4090-4c06-b884-ea4f5c76f764 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:29.165354 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652a6d0-4090-4c06-b884-ea4f5c76f764 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:29.165631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652a6d0-4090-4c06-b884-ea4f5c76f764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:29.180432 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3058a-ac9d-4f64-af94-a858ca81b61b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:29.214090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb140a7a-7a6b-4a3e-8834-9093d67e7c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:29.215097 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb140a7a-7a6b-4a3e-8834-9093d67e7c51 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:29.215268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb140a7a-7a6b-4a3e-8834-9093d67e7c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:29.215551 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb140a7a-7a6b-4a3e-8834-9093d67e7c51 None admin] PATH_INFO: `/v3/users/0577dda6ef974bbbad9fda731e953d3b` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:29.216784 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb140a7a-7a6b-4a3e-8834-9093d67e7c51 None admin] RBAC: Authorizing `identity:get_user(user_id=0577dda6ef974bbbad9fda731e953d3b)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:29.218267 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb140a7a-7a6b-4a3e-8834-9093d67e7c51 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:29.219942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 41/81] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:29 2022] GET /identity/v3/users/0577dda6ef974bbbad9fda731e953d3b => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:29.221207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899f377-e981-4b36-9273-51cba9bacd85 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:29.221500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899f377-e981-4b36-9273-51cba9bacd85 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:29.221781 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899f377-e981-4b36-9273-51cba9bacd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:29.234273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652a6d0-4090-4c06-b884-ea4f5c76f764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:29.235792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652a6d0-4090-4c06-b884-ea4f5c76f764 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:29.239515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4899f377-e981-4b36-9273-51cba9bacd85 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:29.240707 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4899f377-e981-4b36-9273-51cba9bacd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:29.303787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 42/82] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:29.304622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899f377-e981-4b36-9273-51cba9bacd85 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:29.329372 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 41/83] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:48:29.330476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652a6d0-4090-4c06-b884-ea4f5c76f764 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:29.397135 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899f377-e981-4b36-9273-51cba9bacd85 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:29.422294 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652a6d0-4090-4c06-b884-ea4f5c76f764 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:29.429810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604ff32-79c6-4e9e-83ec-01a63e39aef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:29.430603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604ff32-79c6-4e9e-83ec-01a63e39aef8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:29.430890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604ff32-79c6-4e9e-83ec-01a63e39aef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:29.431172 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604ff32-79c6-4e9e-83ec-01a63e39aef8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:29.432355 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604ff32-79c6-4e9e-83ec-01a63e39aef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:29.433825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604ff32-79c6-4e9e-83ec-01a63e39aef8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:29.435448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 43/84] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:29.436210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604ff32-79c6-4e9e-83ec-01a63e39aef8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:29.455818 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a402dfb-9502-4a06-b923-8ad1490e85b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:29.456474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a402dfb-9502-4a06-b923-8ad1490e85b0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:29.456759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a402dfb-9502-4a06-b923-8ad1490e85b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:29.457032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a402dfb-9502-4a06-b923-8ad1490e85b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:29.457957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a402dfb-9502-4a06-b923-8ad1490e85b0 None admin] RBAC: Adding query filter params (role.id=519c87ee2e424f1d81ce0c136c4b2d25, scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5, user.id=0577dda6ef974bbbad9fda731e953d3b) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:29.458267 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a402dfb-9502-4a06-b923-8ad1490e85b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:29.459769 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a402dfb-9502-4a06-b923-8ad1490e85b0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:29.470021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 42/85] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:29 2022] GET /identity/v3/role_assignments?user.id=0577dda6ef974bbbad9fda731e953d3b&scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5&role.id=519c87ee2e424f1d81ce0c136c4b2d25 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:29.470021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a402dfb-9502-4a06-b923-8ad1490e85b0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:29.544228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604ff32-79c6-4e9e-83ec-01a63e39aef8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:29.571365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a402dfb-9502-4a06-b923-8ad1490e85b0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:29.581073 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab5b9d-3e6a-42cc-a9f2-fd1defc5dd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:29.582093 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab5b9d-3e6a-42cc-a9f2-fd1defc5dd6f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:29.582580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab5b9d-3e6a-42cc-a9f2-fd1defc5dd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:29.583044 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab5b9d-3e6a-42cc-a9f2-fd1defc5dd6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:29.606029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d9674-2d4f-4f30-81be-4a37da484532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:29.606855 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d9674-2d4f-4f30-81be-4a37da484532 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:29.607138 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d9674-2d4f-4f30-81be-4a37da484532 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:29.607414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d9674-2d4f-4f30-81be-4a37da484532 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:29.618977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d9674-2d4f-4f30-81be-4a37da484532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:29.626117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-bf8d9674-2d4f-4f30-81be-4a37da484532 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:48:29.627393 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 43/86] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:29.628185 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d9674-2d4f-4f30-81be-4a37da484532 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:29.665718 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab5b9d-3e6a-42cc-a9f2-fd1defc5dd6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:29.667205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab5b9d-3e6a-42cc-a9f2-fd1defc5dd6f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:29.731320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d9674-2d4f-4f30-81be-4a37da484532 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:29.762629 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 44/87] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:48:29.767140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab5b9d-3e6a-42cc-a9f2-fd1defc5dd6f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:29.767978 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826e9d6-8815-4163-a6e3-ac12e1284a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:29.768853 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826e9d6-8815-4163-a6e3-ac12e1284a39 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:29.769147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826e9d6-8815-4163-a6e3-ac12e1284a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:29.769426 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826e9d6-8815-4163-a6e3-ac12e1284a39 None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:29.770636 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826e9d6-8815-4163-a6e3-ac12e1284a39 None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:29.772138 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826e9d6-8815-4163-a6e3-ac12e1284a39 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:29.778750 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 44/88] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:29 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:29.778750 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826e9d6-8815-4163-a6e3-ac12e1284a39 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:29.861438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab5b9d-3e6a-42cc-a9f2-fd1defc5dd6f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:29.874829 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826e9d6-8815-4163-a6e3-ac12e1284a39 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:29.896175 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46cdc3-52ab-46e0-a15b-7a892c10aa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:29.897397 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46cdc3-52ab-46e0-a15b-7a892c10aa3d None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:29.897889 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46cdc3-52ab-46e0-a15b-7a892c10aa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:29.898365 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46cdc3-52ab-46e0-a15b-7a892c10aa3d None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:29.899291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46cdc3-52ab-46e0-a15b-7a892c10aa3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:29.900936 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46cdc3-52ab-46e0-a15b-7a892c10aa3d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:29.906908 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8d59b-2f41-4fc1-af25-0e9a243784ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:29.907569 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8d59b-2f41-4fc1-af25-0e9a243784ab None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:29.907855 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8d59b-2f41-4fc1-af25-0e9a243784ab None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:29.908130 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8d59b-2f41-4fc1-af25-0e9a243784ab None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:29.908876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8d59b-2f41-4fc1-af25-0e9a243784ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:29.909213 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8d59b-2f41-4fc1-af25-0e9a243784ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:29.910618 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8d59b-2f41-4fc1-af25-0e9a243784ab None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:29.919034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 45/89] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:29.919034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8d59b-2f41-4fc1-af25-0e9a243784ab None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:30.001963 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 45/90] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:48:29 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:48:30.002799 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46cdc3-52ab-46e0-a15b-7a892c10aa3d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:30.019050 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8d59b-2f41-4fc1-af25-0e9a243784ab None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:30.056249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5da89-20a6-4461-bf95-766bb0e50e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:30.057231 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5da89-20a6-4461-bf95-766bb0e50e0b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:30.057516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5da89-20a6-4461-bf95-766bb0e50e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:30.057792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5da89-20a6-4461-bf95-766bb0e50e0b None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:30.059083 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5da89-20a6-4461-bf95-766bb0e50e0b None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:30.060643 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5da89-20a6-4461-bf95-766bb0e50e0b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:30.062460 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 46/91] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:29 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:30.063521 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5da89-20a6-4461-bf95-766bb0e50e0b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:30.121514 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46cdc3-52ab-46e0-a15b-7a892c10aa3d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:30.177081 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5da89-20a6-4461-bf95-766bb0e50e0b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:30.179016 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b4b36-f6d6-417d-b384-407b876e93fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:30.179797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b4b36-f6d6-417d-b384-407b876e93fb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:30.180090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b4b36-f6d6-417d-b384-407b876e93fb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:30.180372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b4b36-f6d6-417d-b384-407b876e93fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:30.181269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b4b36-f6d6-417d-b384-407b876e93fb None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5, user.id=2081d2092d1f43b39f058ddf8338a375) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:30.181587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b4b36-f6d6-417d-b384-407b876e93fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:30.183179 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b4b36-f6d6-417d-b384-407b876e93fb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:30.198882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 46/92] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:30 2022] GET /identity/v3/role_assignments?user.id=2081d2092d1f43b39f058ddf8338a375&scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5&role.id=090ba4d1ae32495289276665920d4a2c => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:30.200045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b4b36-f6d6-417d-b384-407b876e93fb None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:30.215278 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf04d63-b73b-4101-9f4e-962b848eeb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:30.216905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf04d63-b73b-4101-9f4e-962b848eeb70 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:30.217488 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf04d63-b73b-4101-9f4e-962b848eeb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:30.218139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf04d63-b73b-4101-9f4e-962b848eeb70 None admin] PATH_INFO: `/v3/users/0577dda6ef974bbbad9fda731e953d3b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:30.220531 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf04d63-b73b-4101-9f4e-962b848eeb70 None admin] RBAC: Authorizing `identity:get_user(user_id=0577dda6ef974bbbad9fda731e953d3b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:30.223009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf04d63-b73b-4101-9f4e-962b848eeb70 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:30.225236 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 47/93] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:30 2022] GET /identity/v3/users/0577dda6ef974bbbad9fda731e953d3b => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:30.231173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf04d63-b73b-4101-9f4e-962b848eeb70 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:30.315030 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b4b36-f6d6-417d-b384-407b876e93fb None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:30.347381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf04d63-b73b-4101-9f4e-962b848eeb70 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:30.359857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640cf87-9aa5-433c-b6ea-def29845848a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:30.360888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640cf87-9aa5-433c-b6ea-def29845848a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:30.361377 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640cf87-9aa5-433c-b6ea-def29845848a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:30.361850 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640cf87-9aa5-433c-b6ea-def29845848a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:30.362877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640cf87-9aa5-433c-b6ea-def29845848a None admin] RBAC: Adding query filter params (role.id=ed823413bca240af87bbf99994bcd0f8, scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5, user.id=0577dda6ef974bbbad9fda731e953d3b) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:30.363377 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640cf87-9aa5-433c-b6ea-def29845848a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:30.365107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640cf87-9aa5-433c-b6ea-def29845848a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:30.371394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 47/94] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:30 2022] GET /identity/v3/role_assignments?user.id=0577dda6ef974bbbad9fda731e953d3b&scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5&role.id=ed823413bca240af87bbf99994bcd0f8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:30.391538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cae484-026a-45ee-bcf6-3b1d326b8083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:30.392229 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cae484-026a-45ee-bcf6-3b1d326b8083 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:30.392510 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cae484-026a-45ee-bcf6-3b1d326b8083 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:30.392786 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cae484-026a-45ee-bcf6-3b1d326b8083 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:30.470416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cae484-026a-45ee-bcf6-3b1d326b8083 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:30.471965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cae484-026a-45ee-bcf6-3b1d326b8083 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:30.582410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 48/95] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:48:30.588684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640cf87-9aa5-433c-b6ea-def29845848a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:30.707663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640cf87-9aa5-433c-b6ea-def29845848a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:30.743063 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee535ec-f845-455a-ae65-a57c2a7773b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:30.743996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee535ec-f845-455a-ae65-a57c2a7773b0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:30.744285 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee535ec-f845-455a-ae65-a57c2a7773b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:30.744561 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee535ec-f845-455a-ae65-a57c2a7773b0 None admin] PATH_INFO: `/v3/projects/35524f79ce9f4afe888b86b8ddc534a6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:30.745787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee535ec-f845-455a-ae65-a57c2a7773b0 None admin] RBAC: Authorizing `identity:get_project(project_id=35524f79ce9f4afe888b86b8ddc534a6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:30.747238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee535ec-f845-455a-ae65-a57c2a7773b0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:30.749207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 48/96] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:30 2022] GET /identity/v3/projects/35524f79ce9f4afe888b86b8ddc534a6 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:30.754837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cae484-026a-45ee-bcf6-3b1d326b8083 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:30.854426 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cae484-026a-45ee-bcf6-3b1d326b8083 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:30.888166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8999cd5-8fd3-4847-8281-d168374d57ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:30.889564 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8999cd5-8fd3-4847-8281-d168374d57ab None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:30.890399 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8999cd5-8fd3-4847-8281-d168374d57ab None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:30.890692 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8999cd5-8fd3-4847-8281-d168374d57ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:30.891513 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8999cd5-8fd3-4847-8281-d168374d57ab None admin] RBAC: Adding query filter params (role.id=519c87ee2e424f1d81ce0c136c4b2d25, scope.project.id=35524f79ce9f4afe888b86b8ddc534a6, user.id=0577dda6ef974bbbad9fda731e953d3b) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:30.891827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8999cd5-8fd3-4847-8281-d168374d57ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:30.893339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8999cd5-8fd3-4847-8281-d168374d57ab None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:30.899001 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 49/97] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:30 2022] GET /identity/v3/role_assignments?user.id=0577dda6ef974bbbad9fda731e953d3b&scope.project.id=35524f79ce9f4afe888b86b8ddc534a6&role.id=519c87ee2e424f1d81ce0c136c4b2d25 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:32.067543 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de7e3-357a-47b6-b82f-25a01642c556 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:32.068043 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de7e3-357a-47b6-b82f-25a01642c556 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:32.068145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de7e3-357a-47b6-b82f-25a01642c556 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:32.069747 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 49/98] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:32.075404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0af7d2-b526-424b-b339-e2d716af8786 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:32.075819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0af7d2-b526-424b-b339-e2d716af8786 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:32.075993 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0af7d2-b526-424b-b339-e2d716af8786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:32.097473 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3e0af7d2-b526-424b-b339-e2d716af8786 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:32.098693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3e0af7d2-b526-424b-b339-e2d716af8786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:32.186968 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 50/99] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:32.226625 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66de7e3-357a-47b6-b82f-25a01642c556 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:32.344533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66de7e3-357a-47b6-b82f-25a01642c556 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:32.378334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c20f04-7f89-48ac-bf09-1efa06938ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:32.379137 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c20f04-7f89-48ac-bf09-1efa06938ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:32.379422 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c20f04-7f89-48ac-bf09-1efa06938ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:32.379703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c20f04-7f89-48ac-bf09-1efa06938ca6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:32.390579 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c20f04-7f89-48ac-bf09-1efa06938ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:32.397658 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-33c20f04-7f89-48ac-bf09-1efa06938ca6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:48:32.399094 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 50/100] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:32.404710 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0af7d2-b526-424b-b339-e2d716af8786 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:32.552620 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0af7d2-b526-424b-b339-e2d716af8786 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:32.595937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da375b37-d9d0-404d-82b0-8210bbeed6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:32.596535 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da375b37-d9d0-404d-82b0-8210bbeed6ea None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:32.596823 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da375b37-d9d0-404d-82b0-8210bbeed6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:32.597120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da375b37-d9d0-404d-82b0-8210bbeed6ea None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:32.597875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da375b37-d9d0-404d-82b0-8210bbeed6ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:32.598184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da375b37-d9d0-404d-82b0-8210bbeed6ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:32.599610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da375b37-d9d0-404d-82b0-8210bbeed6ea None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:32.612504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 51/101] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:32.619717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c20f04-7f89-48ac-bf09-1efa06938ca6 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:32.740685 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c20f04-7f89-48ac-bf09-1efa06938ca6 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:32.777686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac282e12-97ce-4c19-8342-0f5c6dae0113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:32.778631 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac282e12-97ce-4c19-8342-0f5c6dae0113 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:32.778923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac282e12-97ce-4c19-8342-0f5c6dae0113 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:32.779208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac282e12-97ce-4c19-8342-0f5c6dae0113 None admin] PATH_INFO: `/v3/users/0577dda6ef974bbbad9fda731e953d3b` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:32.780802 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac282e12-97ce-4c19-8342-0f5c6dae0113 None admin] RBAC: Authorizing `identity:get_user(user_id=0577dda6ef974bbbad9fda731e953d3b)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:32.786017 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac282e12-97ce-4c19-8342-0f5c6dae0113 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:32.788102 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 51/102] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:32 2022] GET /identity/v3/users/0577dda6ef974bbbad9fda731e953d3b => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:32.794123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da375b37-d9d0-404d-82b0-8210bbeed6ea None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:32.911783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da375b37-d9d0-404d-82b0-8210bbeed6ea None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:32.952800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21b1aa-5038-4a5f-91ea-3edb4139f9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:32.953703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b1aa-5038-4a5f-91ea-3edb4139f9de None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:32.953987 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b1aa-5038-4a5f-91ea-3edb4139f9de None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:32.954264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b1aa-5038-4a5f-91ea-3edb4139f9de None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:32.956069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21b1aa-5038-4a5f-91ea-3edb4139f9de None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:32.957600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21b1aa-5038-4a5f-91ea-3edb4139f9de None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:32.959488 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 52/103] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:32 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:32.965309 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac282e12-97ce-4c19-8342-0f5c6dae0113 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:33.065412 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac282e12-97ce-4c19-8342-0f5c6dae0113 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:33.100019 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d6010-9bf4-49b2-9ff6-f2d49ad8aa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:33.100955 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d6010-9bf4-49b2-9ff6-f2d49ad8aa89 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:33.101280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d6010-9bf4-49b2-9ff6-f2d49ad8aa89 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:33.102127 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d6010-9bf4-49b2-9ff6-f2d49ad8aa89 None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5/users/0577dda6ef974bbbad9fda731e953d3b/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:33.104807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d6010-9bf4-49b2-9ff6-f2d49ad8aa89 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0acfd6cac5d493e9d1064ecf9357aa5, user_id=0577dda6ef974bbbad9fda731e953d3b, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:33.106353 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d6010-9bf4-49b2-9ff6-f2d49ad8aa89 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:33.174416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 52/104] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:48:32 2022] PUT /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5/users/0577dda6ef974bbbad9fda731e953d3b/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:48:33.574177 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191bbd4-bdda-4641-a0da-2c0157acedf3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:33.574679 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191bbd4-bdda-4641-a0da-2c0157acedf3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:33.574750 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191bbd4-bdda-4641-a0da-2c0157acedf3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:33.576271 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 53/105] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:33.581720 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3b4ef-837f-462c-8ad1-0a02a4a0b448 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:33.582022 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3b4ef-837f-462c-8ad1-0a02a4a0b448 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:33.582308 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3b4ef-837f-462c-8ad1-0a02a4a0b448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:33.600791 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-1ec3b4ef-837f-462c-8ad1-0a02a4a0b448 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:33.602089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1ec3b4ef-837f-462c-8ad1-0a02a4a0b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:33.677972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 53/106] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:33.703528 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191bbd4-bdda-4641-a0da-2c0157acedf3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:33.829479 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45250084-0cc7-43d8-ba3d-60d6c4acee66 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:33.829978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45250084-0cc7-43d8-ba3d-60d6c4acee66 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:33.830402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45250084-0cc7-43d8-ba3d-60d6c4acee66 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:33.832032 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 54/107] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:33.837723 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609ce4-26ec-44b6-96f2-3307154e1ecc None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:33.838237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609ce4-26ec-44b6-96f2-3307154e1ecc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:33.838658 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609ce4-26ec-44b6-96f2-3307154e1ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:33.869957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-af609ce4-26ec-44b6-96f2-3307154e1ecc None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:33.872103 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-af609ce4-26ec-44b6-96f2-3307154e1ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:33.903997 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191bbd4-bdda-4641-a0da-2c0157acedf3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:33.972462 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5559d1-55d6-4825-85f4-ea6394bdc4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:33.973588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5559d1-55d6-4825-85f4-ea6394bdc4bc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:33.974018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5559d1-55d6-4825-85f4-ea6394bdc4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:33.974463 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5559d1-55d6-4825-85f4-ea6394bdc4bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:33.997633 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5559d1-55d6-4825-85f4-ea6394bdc4bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:34.005118 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-3e5559d1-55d6-4825-85f4-ea6394bdc4bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 10:48:34.007068 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 54/108] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:48:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:34.008433 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 55/109] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:34.014080 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5559d1-55d6-4825-85f4-ea6394bdc4bc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:34.046684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af609ce4-26ec-44b6-96f2-3307154e1ecc None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:34.149149 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5559d1-55d6-4825-85f4-ea6394bdc4bc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:34.171593 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a599860-694a-430f-9b7d-f2611351c065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:34.172565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a599860-694a-430f-9b7d-f2611351c065 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:34.173002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a599860-694a-430f-9b7d-f2611351c065 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:34.173523 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a599860-694a-430f-9b7d-f2611351c065 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:34.174495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a599860-694a-430f-9b7d-f2611351c065 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:34.174949 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a599860-694a-430f-9b7d-f2611351c065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:34.176838 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a599860-694a-430f-9b7d-f2611351c065 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:34.194301 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 55/110] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:48:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:34.201429 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3beed-450a-4e32-926a-95898f23dda0 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:34.203246 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3beed-450a-4e32-926a-95898f23dda0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:34.204349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3beed-450a-4e32-926a-95898f23dda0 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:34.206561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 56/111] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:34.210606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3beed-450a-4e32-926a-95898f23dda0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:34.225779 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af609ce4-26ec-44b6-96f2-3307154e1ecc None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:34.295887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88322f46-9b00-4465-a800-014b9ebb63a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:34.296954 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88322f46-9b00-4465-a800-014b9ebb63a5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:34.297402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88322f46-9b00-4465-a800-014b9ebb63a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:34.297892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88322f46-9b00-4465-a800-014b9ebb63a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:34.321512 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88322f46-9b00-4465-a800-014b9ebb63a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:34.338609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-88322f46-9b00-4465-a800-014b9ebb63a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 10:48:34.340103 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 56/112] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:34.341472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c1184-41a1-478f-965f-8b5243d1da4e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:34.344788 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c1184-41a1-478f-965f-8b5243d1da4e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:34.345309 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c1184-41a1-478f-965f-8b5243d1da4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:34.374136 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3beed-450a-4e32-926a-95898f23dda0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:34.385110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-eb2c1184-41a1-478f-965f-8b5243d1da4e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:34.386512 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-eb2c1184-41a1-478f-965f-8b5243d1da4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:34.416593 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfe76f-89a9-46c9-bf91-d5bdbcffc093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:34.417875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfe76f-89a9-46c9-bf91-d5bdbcffc093 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:34.418312 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfe76f-89a9-46c9-bf91-d5bdbcffc093 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:34.418734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfe76f-89a9-46c9-bf91-d5bdbcffc093 None admin] PATH_INFO: `/v3/users/0577dda6ef974bbbad9fda731e953d3b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:34.425936 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfe76f-89a9-46c9-bf91-d5bdbcffc093 None admin] RBAC: Authorizing `identity:get_user(user_id=0577dda6ef974bbbad9fda731e953d3b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:34.427751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfe76f-89a9-46c9-bf91-d5bdbcffc093 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:34.429792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 57/113] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:34 2022] GET /identity/v3/users/0577dda6ef974bbbad9fda731e953d3b => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:34.431205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfe76f-89a9-46c9-bf91-d5bdbcffc093 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:34.509425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 57/114] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:34.513289 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c1184-41a1-478f-965f-8b5243d1da4e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:34.559428 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfe76f-89a9-46c9-bf91-d5bdbcffc093 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:34.593771 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f4467-2c01-4ba3-8851-3846d2e0a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:34.594541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f4467-2c01-4ba3-8851-3846d2e0a09e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:34.594943 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f4467-2c01-4ba3-8851-3846d2e0a09e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:34.595222 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f4467-2c01-4ba3-8851-3846d2e0a09e None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:34.595971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f4467-2c01-4ba3-8851-3846d2e0a09e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:34.596275 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f4467-2c01-4ba3-8851-3846d2e0a09e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:34.597738 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f4467-2c01-4ba3-8851-3846d2e0a09e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:34.606409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 58/115] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:34.607777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43a3f7-d08c-4faf-904f-a53441e94406 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:34.608070 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43a3f7-d08c-4faf-904f-a53441e94406 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:34.608370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43a3f7-d08c-4faf-904f-a53441e94406 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:34.613096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 59/116] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:34.613096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1353e4f-fdcf-4a75-9eb8-dc0875823e0f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:34.613096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1353e4f-fdcf-4a75-9eb8-dc0875823e0f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:34.613096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1353e4f-fdcf-4a75-9eb8-dc0875823e0f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:34.613096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 60/117] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:34.613479 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1353e4f-fdcf-4a75-9eb8-dc0875823e0f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:34.635017 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c1184-41a1-478f-965f-8b5243d1da4e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:34.676522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609229d-b634-4813-8f6c-21ce85f8f59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:34.677452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609229d-b634-4813-8f6c-21ce85f8f59a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:34.677740 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609229d-b634-4813-8f6c-21ce85f8f59a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:34.678018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609229d-b634-4813-8f6c-21ce85f8f59a None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:34.679315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609229d-b634-4813-8f6c-21ce85f8f59a None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:34.680837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609229d-b634-4813-8f6c-21ce85f8f59a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:34.682584 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 58/118] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:34 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:34.683352 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609229d-b634-4813-8f6c-21ce85f8f59a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:34.714843 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1353e4f-fdcf-4a75-9eb8-dc0875823e0f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:34.750015 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18c547-50ae-42b4-8e48-df87c61c70b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:34.750854 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18c547-50ae-42b4-8e48-df87c61c70b5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:34.751141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18c547-50ae-42b4-8e48-df87c61c70b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:34.751421 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18c547-50ae-42b4-8e48-df87c61c70b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:34.762114 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18c547-50ae-42b4-8e48-df87c61c70b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:34.769146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-8e18c547-50ae-42b4-8e48-df87c61c70b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:48:34.772382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 61/119] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:48:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:34.772382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cb24c-1c26-432a-8893-5c50c92be1cb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:34.772382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cb24c-1c26-432a-8893-5c50c92be1cb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:34.772382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cb24c-1c26-432a-8893-5c50c92be1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:34.790566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609229d-b634-4813-8f6c-21ce85f8f59a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:34.822300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-456cb24c-1c26-432a-8893-5c50c92be1cb None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:34.823758 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-456cb24c-1c26-432a-8893-5c50c92be1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:34.844135 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e7f3c-a98d-4bec-9f0b-6e06b47d53ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:34.845391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e7f3c-a98d-4bec-9f0b-6e06b47d53ba None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:34.845830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e7f3c-a98d-4bec-9f0b-6e06b47d53ba None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:34.846112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e7f3c-a98d-4bec-9f0b-6e06b47d53ba None admin] PATH_INFO: `/v3/users/635aadd986a14250beb9c600784c04f7` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:34.859238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e7f3c-a98d-4bec-9f0b-6e06b47d53ba None admin] RBAC: Authorizing `identity:get_user(user_id=635aadd986a14250beb9c600784c04f7)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:34.860698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e7f3c-a98d-4bec-9f0b-6e06b47d53ba None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:34.862590 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 59/120] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:34 2022] GET /identity/v3/users/635aadd986a14250beb9c600784c04f7 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:34.863618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6e8d-d328-47c3-b0b6-48aa6ae93eb4 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:34.863929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6e8d-d328-47c3-b0b6-48aa6ae93eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:34.864219 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6e8d-d328-47c3-b0b6-48aa6ae93eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:34.880375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-896c6e8d-d328-47c3-b0b6-48aa6ae93eb4 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:34.881617 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-896c6e8d-d328-47c3-b0b6-48aa6ae93eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:34.895062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 62/121] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:34.895707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cb24c-1c26-432a-8893-5c50c92be1cb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:34.952836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 60/122] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:34.957952 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c6e8d-d328-47c3-b0b6-48aa6ae93eb4 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:34.999800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cb24c-1c26-432a-8893-5c50c92be1cb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:35.032330 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0e021-36f9-4b97-bf59-97ea014e7c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:35.033366 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0e021-36f9-4b97-bf59-97ea014e7c39 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:35.033757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0e021-36f9-4b97-bf59-97ea014e7c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:35.034139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0e021-36f9-4b97-bf59-97ea014e7c39 None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5/users/0577dda6ef974bbbad9fda731e953d3b/roles/ed823413bca240af87bbf99994bcd0f8` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:35.036529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0e021-36f9-4b97-bf59-97ea014e7c39 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0acfd6cac5d493e9d1064ecf9357aa5, user_id=0577dda6ef974bbbad9fda731e953d3b, role_id=ed823413bca240af87bbf99994bcd0f8)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:35.038066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0e021-36f9-4b97-bf59-97ea014e7c39 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:35.058913 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c6e8d-d328-47c3-b0b6-48aa6ae93eb4 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:35.091975 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c656a8-b4a5-495a-9a0e-a56a885ca3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:35.092665 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c656a8-b4a5-495a-9a0e-a56a885ca3ce None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:35.092989 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c656a8-b4a5-495a-9a0e-a56a885ca3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:35.093300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c656a8-b4a5-495a-9a0e-a56a885ca3ce None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:35.094048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c656a8-b4a5-495a-9a0e-a56a885ca3ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:35.094359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c656a8-b4a5-495a-9a0e-a56a885ca3ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:35.095741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c656a8-b4a5-495a-9a0e-a56a885ca3ce None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:35.103462 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 61/123] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:35.104242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c656a8-b4a5-495a-9a0e-a56a885ca3ce None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:35.149088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 63/124] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:48:34 2022] PUT /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5/users/0577dda6ef974bbbad9fda731e953d3b/roles/ed823413bca240af87bbf99994bcd0f8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:48:35.149088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0e021-36f9-4b97-bf59-97ea014e7c39 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:35.220984 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c656a8-b4a5-495a-9a0e-a56a885ca3ce None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:35.261415 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eb930-039e-4812-a15b-4bef98ad018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:35.262607 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eb930-039e-4812-a15b-4bef98ad018f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:35.263094 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eb930-039e-4812-a15b-4bef98ad018f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:35.263498 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eb930-039e-4812-a15b-4bef98ad018f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:35.265284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0e021-36f9-4b97-bf59-97ea014e7c39 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:35.302043 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b6966-dabc-44f0-bd0a-06c0a2b5cee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:35.303028 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b6966-dabc-44f0-bd0a-06c0a2b5cee0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:35.303410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b6966-dabc-44f0-bd0a-06c0a2b5cee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:35.303788 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b6966-dabc-44f0-bd0a-06c0a2b5cee0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:35.316436 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b6966-dabc-44f0-bd0a-06c0a2b5cee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:35.325118 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-d80b6966-dabc-44f0-bd0a-06c0a2b5cee0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:48:35.326001 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 64/125] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:35.327778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b6966-dabc-44f0-bd0a-06c0a2b5cee0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:35.351770 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32eb930-039e-4812-a15b-4bef98ad018f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:35.353302 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32eb930-039e-4812-a15b-4bef98ad018f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:35.435312 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b6966-dabc-44f0-bd0a-06c0a2b5cee0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:35.454088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 62/126] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:48:35.454862 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eb930-039e-4812-a15b-4bef98ad018f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:35.474187 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e7ba8-90d2-4f33-9eab-cf9cae69e653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:35.474995 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e7ba8-90d2-4f33-9eab-cf9cae69e653 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:35.475279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e7ba8-90d2-4f33-9eab-cf9cae69e653 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:35.475554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e7ba8-90d2-4f33-9eab-cf9cae69e653 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:35.476767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e7ba8-90d2-4f33-9eab-cf9cae69e653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:35.478306 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e7ba8-90d2-4f33-9eab-cf9cae69e653 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:35.480160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 65/127] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:35.480705 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e7ba8-90d2-4f33-9eab-cf9cae69e653 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:35.553254 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eb930-039e-4812-a15b-4bef98ad018f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:35.584973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e7ba8-90d2-4f33-9eab-cf9cae69e653 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:35.589531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9f999-8396-4cb0-93a5-bdcb94910b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:35.590429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9f999-8396-4cb0-93a5-bdcb94910b0e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:35.590713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9f999-8396-4cb0-93a5-bdcb94910b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:35.590990 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9f999-8396-4cb0-93a5-bdcb94910b0e None admin] PATH_INFO: `/v3/users/2081d2092d1f43b39f058ddf8338a375` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:35.592208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9f999-8396-4cb0-93a5-bdcb94910b0e None admin] RBAC: Authorizing `identity:get_user(user_id=2081d2092d1f43b39f058ddf8338a375)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:35.594170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9f999-8396-4cb0-93a5-bdcb94910b0e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:35.596006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 63/128] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:35 2022] GET /identity/v3/users/2081d2092d1f43b39f058ddf8338a375 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:35.596690 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9f999-8396-4cb0-93a5-bdcb94910b0e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:35.619094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca82d3-119e-4859-b66d-7296a729fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:35.619774 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca82d3-119e-4859-b66d-7296a729fa0b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:35.620061 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca82d3-119e-4859-b66d-7296a729fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:35.620341 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca82d3-119e-4859-b66d-7296a729fa0b None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:35.621118 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca82d3-119e-4859-b66d-7296a729fa0b None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:35.621435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca82d3-119e-4859-b66d-7296a729fa0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:35.622863 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca82d3-119e-4859-b66d-7296a729fa0b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:35.631204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 66/129] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:35.631827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca82d3-119e-4859-b66d-7296a729fa0b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:35.704354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9f999-8396-4cb0-93a5-bdcb94910b0e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:35.742845 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca82d3-119e-4859-b66d-7296a729fa0b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:35.743010 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed0069-652a-4e49-aaaf-781e07a1e642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:35.743010 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed0069-652a-4e49-aaaf-781e07a1e642 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:35.743010 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed0069-652a-4e49-aaaf-781e07a1e642 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:35.743010 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed0069-652a-4e49-aaaf-781e07a1e642 None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:35.743322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed0069-652a-4e49-aaaf-781e07a1e642 None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:35.743402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed0069-652a-4e49-aaaf-781e07a1e642 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:35.745297 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 64/130] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:35 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:35.746002 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed0069-652a-4e49-aaaf-781e07a1e642 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:35.774530 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e3176-c8f7-4d2f-a021-d6df67c865ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:35.775200 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e3176-c8f7-4d2f-a021-d6df67c865ba None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:35.775488 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e3176-c8f7-4d2f-a021-d6df67c865ba None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:35.775858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e3176-c8f7-4d2f-a021-d6df67c865ba None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:35.776576 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e3176-c8f7-4d2f-a021-d6df67c865ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:35.778251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e3176-c8f7-4d2f-a021-d6df67c865ba None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:35.845351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed0069-652a-4e49-aaaf-781e07a1e642 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:35.854636 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 67/131] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Apr 6 10:48:35 2022] POST /identity/v3/projects => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:48:35.861284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e3176-c8f7-4d2f-a021-d6df67c865ba None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:35.930644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e64d4-8fa7-4639-8f70-315a29b6f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:35.931541 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e64d4-8fa7-4639-8f70-315a29b6f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:35.931822 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e64d4-8fa7-4639-8f70-315a29b6f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:35.932099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e64d4-8fa7-4639-8f70-315a29b6f8a4 None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:35.935529 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e64d4-8fa7-4639-8f70-315a29b6f8a4 None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:35.937013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e64d4-8fa7-4639-8f70-315a29b6f8a4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:35.939220 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 65/132] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:35 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:35.941797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e64d4-8fa7-4639-8f70-315a29b6f8a4 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:36.061159 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e3176-c8f7-4d2f-a021-d6df67c865ba None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:36.083021 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e64d4-8fa7-4639-8f70-315a29b6f8a4 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:36.111437 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae669c-a6a7-40a7-af09-1d4c5fe4dae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:36.112324 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae669c-a6a7-40a7-af09-1d4c5fe4dae2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:36.112613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae669c-a6a7-40a7-af09-1d4c5fe4dae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:36.112880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae669c-a6a7-40a7-af09-1d4c5fe4dae2 None admin] PATH_INFO: `/v3/users/0577dda6ef974bbbad9fda731e953d3b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:36.114176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae669c-a6a7-40a7-af09-1d4c5fe4dae2 None admin] RBAC: Authorizing `identity:get_user(user_id=0577dda6ef974bbbad9fda731e953d3b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:36.115683 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae669c-a6a7-40a7-af09-1d4c5fe4dae2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:36.118461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 68/133] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:35 2022] GET /identity/v3/users/0577dda6ef974bbbad9fda731e953d3b => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:36.118964 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae669c-a6a7-40a7-af09-1d4c5fe4dae2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:36.122355 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e6e87-b0b7-40c1-9183-79aeda0f7fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:36.123332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e6e87-b0b7-40c1-9183-79aeda0f7fae None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:36.123447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e6e87-b0b7-40c1-9183-79aeda0f7fae None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:36.123683 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e6e87-b0b7-40c1-9183-79aeda0f7fae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:36.124522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e6e87-b0b7-40c1-9183-79aeda0f7fae None admin] RBAC: Adding query filter params (role.id=223e41cadac841039801dd9dc1416608, scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5, user.id=635aadd986a14250beb9c600784c04f7) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:36.124838 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e6e87-b0b7-40c1-9183-79aeda0f7fae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:36.126335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e6e87-b0b7-40c1-9183-79aeda0f7fae None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:36.132066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 66/134] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:35 2022] GET /identity/v3/role_assignments?user.id=635aadd986a14250beb9c600784c04f7&scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5&role.id=223e41cadac841039801dd9dc1416608 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:36.134274 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f108175-00e9-4d6d-a4a6-68839f5af0ee None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:36.134787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f108175-00e9-4d6d-a4a6-68839f5af0ee None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:36.135275 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f108175-00e9-4d6d-a4a6-68839f5af0ee None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:36.136783 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 67/135] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:36.137820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f108175-00e9-4d6d-a4a6-68839f5af0ee None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:36.236471 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae669c-a6a7-40a7-af09-1d4c5fe4dae2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:36.249927 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f108175-00e9-4d6d-a4a6-68839f5af0ee None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:36.274943 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db385f8-5d36-4d45-80d4-a24caedd9f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:36.275848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db385f8-5d36-4d45-80d4-a24caedd9f5b None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:36.276129 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db385f8-5d36-4d45-80d4-a24caedd9f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:36.276404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db385f8-5d36-4d45-80d4-a24caedd9f5b None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5/users/2081d2092d1f43b39f058ddf8338a375/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:36.278828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db385f8-5d36-4d45-80d4-a24caedd9f5b None admin] RBAC: Authorizing `identity:create_grant(project_id=c0acfd6cac5d493e9d1064ecf9357aa5, user_id=2081d2092d1f43b39f058ddf8338a375, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:36.280378 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db385f8-5d36-4d45-80d4-a24caedd9f5b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:36.289585 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fec34c-5189-4bc4-9df7-7c2ff234f02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:36.292416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fec34c-5189-4bc4-9df7-7c2ff234f02e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:36.292416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fec34c-5189-4bc4-9df7-7c2ff234f02e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:36.292416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fec34c-5189-4bc4-9df7-7c2ff234f02e None admin] PATH_INFO: `/v3/projects/35524f79ce9f4afe888b86b8ddc534a6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:36.293679 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fec34c-5189-4bc4-9df7-7c2ff234f02e None admin] RBAC: Authorizing `identity:get_project(project_id=35524f79ce9f4afe888b86b8ddc534a6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:36.295411 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fec34c-5189-4bc4-9df7-7c2ff234f02e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:36.297508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 68/136] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:36 2022] GET /identity/v3/projects/35524f79ce9f4afe888b86b8ddc534a6 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:36.299182 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86197802-cf76-4dc7-b4e4-f4f2827ea409 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:36.299653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86197802-cf76-4dc7-b4e4-f4f2827ea409 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:36.300108 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86197802-cf76-4dc7-b4e4-f4f2827ea409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:36.321044 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-86197802-cf76-4dc7-b4e4-f4f2827ea409 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:36.322636 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-86197802-cf76-4dc7-b4e4-f4f2827ea409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:36.355545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 69/137] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:48:36 2022] PUT /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5/users/2081d2092d1f43b39f058ddf8338a375/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:48:36.357151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db385f8-5d36-4d45-80d4-a24caedd9f5b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:36.397981 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 69/138] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:36.445785 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86197802-cf76-4dc7-b4e4-f4f2827ea409 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:36.488109 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db385f8-5d36-4d45-80d4-a24caedd9f5b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:36.529789 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a7322-3682-45e3-a1a4-71f65f5514d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:36.530701 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a7322-3682-45e3-a1a4-71f65f5514d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:36.530979 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a7322-3682-45e3-a1a4-71f65f5514d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:36.531250 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a7322-3682-45e3-a1a4-71f65f5514d0 None admin] PATH_INFO: `/v3/projects/35524f79ce9f4afe888b86b8ddc534a6/users/0577dda6ef974bbbad9fda731e953d3b/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:36.534501 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a7322-3682-45e3-a1a4-71f65f5514d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=35524f79ce9f4afe888b86b8ddc534a6, user_id=0577dda6ef974bbbad9fda731e953d3b, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:36.536095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a7322-3682-45e3-a1a4-71f65f5514d0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:36.583397 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86197802-cf76-4dc7-b4e4-f4f2827ea409 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:36.606559 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 70/139] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:48:36 2022] PUT /identity/v3/projects/35524f79ce9f4afe888b86b8ddc534a6/users/0577dda6ef974bbbad9fda731e953d3b/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:48:36.622676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f677b-1da7-4456-b370-ce5a7e51447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:36.623932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f677b-1da7-4456-b370-ce5a7e51447e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:36.624424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f677b-1da7-4456-b370-ce5a7e51447e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:36.624968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f677b-1da7-4456-b370-ce5a7e51447e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:36.637888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f677b-1da7-4456-b370-ce5a7e51447e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:36.645893 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-8e5f677b-1da7-4456-b370-ce5a7e51447e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:48:36.647586 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 70/140] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:48:36.656971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a7322-3682-45e3-a1a4-71f65f5514d0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:36.788694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a7322-3682-45e3-a1a4-71f65f5514d0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:36.825544 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d95fec-51f3-461a-bcc5-0152351984e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:36.826707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d95fec-51f3-461a-bcc5-0152351984e8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:36.827220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d95fec-51f3-461a-bcc5-0152351984e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:36.827699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d95fec-51f3-461a-bcc5-0152351984e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:36.828732 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d95fec-51f3-461a-bcc5-0152351984e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:36.829289 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d95fec-51f3-461a-bcc5-0152351984e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:36.830946 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d95fec-51f3-461a-bcc5-0152351984e8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:36.841136 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 71/141] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:36.846411 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f677b-1da7-4456-b370-ce5a7e51447e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:36.954630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f677b-1da7-4456-b370-ce5a7e51447e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:36.991025 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce141a6-80f6-4a4f-843b-c26e89238cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:36.992373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce141a6-80f6-4a4f-843b-c26e89238cae None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:36.992873 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce141a6-80f6-4a4f-843b-c26e89238cae None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:36.993371 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce141a6-80f6-4a4f-843b-c26e89238cae None admin] PATH_INFO: `/v3/users/0577dda6ef974bbbad9fda731e953d3b` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:36.994807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce141a6-80f6-4a4f-843b-c26e89238cae None admin] RBAC: Authorizing `identity:get_user(user_id=0577dda6ef974bbbad9fda731e953d3b)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:36.996488 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce141a6-80f6-4a4f-843b-c26e89238cae None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:36.998680 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 71/142] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:36 2022] GET /identity/v3/users/0577dda6ef974bbbad9fda731e953d3b => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:37.003877 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d95fec-51f3-461a-bcc5-0152351984e8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:37.111378 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d95fec-51f3-461a-bcc5-0152351984e8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:37.151002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe452fd-1c9b-4ed1-9be3-d75d7369e121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:37.152053 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe452fd-1c9b-4ed1-9be3-d75d7369e121 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:37.152539 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe452fd-1c9b-4ed1-9be3-d75d7369e121 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:37.153018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe452fd-1c9b-4ed1-9be3-d75d7369e121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:37.233035 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe452fd-1c9b-4ed1-9be3-d75d7369e121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:37.234919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe452fd-1c9b-4ed1-9be3-d75d7369e121 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:37.352796 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 72/143] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:48:37.362196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce141a6-80f6-4a4f-843b-c26e89238cae None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:37.480169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce141a6-80f6-4a4f-843b-c26e89238cae None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:37.514468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8eecf-f66a-4ce0-a3b2-c16750a55385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:37.515755 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8eecf-f66a-4ce0-a3b2-c16750a55385 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:37.516250 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8eecf-f66a-4ce0-a3b2-c16750a55385 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:37.516787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8eecf-f66a-4ce0-a3b2-c16750a55385 None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:37.518250 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8eecf-f66a-4ce0-a3b2-c16750a55385 None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:37.519907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8eecf-f66a-4ce0-a3b2-c16750a55385 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:37.521911 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 72/144] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:37 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:37.528369 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe452fd-1c9b-4ed1-9be3-d75d7369e121 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:37.653800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe452fd-1c9b-4ed1-9be3-d75d7369e121 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:37.701855 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d1a65-027f-461b-8786-e6cecdb165ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:37.702581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d1a65-027f-461b-8786-e6cecdb165ab None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:37.702806 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d1a65-027f-461b-8786-e6cecdb165ab None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:37.703084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d1a65-027f-461b-8786-e6cecdb165ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:37.703920 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d1a65-027f-461b-8786-e6cecdb165ab None admin] RBAC: Adding query filter params (role.id=519c87ee2e424f1d81ce0c136c4b2d25, scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5, user.id=0577dda6ef974bbbad9fda731e953d3b) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:37.704236 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d1a65-027f-461b-8786-e6cecdb165ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:37.705760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d1a65-027f-461b-8786-e6cecdb165ab None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:37.712277 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 73/145] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:37 2022] GET /identity/v3/role_assignments?user.id=0577dda6ef974bbbad9fda731e953d3b&scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5&role.id=519c87ee2e424f1d81ce0c136c4b2d25 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:38.124770 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1978c6-2399-4648-b9f5-9bdb2fed9726 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:38.125074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1978c6-2399-4648-b9f5-9bdb2fed9726 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:38.125384 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1978c6-2399-4648-b9f5-9bdb2fed9726 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:38.126767 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 73/146] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:38.132097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee5ea4-cc4f-400c-a270-8340d73e34e2 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:38.132393 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee5ea4-cc4f-400c-a270-8340d73e34e2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:38.132680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee5ea4-cc4f-400c-a270-8340d73e34e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:38.154860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f8ee5ea4-cc4f-400c-a270-8340d73e34e2 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:38.156096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f8ee5ea4-cc4f-400c-a270-8340d73e34e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:38.239632 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 74/147] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:38.286668 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1978c6-2399-4648-b9f5-9bdb2fed9726 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:38.397392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1978c6-2399-4648-b9f5-9bdb2fed9726 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:38.450163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28a4f3-b6bf-4383-9137-379579b456ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:38.451496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28a4f3-b6bf-4383-9137-379579b456ac None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:38.451980 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28a4f3-b6bf-4383-9137-379579b456ac None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:38.452579 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28a4f3-b6bf-4383-9137-379579b456ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:38.464905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28a4f3-b6bf-4383-9137-379579b456ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:38.472625 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-bc28a4f3-b6bf-4383-9137-379579b456ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 10:48:38.474176 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 74/148] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:48:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:38.480857 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee5ea4-cc4f-400c-a270-8340d73e34e2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:38.625008 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee5ea4-cc4f-400c-a270-8340d73e34e2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:38.669272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce11dc-5415-4f1d-b1df-d30dae4c587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:38.669886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce11dc-5415-4f1d-b1df-d30dae4c587f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:38.670172 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce11dc-5415-4f1d-b1df-d30dae4c587f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:38.670447 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce11dc-5415-4f1d-b1df-d30dae4c587f None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:38.671207 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce11dc-5415-4f1d-b1df-d30dae4c587f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:38.671515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce11dc-5415-4f1d-b1df-d30dae4c587f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:38.673460 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce11dc-5415-4f1d-b1df-d30dae4c587f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:38.685570 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 75/149] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:48:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:38.694539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28a4f3-b6bf-4383-9137-379579b456ac None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:38.835953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28a4f3-b6bf-4383-9137-379579b456ac None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:38.875466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321194bb-b355-493e-9302-f85559a3cb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:38.876733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321194bb-b355-493e-9302-f85559a3cb8a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:38.877248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321194bb-b355-493e-9302-f85559a3cb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:38.877724 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321194bb-b355-493e-9302-f85559a3cb8a None admin] PATH_INFO: `/v3/users/0577dda6ef974bbbad9fda731e953d3b` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:38.879199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321194bb-b355-493e-9302-f85559a3cb8a None admin] RBAC: Authorizing `identity:get_user(user_id=0577dda6ef974bbbad9fda731e953d3b)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:38.880955 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321194bb-b355-493e-9302-f85559a3cb8a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:38.883162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 75/150] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:38 2022] GET /identity/v3/users/0577dda6ef974bbbad9fda731e953d3b => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:38.889306 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce11dc-5415-4f1d-b1df-d30dae4c587f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:39.009174 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce11dc-5415-4f1d-b1df-d30dae4c587f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:39.043217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef78ed-e5e0-4445-997e-fe61aa31fe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:39.043950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef78ed-e5e0-4445-997e-fe61aa31fe0e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:39.044290 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef78ed-e5e0-4445-997e-fe61aa31fe0e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:39.044574 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef78ed-e5e0-4445-997e-fe61aa31fe0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:39.128822 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef78ed-e5e0-4445-997e-fe61aa31fe0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:39.130369 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef78ed-e5e0-4445-997e-fe61aa31fe0e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:39.229158 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 76/151] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:48:39.238083 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321194bb-b355-493e-9302-f85559a3cb8a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:39.357424 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290a83b-e3b0-4c9b-b3fb-9c865f6a19ab None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:39.357710 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290a83b-e3b0-4c9b-b3fb-9c865f6a19ab None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:39.357907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290a83b-e3b0-4c9b-b3fb-9c865f6a19ab None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:39.359447 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 77/152] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:48:39.362691 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979b9a8-accd-40f5-86f8-afac879765a0 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:39.362977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979b9a8-accd-40f5-86f8-afac879765a0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:39.363257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979b9a8-accd-40f5-86f8-afac879765a0 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:39.364710 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 78/153] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:39.369161 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f9f1c-4363-4de8-8b12-786cd794ef59 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:39.369616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f9f1c-4363-4de8-8b12-786cd794ef59 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:39.369902 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f9f1c-4363-4de8-8b12-786cd794ef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:39.388075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321194bb-b355-493e-9302-f85559a3cb8a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:39.391190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d46f9f1c-4363-4de8-8b12-786cd794ef59 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:39.392405 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d46f9f1c-4363-4de8-8b12-786cd794ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:39.422393 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb9fb9-31ae-4f2d-8823-ccd8e040ff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:39.423944 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb9fb9-31ae-4f2d-8823-ccd8e040ff3e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:39.424428 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb9fb9-31ae-4f2d-8823-ccd8e040ff3e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:39.424924 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb9fb9-31ae-4f2d-8823-ccd8e040ff3e None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:39.426439 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb9fb9-31ae-4f2d-8823-ccd8e040ff3e None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:39.429272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb9fb9-31ae-4f2d-8823-ccd8e040ff3e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:39.431230 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 76/154] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:39 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:39.437528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ef260-7c15-461b-adcf-4311805f9efd None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:39.438314 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ef260-7c15-461b-adcf-4311805f9efd None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:39.438855 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ef260-7c15-461b-adcf-4311805f9efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:39.456328 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a35ef260-7c15-461b-adcf-4311805f9efd None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:39.457856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a35ef260-7c15-461b-adcf-4311805f9efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:39.471795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 79/155] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:48:39.473394 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f9f1c-4363-4de8-8b12-786cd794ef59 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:39.544985 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 77/156] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:39.546379 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ef260-7c15-461b-adcf-4311805f9efd None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:39.600204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f9f1c-4363-4de8-8b12-786cd794ef59 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:39.635326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580837e-aac8-4e46-aac0-3aaff830939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:39.636353 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580837e-aac8-4e46-aac0-3aaff830939a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:39.636835 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580837e-aac8-4e46-aac0-3aaff830939a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:39.637403 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580837e-aac8-4e46-aac0-3aaff830939a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:39.638508 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580837e-aac8-4e46-aac0-3aaff830939a None admin] RBAC: Adding query filter params (role.id=ed823413bca240af87bbf99994bcd0f8, scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5, user.id=0577dda6ef974bbbad9fda731e953d3b) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:39.639024 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580837e-aac8-4e46-aac0-3aaff830939a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:39.640819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580837e-aac8-4e46-aac0-3aaff830939a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:39.647430 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 80/157] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:39 2022] GET /identity/v3/role_assignments?user.id=0577dda6ef974bbbad9fda731e953d3b&scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5&role.id=ed823413bca240af87bbf99994bcd0f8 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:39.654496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580837e-aac8-4e46-aac0-3aaff830939a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:39.664037 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ef260-7c15-461b-adcf-4311805f9efd None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:39.707857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bc318-aa36-4ac0-94fe-2e6204deb129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:39.709626 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bc318-aa36-4ac0-94fe-2e6204deb129 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:39.709918 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bc318-aa36-4ac0-94fe-2e6204deb129 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:39.710199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bc318-aa36-4ac0-94fe-2e6204deb129 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:39.712157 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bc318-aa36-4ac0-94fe-2e6204deb129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:39.713684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bc318-aa36-4ac0-94fe-2e6204deb129 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:39.716058 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 78/158] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:39.721925 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e9dd1-0b4c-4fca-8348-92aaf29d0943 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:39.722221 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e9dd1-0b4c-4fca-8348-92aaf29d0943 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:39.722501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e9dd1-0b4c-4fca-8348-92aaf29d0943 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:39.723937 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 79/159] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:39.724686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e9dd1-0b4c-4fca-8348-92aaf29d0943 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:39.790141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580837e-aac8-4e46-aac0-3aaff830939a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:39.829008 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16d320-7934-4d74-b959-db3038e40e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:39.829868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16d320-7934-4d74-b959-db3038e40e38 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:39.830148 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16d320-7934-4d74-b959-db3038e40e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:39.830422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16d320-7934-4d74-b959-db3038e40e38 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:39.838848 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e9dd1-0b4c-4fca-8348-92aaf29d0943 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:39.842741 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16d320-7934-4d74-b959-db3038e40e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:39.850278 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-7d16d320-7934-4d74-b959-db3038e40e38 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 10:48:39.851981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 81/160] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:39.853291 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7e36d-4bf8-4e48-a5fb-31743d3f3fa4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:39.853632 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7e36d-4bf8-4e48-a5fb-31743d3f3fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:39.853911 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7e36d-4bf8-4e48-a5fb-31743d3f3fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:39.871826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-24d7e36d-4bf8-4e48-a5fb-31743d3f3fa4 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:39.873223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-24d7e36d-4bf8-4e48-a5fb-31743d3f3fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:39.875648 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c376a-a29d-4c36-b317-2c518c5c1a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:39.876339 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c376a-a29d-4c36-b317-2c518c5c1a9a None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:39.876625 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c376a-a29d-4c36-b317-2c518c5c1a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:39.876903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c376a-a29d-4c36-b317-2c518c5c1a9a None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:39.877656 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c376a-a29d-4c36-b317-2c518c5c1a9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:39.879088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c376a-a29d-4c36-b317-2c518c5c1a9a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:39.948432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 82/161] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:39.949313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7e36d-4bf8-4e48-a5fb-31743d3f3fa4 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:39.985617 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 80/162] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:48:39 2022] POST /identity/v3/users => generated 283 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:48:39.994272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c376a-a29d-4c36-b317-2c518c5c1a9a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:40.062176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7e36d-4bf8-4e48-a5fb-31743d3f3fa4 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:40.099878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69372f9-db42-41ca-a805-989f3859a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:40.100620 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69372f9-db42-41ca-a805-989f3859a389 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:40.100907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69372f9-db42-41ca-a805-989f3859a389 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:40.101253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69372f9-db42-41ca-a805-989f3859a389 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:40.102603 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69372f9-db42-41ca-a805-989f3859a389 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:40.102913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69372f9-db42-41ca-a805-989f3859a389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:40.104362 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69372f9-db42-41ca-a805-989f3859a389 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:40.104538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c376a-a29d-4c36-b317-2c518c5c1a9a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:40.114127 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 83/163] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:40.121654 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69372f9-db42-41ca-a805-989f3859a389 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:40.141651 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49b428-5f37-4081-9b0e-fee69f668569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:40.142494 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49b428-5f37-4081-9b0e-fee69f668569 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:40.142783 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49b428-5f37-4081-9b0e-fee69f668569 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:40.143061 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49b428-5f37-4081-9b0e-fee69f668569 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:40.154565 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49b428-5f37-4081-9b0e-fee69f668569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:40.165371 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-5f49b428-5f37-4081-9b0e-fee69f668569 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:48:40.166660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 81/164] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:48:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:40.175495 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6076ef-eb4c-40a2-8c67-602298cf166c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:40.175867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6076ef-eb4c-40a2-8c67-602298cf166c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:40.176151 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6076ef-eb4c-40a2-8c67-602298cf166c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:40.177589 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 82/165] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:40.178296 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6076ef-eb4c-40a2-8c67-602298cf166c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:40.237433 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69372f9-db42-41ca-a805-989f3859a389 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:40.279883 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ce407-2007-491e-9f64-e19334185eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:40.280755 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ce407-2007-491e-9f64-e19334185eaa None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:40.281028 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ce407-2007-491e-9f64-e19334185eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:40.281322 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ce407-2007-491e-9f64-e19334185eaa None admin] PATH_INFO: `/v3/users/635aadd986a14250beb9c600784c04f7` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:40.282521 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ce407-2007-491e-9f64-e19334185eaa None admin] RBAC: Authorizing `identity:get_user(user_id=635aadd986a14250beb9c600784c04f7)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:40.284066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ce407-2007-491e-9f64-e19334185eaa None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:40.289424 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 84/166] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:40 2022] GET /identity/v3/users/635aadd986a14250beb9c600784c04f7 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:40.289424 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f2b00-e671-4174-942d-f76a54f63e26 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:40.289424 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f2b00-e671-4174-942d-f76a54f63e26 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:40.289424 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f2b00-e671-4174-942d-f76a54f63e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:40.302544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6076ef-eb4c-40a2-8c67-602298cf166c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:40.306707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f82f2b00-e671-4174-942d-f76a54f63e26 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:40.307619 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f82f2b00-e671-4174-942d-f76a54f63e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:40.346493 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74efe6f-f19f-4e10-a3fd-8244a903806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:40.347176 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74efe6f-f19f-4e10-a3fd-8244a903806f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:40.347460 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74efe6f-f19f-4e10-a3fd-8244a903806f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:40.347734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74efe6f-f19f-4e10-a3fd-8244a903806f None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:40.348486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74efe6f-f19f-4e10-a3fd-8244a903806f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:40.348797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74efe6f-f19f-4e10-a3fd-8244a903806f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:40.350213 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74efe6f-f19f-4e10-a3fd-8244a903806f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:40.360227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 83/167] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:40.361208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74efe6f-f19f-4e10-a3fd-8244a903806f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:40.388736 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 85/168] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:40.389934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f2b00-e671-4174-942d-f76a54f63e26 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:40.486448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74efe6f-f19f-4e10-a3fd-8244a903806f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:40.509870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f2b00-e671-4174-942d-f76a54f63e26 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:40.540877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6a064-067c-4bef-ae7c-a1c39a094b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:40.542068 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6a064-067c-4bef-ae7c-a1c39a094b34 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:40.542536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6a064-067c-4bef-ae7c-a1c39a094b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:40.543174 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6a064-067c-4bef-ae7c-a1c39a094b34 None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:40.545403 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6a064-067c-4bef-ae7c-a1c39a094b34 None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:40.548419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6a064-067c-4bef-ae7c-a1c39a094b34 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:40.550717 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25579f8f-d925-4b28-a436-f4c8db0805d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:40.551721 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25579f8f-d925-4b28-a436-f4c8db0805d8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:40.551877 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25579f8f-d925-4b28-a436-f4c8db0805d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:40.552249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25579f8f-d925-4b28-a436-f4c8db0805d8 None admin] PATH_INFO: `/v3/users/2081d2092d1f43b39f058ddf8338a375` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:40.552432 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 84/169] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:40 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:40.553481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25579f8f-d925-4b28-a436-f4c8db0805d8 None admin] RBAC: Authorizing `identity:get_user(user_id=2081d2092d1f43b39f058ddf8338a375)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:40.553713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6a064-067c-4bef-ae7c-a1c39a094b34 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:40.555155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25579f8f-d925-4b28-a436-f4c8db0805d8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:40.557064 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 86/170] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:40 2022] GET /identity/v3/users/2081d2092d1f43b39f058ddf8338a375 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:40.557766 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25579f8f-d925-4b28-a436-f4c8db0805d8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:40.656525 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6a064-067c-4bef-ae7c-a1c39a094b34 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:40.657002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25579f8f-d925-4b28-a436-f4c8db0805d8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:40.692392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166bf80-3f30-4c15-9f15-c5887a6dd187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:40.692642 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e98803-0bb9-4dc3-855b-5ca5b5e37cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:40.693579 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e98803-0bb9-4dc3-855b-5ca5b5e37cc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:40.693859 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e98803-0bb9-4dc3-855b-5ca5b5e37cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:40.694089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166bf80-3f30-4c15-9f15-c5887a6dd187 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:40.694186 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e98803-0bb9-4dc3-855b-5ca5b5e37cc9 None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5/users/635aadd986a14250beb9c600784c04f7/roles/223e41cadac841039801dd9dc1416608` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:40.694656 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166bf80-3f30-4c15-9f15-c5887a6dd187 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:40.695248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166bf80-3f30-4c15-9f15-c5887a6dd187 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:40.696156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e98803-0bb9-4dc3-855b-5ca5b5e37cc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0acfd6cac5d493e9d1064ecf9357aa5, user_id=635aadd986a14250beb9c600784c04f7, role_id=223e41cadac841039801dd9dc1416608)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:40.697680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e98803-0bb9-4dc3-855b-5ca5b5e37cc9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:40.706701 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166bf80-3f30-4c15-9f15-c5887a6dd187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:40.714637 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-c166bf80-3f30-4c15-9f15-c5887a6dd187 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:48:40.716056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 85/171] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:40.716990 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166bf80-3f30-4c15-9f15-c5887a6dd187 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:40.779917 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 87/172] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:48:40 2022] PUT /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5/users/635aadd986a14250beb9c600784c04f7/roles/223e41cadac841039801dd9dc1416608 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:48:40.780854 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e98803-0bb9-4dc3-855b-5ca5b5e37cc9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:40.843756 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166bf80-3f30-4c15-9f15-c5887a6dd187 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:40.894549 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1b2da-41f5-4234-b036-e96298236fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:40.895220 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1b2da-41f5-4234-b036-e96298236fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:40.895500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1b2da-41f5-4234-b036-e96298236fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:40.895772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1b2da-41f5-4234-b036-e96298236fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:40.898782 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e98803-0bb9-4dc3-855b-5ca5b5e37cc9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:40.972900 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa033e5-f77a-4aa3-9e2c-ec1e283a3f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:40.973684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa033e5-f77a-4aa3-9e2c-ec1e283a3f4b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:40.973920 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa033e5-f77a-4aa3-9e2c-ec1e283a3f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:40.974248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa033e5-f77a-4aa3-9e2c-ec1e283a3f4b None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:40.975006 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa033e5-f77a-4aa3-9e2c-ec1e283a3f4b None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:40.975306 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa033e5-f77a-4aa3-9e2c-ec1e283a3f4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:40.978239 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa033e5-f77a-4aa3-9e2c-ec1e283a3f4b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:40.994741 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 88/173] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:41.002365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa033e5-f77a-4aa3-9e2c-ec1e283a3f4b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:41.020270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1b2da-41f5-4234-b036-e96298236fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:41.021768 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1b2da-41f5-4234-b036-e96298236fd6 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:41.186116 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa033e5-f77a-4aa3-9e2c-ec1e283a3f4b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:41.227829 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf8d51-1df9-41a5-a65d-b7180b3c8ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:41.228700 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf8d51-1df9-41a5-a65d-b7180b3c8ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:41.228970 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf8d51-1df9-41a5-a65d-b7180b3c8ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:41.229262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf8d51-1df9-41a5-a65d-b7180b3c8ba7 None admin] PATH_INFO: `/v3/users/0577dda6ef974bbbad9fda731e953d3b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:41.232419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf8d51-1df9-41a5-a65d-b7180b3c8ba7 None admin] RBAC: Authorizing `identity:get_user(user_id=0577dda6ef974bbbad9fda731e953d3b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:41.233936 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf8d51-1df9-41a5-a65d-b7180b3c8ba7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:41.235592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 89/174] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:41 2022] GET /identity/v3/users/0577dda6ef974bbbad9fda731e953d3b => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:41.238990 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 86/175] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:48:41.244917 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1b2da-41f5-4234-b036-e96298236fd6 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:41.245072 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf8d51-1df9-41a5-a65d-b7180b3c8ba7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:41.368935 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1b2da-41f5-4234-b036-e96298236fd6 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:41.412623 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d8611-ca82-47b5-bfc3-e7aa2f16453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:41.413527 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d8611-ca82-47b5-bfc3-e7aa2f16453b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:41.413807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d8611-ca82-47b5-bfc3-e7aa2f16453b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:41.414119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d8611-ca82-47b5-bfc3-e7aa2f16453b None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:41.417772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d8611-ca82-47b5-bfc3-e7aa2f16453b None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:41.419233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d8611-ca82-47b5-bfc3-e7aa2f16453b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:41.420957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 87/176] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:41 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:41.442777 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d8611-ca82-47b5-bfc3-e7aa2f16453b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:41.452743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf8d51-1df9-41a5-a65d-b7180b3c8ba7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:41.490266 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f10321-2032-4f3f-afbf-2b699955fa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:41.492611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f10321-2032-4f3f-afbf-2b699955fa7f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:41.494589 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f10321-2032-4f3f-afbf-2b699955fa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:41.495112 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f10321-2032-4f3f-afbf-2b699955fa7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:41.621082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d8611-ca82-47b5-bfc3-e7aa2f16453b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:41.644991 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f10321-2032-4f3f-afbf-2b699955fa7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:41.646825 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f10321-2032-4f3f-afbf-2b699955fa7f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:41.689776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb8a10-814e-446c-a202-b255adf8d6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:41.690550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb8a10-814e-446c-a202-b255adf8d6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:41.690837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb8a10-814e-446c-a202-b255adf8d6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:41.691414 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb8a10-814e-446c-a202-b255adf8d6b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:41.691956 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb8a10-814e-446c-a202-b255adf8d6b8 None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5, user.id=2081d2092d1f43b39f058ddf8338a375) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:41.692273 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb8a10-814e-446c-a202-b255adf8d6b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:41.693811 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb8a10-814e-446c-a202-b255adf8d6b8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:41.700530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 88/177] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:41 2022] GET /identity/v3/role_assignments?user.id=2081d2092d1f43b39f058ddf8338a375&scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5&role.id=090ba4d1ae32495289276665920d4a2c => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:41.828869 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 90/178] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:48:41.834574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb8a10-814e-446c-a202-b255adf8d6b8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:41.993461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb8a10-814e-446c-a202-b255adf8d6b8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:42.043322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17e2a4-3bc6-4226-9594-ebe6b401c681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:42.044548 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17e2a4-3bc6-4226-9594-ebe6b401c681 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:42.045073 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17e2a4-3bc6-4226-9594-ebe6b401c681 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:42.045552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17e2a4-3bc6-4226-9594-ebe6b401c681 None admin] PATH_INFO: `/v3/projects/35524f79ce9f4afe888b86b8ddc534a6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:42.049777 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17e2a4-3bc6-4226-9594-ebe6b401c681 None admin] RBAC: Authorizing `identity:get_project(project_id=35524f79ce9f4afe888b86b8ddc534a6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:42.051463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17e2a4-3bc6-4226-9594-ebe6b401c681 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:42.053463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 89/179] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:41 2022] GET /identity/v3/projects/35524f79ce9f4afe888b86b8ddc534a6 => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:42.059600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f10321-2032-4f3f-afbf-2b699955fa7f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:42.208291 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f10321-2032-4f3f-afbf-2b699955fa7f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:42.250867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e7d74-b045-4f8e-a8ec-b4bfae57bd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:42.251449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e7d74-b045-4f8e-a8ec-b4bfae57bd08 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:42.251781 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e7d74-b045-4f8e-a8ec-b4bfae57bd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:42.252058 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e7d74-b045-4f8e-a8ec-b4bfae57bd08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:42.252884 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e7d74-b045-4f8e-a8ec-b4bfae57bd08 None admin] RBAC: Adding query filter params (role.id=519c87ee2e424f1d81ce0c136c4b2d25, scope.project.id=35524f79ce9f4afe888b86b8ddc534a6, user.id=0577dda6ef974bbbad9fda731e953d3b) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:42.253214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e7d74-b045-4f8e-a8ec-b4bfae57bd08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:42.254724 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e7d74-b045-4f8e-a8ec-b4bfae57bd08 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:42.265830 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 91/180] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:42 2022] GET /identity/v3/role_assignments?user.id=0577dda6ef974bbbad9fda731e953d3b&scope.project.id=35524f79ce9f4afe888b86b8ddc534a6&role.id=519c87ee2e424f1d81ce0c136c4b2d25 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:42.883836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ddf02-fe84-40b0-a5d6-642128bd9612 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:42.883836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ddf02-fe84-40b0-a5d6-642128bd9612 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:42.883836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ddf02-fe84-40b0-a5d6-642128bd9612 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:42.883836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 90/181] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:42.889407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00cfbf-b0df-4671-96d3-30c8c0cdbb89 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:42.890069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00cfbf-b0df-4671-96d3-30c8c0cdbb89 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:42.890549 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00cfbf-b0df-4671-96d3-30c8c0cdbb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:42.909212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5f00cfbf-b0df-4671-96d3-30c8c0cdbb89 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:42.910784 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5f00cfbf-b0df-4671-96d3-30c8c0cdbb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:42.991075 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 92/182] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:43.017559 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ddf02-fe84-40b0-a5d6-642128bd9612 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:43.125686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ddf02-fe84-40b0-a5d6-642128bd9612 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:43.159811 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ff0eb-7d9a-43c2-a485-d88800909094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:43.160958 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff0eb-7d9a-43c2-a485-d88800909094 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:43.161495 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff0eb-7d9a-43c2-a485-d88800909094 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:43.161967 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff0eb-7d9a-43c2-a485-d88800909094 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:43.174271 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ff0eb-7d9a-43c2-a485-d88800909094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:43.182049 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-b96ff0eb-7d9a-43c2-a485-d88800909094 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:48:43.183764 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 91/183] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:48:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:43.189940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00cfbf-b0df-4671-96d3-30c8c0cdbb89 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:43.293668 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00cfbf-b0df-4671-96d3-30c8c0cdbb89 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:43.313979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e152f0-0045-4a31-8970-73bd6224badd None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:43.314587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e152f0-0045-4a31-8970-73bd6224badd None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:43.315063 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e152f0-0045-4a31-8970-73bd6224badd None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:43.316627 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 92/184] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:48:43.322254 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1161c4-17b9-4edb-8208-d467ee943384 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:43.322766 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1161c4-17b9-4edb-8208-d467ee943384 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:43.323256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1161c4-17b9-4edb-8208-d467ee943384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:43.327944 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180bff4-7801-47da-b204-402f6798ccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:43.328620 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180bff4-7801-47da-b204-402f6798ccb1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:43.328899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180bff4-7801-47da-b204-402f6798ccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:43.329344 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180bff4-7801-47da-b204-402f6798ccb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:43.329944 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180bff4-7801-47da-b204-402f6798ccb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:43.330245 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180bff4-7801-47da-b204-402f6798ccb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:43.331663 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180bff4-7801-47da-b204-402f6798ccb1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:43.340896 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 93/185] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:43.343288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-fc1161c4-17b9-4edb-8208-d467ee943384 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:43.344698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fc1161c4-17b9-4edb-8208-d467ee943384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:43.346096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180bff4-7801-47da-b204-402f6798ccb1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:43.417130 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 93/186] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:48:43.438470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1161c4-17b9-4edb-8208-d467ee943384 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:43.444879 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180bff4-7801-47da-b204-402f6798ccb1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:43.479400 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48b9e2-7d76-403f-b790-5328d990a4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:43.480313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48b9e2-7d76-403f-b790-5328d990a4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:43.480590 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48b9e2-7d76-403f-b790-5328d990a4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:43.480863 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48b9e2-7d76-403f-b790-5328d990a4f4 None admin] PATH_INFO: `/v3/users/1deca318db1b40339b0bfb1f95d8a63f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:43.496208 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48b9e2-7d76-403f-b790-5328d990a4f4 None admin] RBAC: Authorizing `identity:get_user(user_id=1deca318db1b40339b0bfb1f95d8a63f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:43.497856 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48b9e2-7d76-403f-b790-5328d990a4f4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:43.499649 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 94/187] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:43 2022] GET /identity/v3/users/1deca318db1b40339b0bfb1f95d8a63f => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:43.505203 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48b9e2-7d76-403f-b790-5328d990a4f4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:43.546526 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1161c4-17b9-4edb-8208-d467ee943384 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:43.595871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27ab67-a54c-44a6-a15f-b4dec956dc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:43.596689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27ab67-a54c-44a6-a15f-b4dec956dc59 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:43.596968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27ab67-a54c-44a6-a15f-b4dec956dc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:43.597270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27ab67-a54c-44a6-a15f-b4dec956dc59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:43.613636 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48b9e2-7d76-403f-b790-5328d990a4f4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:43.622484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27ab67-a54c-44a6-a15f-b4dec956dc59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:43.629291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-3a27ab67-a54c-44a6-a15f-b4dec956dc59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 10:48:43.630515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 94/188] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:48:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:48:43.635303 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9331fa8-96e9-4885-8d73-cd74997e604e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:43.635303 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9331fa8-96e9-4885-8d73-cd74997e604e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:43.635303 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9331fa8-96e9-4885-8d73-cd74997e604e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:43.635303 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 95/189] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:43.638986 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947a7e3-e515-4430-9062-98dcfc7e6297 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:43.639392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947a7e3-e515-4430-9062-98dcfc7e6297 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:43.639515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947a7e3-e515-4430-9062-98dcfc7e6297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:43.652082 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ce183-89fd-4b41-999d-d65391c3bfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:43.653135 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ce183-89fd-4b41-999d-d65391c3bfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:43.653494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ce183-89fd-4b41-999d-d65391c3bfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:43.653830 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ce183-89fd-4b41-999d-d65391c3bfa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:43.662847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c947a7e3-e515-4430-9062-98dcfc7e6297 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:43.665085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c947a7e3-e515-4430-9062-98dcfc7e6297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:43.746592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ce183-89fd-4b41-999d-d65391c3bfa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:43.747979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 96/190] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:43.748325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ce183-89fd-4b41-999d-d65391c3bfa1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:43.749250 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947a7e3-e515-4430-9062-98dcfc7e6297 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:43.869477 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 95/191] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 10:48:43.870658 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ce183-89fd-4b41-999d-d65391c3bfa1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:43.871356 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947a7e3-e515-4430-9062-98dcfc7e6297 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:43.903976 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e09f35-c3a0-4532-a902-3c9a99282864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:43.904644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09f35-c3a0-4532-a902-3c9a99282864 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:43.904921 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09f35-c3a0-4532-a902-3c9a99282864 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:43.905239 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09f35-c3a0-4532-a902-3c9a99282864 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:43.905984 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e09f35-c3a0-4532-a902-3c9a99282864 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:43.906287 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e09f35-c3a0-4532-a902-3c9a99282864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:43.909654 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e09f35-c3a0-4532-a902-3c9a99282864 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:43.919046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 97/192] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:48:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:43.922458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cb375-1ff0-4dcc-8efa-73438b4960cc None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:43.922742 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cb375-1ff0-4dcc-8efa-73438b4960cc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:43.923013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cb375-1ff0-4dcc-8efa-73438b4960cc None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:43.924350 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 98/193] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:43.925035 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cb375-1ff0-4dcc-8efa-73438b4960cc None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:43.968846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ce183-89fd-4b41-999d-d65391c3bfa1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:44.010551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d2d81-1f2e-46d8-a0dd-bc8b033e560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:44.011602 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d2d81-1f2e-46d8-a0dd-bc8b033e560a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:44.011955 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d2d81-1f2e-46d8-a0dd-bc8b033e560a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:44.012304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d2d81-1f2e-46d8-a0dd-bc8b033e560a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:44.013514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d2d81-1f2e-46d8-a0dd-bc8b033e560a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:44.015067 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d2d81-1f2e-46d8-a0dd-bc8b033e560a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:44.016693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 96/194] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:44.017496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d2d81-1f2e-46d8-a0dd-bc8b033e560a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:44.034707 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cb375-1ff0-4dcc-8efa-73438b4960cc None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:44.067959 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f86774-db09-492a-a95f-79e2b031c7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:44.068826 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f86774-db09-492a-a95f-79e2b031c7df None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:44.069141 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f86774-db09-492a-a95f-79e2b031c7df None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:44.069418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f86774-db09-492a-a95f-79e2b031c7df None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:44.070620 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f86774-db09-492a-a95f-79e2b031c7df None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:44.072058 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f86774-db09-492a-a95f-79e2b031c7df None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:44.073790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 99/195] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:43 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:44.074984 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c9f7a-6560-4318-800c-a47dd32eba28 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:44.075263 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c9f7a-6560-4318-800c-a47dd32eba28 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:44.075539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c9f7a-6560-4318-800c-a47dd32eba28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:44.091045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-be7c9f7a-6560-4318-800c-a47dd32eba28 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:44.092215 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-be7c9f7a-6560-4318-800c-a47dd32eba28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:44.115521 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d2d81-1f2e-46d8-a0dd-bc8b033e560a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:44.147232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa2f27-6b10-40e3-8f42-07bffeaa835e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:44.148120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa2f27-6b10-40e3-8f42-07bffeaa835e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:44.148444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa2f27-6b10-40e3-8f42-07bffeaa835e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:44.148715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa2f27-6b10-40e3-8f42-07bffeaa835e None admin] PATH_INFO: `/v3/users/1deca318db1b40339b0bfb1f95d8a63f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:44.149921 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa2f27-6b10-40e3-8f42-07bffeaa835e None admin] RBAC: Authorizing `identity:get_user(user_id=1deca318db1b40339b0bfb1f95d8a63f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:44.151398 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa2f27-6b10-40e3-8f42-07bffeaa835e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:44.153039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 97/196] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:44 2022] GET /identity/v3/users/1deca318db1b40339b0bfb1f95d8a63f => generated 283 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:44.153787 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa2f27-6b10-40e3-8f42-07bffeaa835e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:44.154762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 100/197] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:44.155580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c9f7a-6560-4318-800c-a47dd32eba28 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:44.248503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa2f27-6b10-40e3-8f42-07bffeaa835e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:44.251497 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c9f7a-6560-4318-800c-a47dd32eba28 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:44.283230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10383441-cc7c-4c75-8e92-db0a9069d296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:44.283907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10383441-cc7c-4c75-8e92-db0a9069d296 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:44.284190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10383441-cc7c-4c75-8e92-db0a9069d296 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:44.284468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10383441-cc7c-4c75-8e92-db0a9069d296 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:44.285218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10383441-cc7c-4c75-8e92-db0a9069d296 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:44.286132 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4b929-5d8c-4bab-8454-3fb1befb2116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:44.286738 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10383441-cc7c-4c75-8e92-db0a9069d296 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:44.286824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4b929-5d8c-4bab-8454-3fb1befb2116 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:44.287057 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4b929-5d8c-4bab-8454-3fb1befb2116 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:44.287325 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4b929-5d8c-4bab-8454-3fb1befb2116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:44.288150 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4b929-5d8c-4bab-8454-3fb1befb2116 None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=91dff31874af45e2a47062d139da0caf, user.id=1deca318db1b40339b0bfb1f95d8a63f) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:44.288458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4b929-5d8c-4bab-8454-3fb1befb2116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:44.290476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4b929-5d8c-4bab-8454-3fb1befb2116 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:44.295797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 101/198] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:44 2022] GET /identity/v3/role_assignments?user.id=1deca318db1b40339b0bfb1f95d8a63f&scope.project.id=91dff31874af45e2a47062d139da0caf&role.id=090ba4d1ae32495289276665920d4a2c => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:44.295797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4b929-5d8c-4bab-8454-3fb1befb2116 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:44.390548 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 98/199] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:48:44 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:48:44.402057 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4b929-5d8c-4bab-8454-3fb1befb2116 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:44.402252 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10383441-cc7c-4c75-8e92-db0a9069d296 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:44.456586 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf53a2a-25ad-4c91-b745-0430d1959c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:44.457327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf53a2a-25ad-4c91-b745-0430d1959c05 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:44.457614 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf53a2a-25ad-4c91-b745-0430d1959c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:44.457894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf53a2a-25ad-4c91-b745-0430d1959c05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:44.546408 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10383441-cc7c-4c75-8e92-db0a9069d296 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:44.550038 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf53a2a-25ad-4c91-b745-0430d1959c05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:44.551872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf53a2a-25ad-4c91-b745-0430d1959c05 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:44.595151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c483b-aba4-4b1e-8ad3-e0b82a0dd16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:44.595873 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c483b-aba4-4b1e-8ad3-e0b82a0dd16e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:44.596160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c483b-aba4-4b1e-8ad3-e0b82a0dd16e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:44.596440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c483b-aba4-4b1e-8ad3-e0b82a0dd16e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:44.609102 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c483b-aba4-4b1e-8ad3-e0b82a0dd16e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:44.616404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-470c483b-aba4-4b1e-8ad3-e0b82a0dd16e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 10:48:44.618287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 99/200] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:44.624120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c483b-aba4-4b1e-8ad3-e0b82a0dd16e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:44.691953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 102/201] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:48:44.694452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf53a2a-25ad-4c91-b745-0430d1959c05 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:44.771045 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c483b-aba4-4b1e-8ad3-e0b82a0dd16e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:44.817682 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b09cf-7056-41b8-916c-49d754e98b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:44.818675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b09cf-7056-41b8-916c-49d754e98b33 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:44.818965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b09cf-7056-41b8-916c-49d754e98b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:44.819239 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b09cf-7056-41b8-916c-49d754e98b33 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:44.820792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b09cf-7056-41b8-916c-49d754e98b33 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:44.821121 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b09cf-7056-41b8-916c-49d754e98b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:44.822264 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf53a2a-25ad-4c91-b745-0430d1959c05 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:44.822569 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b09cf-7056-41b8-916c-49d754e98b33 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:44.832816 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 100/202] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:44.838987 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b09cf-7056-41b8-916c-49d754e98b33 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:44.861622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3597539-8bb9-461a-bc8c-1d292ea4eb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:44.862525 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3597539-8bb9-461a-bc8c-1d292ea4eb7e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:44.862810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3597539-8bb9-461a-bc8c-1d292ea4eb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:44.863089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3597539-8bb9-461a-bc8c-1d292ea4eb7e None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:44.864300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3597539-8bb9-461a-bc8c-1d292ea4eb7e None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:44.865791 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3597539-8bb9-461a-bc8c-1d292ea4eb7e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:44.867536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 103/203] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:44 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:44.873703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3597539-8bb9-461a-bc8c-1d292ea4eb7e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:44.977378 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3597539-8bb9-461a-bc8c-1d292ea4eb7e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:44.982553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b09cf-7056-41b8-916c-49d754e98b33 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:45.016939 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88acac0-d95e-4fd4-827a-098b60a323b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:45.017923 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88acac0-d95e-4fd4-827a-098b60a323b2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:45.018205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88acac0-d95e-4fd4-827a-098b60a323b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:45.018535 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88acac0-d95e-4fd4-827a-098b60a323b2 None admin] PATH_INFO: `/v3/users/635aadd986a14250beb9c600784c04f7` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:45.019777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88acac0-d95e-4fd4-827a-098b60a323b2 None admin] RBAC: Authorizing `identity:get_user(user_id=635aadd986a14250beb9c600784c04f7)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:45.021303 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88acac0-d95e-4fd4-827a-098b60a323b2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:45.027997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94015c67-660c-4c29-bfeb-75e8aebdb679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:45.028153 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 101/204] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:44 2022] GET /identity/v3/users/635aadd986a14250beb9c600784c04f7 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:45.028667 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015c67-660c-4c29-bfeb-75e8aebdb679 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:45.028951 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015c67-660c-4c29-bfeb-75e8aebdb679 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:45.029253 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015c67-660c-4c29-bfeb-75e8aebdb679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:45.029350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88acac0-d95e-4fd4-827a-098b60a323b2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:45.030209 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94015c67-660c-4c29-bfeb-75e8aebdb679 None admin] RBAC: Adding query filter params (role.id=ed823413bca240af87bbf99994bcd0f8, scope.project.id=91dff31874af45e2a47062d139da0caf, user.id=1deca318db1b40339b0bfb1f95d8a63f) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:45.030532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94015c67-660c-4c29-bfeb-75e8aebdb679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:45.031973 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94015c67-660c-4c29-bfeb-75e8aebdb679 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:45.037904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 104/205] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:44 2022] GET /identity/v3/role_assignments?user.id=1deca318db1b40339b0bfb1f95d8a63f&scope.project.id=91dff31874af45e2a47062d139da0caf&role.id=ed823413bca240af87bbf99994bcd0f8 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:45.140198 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88acac0-d95e-4fd4-827a-098b60a323b2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:45.176827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79747b-bf8f-4810-841a-1d2cd31b3c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:45.177576 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79747b-bf8f-4810-841a-1d2cd31b3c22 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:45.177862 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79747b-bf8f-4810-841a-1d2cd31b3c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:45.178139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79747b-bf8f-4810-841a-1d2cd31b3c22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:45.250075 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79747b-bf8f-4810-841a-1d2cd31b3c22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:45.251535 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79747b-bf8f-4810-841a-1d2cd31b3c22 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:45.359001 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 102/206] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:48:45.360383 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94015c67-660c-4c29-bfeb-75e8aebdb679 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:45.463424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94015c67-660c-4c29-bfeb-75e8aebdb679 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:45.498988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770530f-4c2d-49a6-bae3-b5cf70824eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:45.499930 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770530f-4c2d-49a6-bae3-b5cf70824eee None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:45.500262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770530f-4c2d-49a6-bae3-b5cf70824eee None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:45.500526 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770530f-4c2d-49a6-bae3-b5cf70824eee None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:45.505816 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770530f-4c2d-49a6-bae3-b5cf70824eee None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:45.507290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770530f-4c2d-49a6-bae3-b5cf70824eee None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:45.509281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 105/207] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:45 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:45.515162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79747b-bf8f-4810-841a-1d2cd31b3c22 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:45.616959 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79747b-bf8f-4810-841a-1d2cd31b3c22 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:45.654568 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4e2ac-654c-4221-b80c-3d338fa84d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:45.661073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4e2ac-654c-4221-b80c-3d338fa84d4e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:45.661073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4e2ac-654c-4221-b80c-3d338fa84d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:45.661073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4e2ac-654c-4221-b80c-3d338fa84d4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:45.661073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4e2ac-654c-4221-b80c-3d338fa84d4e None admin] RBAC: Adding query filter params (role.id=223e41cadac841039801dd9dc1416608, scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5, user.id=635aadd986a14250beb9c600784c04f7) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:45.661073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4e2ac-654c-4221-b80c-3d338fa84d4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:45.661073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4e2ac-654c-4221-b80c-3d338fa84d4e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:45.671339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 103/208] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:45 2022] GET /identity/v3/role_assignments?user.id=635aadd986a14250beb9c600784c04f7&scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5&role.id=223e41cadac841039801dd9dc1416608 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:46.960731 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b48ef8-2b64-4dd8-b654-531198efb48d None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:46.962622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b48ef8-2b64-4dd8-b654-531198efb48d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:46.962622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b48ef8-2b64-4dd8-b654-531198efb48d None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:46.963277 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 106/209] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:46.968920 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c28d08-9ef1-46bb-8c84-f9540c963cf0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:46.969407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c28d08-9ef1-46bb-8c84-f9540c963cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:46.969537 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c28d08-9ef1-46bb-8c84-f9540c963cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:46.986362 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-35c28d08-9ef1-46bb-8c84-f9540c963cf0 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:46.987541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-35c28d08-9ef1-46bb-8c84-f9540c963cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:47.058125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 104/210] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:48:47.080558 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b48ef8-2b64-4dd8-b654-531198efb48d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:47.094002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e21fc-3459-4934-96d9-02f91191ab36 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:47.094603 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e21fc-3459-4934-96d9-02f91191ab36 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:47.094884 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e21fc-3459-4934-96d9-02f91191ab36 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:47.097143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 105/211] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:48:47.101840 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfb941-70ef-4d1b-bd80-6f82c49f72fd None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:47.102134 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfb941-70ef-4d1b-bd80-6f82c49f72fd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:47.102414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfb941-70ef-4d1b-bd80-6f82c49f72fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:47.123317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3adfb941-70ef-4d1b-bd80-6f82c49f72fd None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:47.124950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3adfb941-70ef-4d1b-bd80-6f82c49f72fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:47.184064 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b48ef8-2b64-4dd8-b654-531198efb48d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:47.210675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 106/212] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:47.224178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae1db6-2328-47fe-9c2e-b66f707bb147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:47.225149 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae1db6-2328-47fe-9c2e-b66f707bb147 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:47.225433 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae1db6-2328-47fe-9c2e-b66f707bb147 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:47.225711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae1db6-2328-47fe-9c2e-b66f707bb147 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:47.236734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfb941-70ef-4d1b-bd80-6f82c49f72fd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:47.237090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae1db6-2328-47fe-9c2e-b66f707bb147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:47.244995 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-b3ae1db6-2328-47fe-9c2e-b66f707bb147 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:48:47.246268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 107/213] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:48:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:47.252011 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae1db6-2328-47fe-9c2e-b66f707bb147 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:47.350628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfb941-70ef-4d1b-bd80-6f82c49f72fd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:47.376184 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae1db6-2328-47fe-9c2e-b66f707bb147 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:47.386794 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefefe8-118f-4f56-ab58-2f3ac4c198da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:47.387589 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefefe8-118f-4f56-ab58-2f3ac4c198da None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:47.387872 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefefe8-118f-4f56-ab58-2f3ac4c198da None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:47.388149 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefefe8-118f-4f56-ab58-2f3ac4c198da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:47.389332 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefefe8-118f-4f56-ab58-2f3ac4c198da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:47.390807 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefefe8-118f-4f56-ab58-2f3ac4c198da None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:47.392583 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 107/214] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:47.393615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd0389-4790-45ac-a118-4483dda5f175 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:47.393899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd0389-4790-45ac-a118-4483dda5f175 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:47.394174 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd0389-4790-45ac-a118-4483dda5f175 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:47.395514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 108/215] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:47.400050 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd0389-4790-45ac-a118-4483dda5f175 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:47.415763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51776ba6-6bf1-404a-9b1d-85a2bc17b059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:47.416441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776ba6-6bf1-404a-9b1d-85a2bc17b059 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:47.416724 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776ba6-6bf1-404a-9b1d-85a2bc17b059 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:47.417001 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776ba6-6bf1-404a-9b1d-85a2bc17b059 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:47.417784 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51776ba6-6bf1-404a-9b1d-85a2bc17b059 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:47.418096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51776ba6-6bf1-404a-9b1d-85a2bc17b059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:47.419490 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51776ba6-6bf1-404a-9b1d-85a2bc17b059 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:47.433106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 108/216] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:47.433106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efef42f-8fda-4f73-ad68-63ac5860c0aa None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:47.433106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efef42f-8fda-4f73-ad68-63ac5860c0aa None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:47.433106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efef42f-8fda-4f73-ad68-63ac5860c0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:47.450189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0efef42f-8fda-4f73-ad68-63ac5860c0aa None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:47.451379 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0efef42f-8fda-4f73-ad68-63ac5860c0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:47.509797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd0389-4790-45ac-a118-4483dda5f175 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:47.516428 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 109/217] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:47.517222 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efef42f-8fda-4f73-ad68-63ac5860c0aa None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:47.551885 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d08b87-4a4a-436c-b6f4-521c995fbe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:47.552935 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d08b87-4a4a-436c-b6f4-521c995fbe2a None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:47.553258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d08b87-4a4a-436c-b6f4-521c995fbe2a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:47.553534 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d08b87-4a4a-436c-b6f4-521c995fbe2a None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:47.554243 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d08b87-4a4a-436c-b6f4-521c995fbe2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:47.555759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d08b87-4a4a-436c-b6f4-521c995fbe2a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:47.614368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efef42f-8fda-4f73-ad68-63ac5860c0aa None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:47.647772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 109/218] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:48:47 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:48:47.657369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2c376-f423-4fd1-8fe3-6cefa613bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:47.657369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c376-f423-4fd1-8fe3-6cefa613bf23 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:47.657369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c376-f423-4fd1-8fe3-6cefa613bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:47.657369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c376-f423-4fd1-8fe3-6cefa613bf23 None admin] PATH_INFO: `/v3/users/1deca318db1b40339b0bfb1f95d8a63f` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:47.657696 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d08b87-4a4a-436c-b6f4-521c995fbe2a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:47.658877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2c376-f423-4fd1-8fe3-6cefa613bf23 None admin] RBAC: Authorizing `identity:get_user(user_id=1deca318db1b40339b0bfb1f95d8a63f)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:47.660448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2c376-f423-4fd1-8fe3-6cefa613bf23 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:47.662291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 110/219] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:47 2022] GET /identity/v3/users/1deca318db1b40339b0bfb1f95d8a63f => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:47.668530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2c376-f423-4fd1-8fe3-6cefa613bf23 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:47.776244 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d08b87-4a4a-436c-b6f4-521c995fbe2a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:47.776785 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2c376-f423-4fd1-8fe3-6cefa613bf23 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:47.815031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1c370-a6c7-4394-b656-61547ff636c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:47.815841 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1c370-a6c7-4394-b656-61547ff636c9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:47.816121 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1c370-a6c7-4394-b656-61547ff636c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:47.816393 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1c370-a6c7-4394-b656-61547ff636c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:47.816664 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f96dee-fee7-445d-ae7c-1ad63f0553da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:47.817581 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f96dee-fee7-445d-ae7c-1ad63f0553da None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:47.817911 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f96dee-fee7-445d-ae7c-1ad63f0553da None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:47.818190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f96dee-fee7-445d-ae7c-1ad63f0553da None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:47.820157 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f96dee-fee7-445d-ae7c-1ad63f0553da None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:47.822086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f96dee-fee7-445d-ae7c-1ad63f0553da None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:47.824242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 111/220] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:47 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:47.825491 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f34c74-8e9d-4244-9a39-20c5c518f8bb None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:47.825779 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f34c74-8e9d-4244-9a39-20c5c518f8bb None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:47.826054 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f34c74-8e9d-4244-9a39-20c5c518f8bb None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:47.827489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 112/221] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:47.833553 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f34c74-8e9d-4244-9a39-20c5c518f8bb None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:47.836759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1c370-a6c7-4394-b656-61547ff636c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:47.844034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-4cb1c370-a6c7-4394-b656-61547ff636c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:48:47.845448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 110/222] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:47.846701 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05333d84-d130-4516-8043-d1dd07e0822a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:47.847002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05333d84-d130-4516-8043-d1dd07e0822a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:47.847285 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05333d84-d130-4516-8043-d1dd07e0822a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:47.866399 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-05333d84-d130-4516-8043-d1dd07e0822a None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:47.868154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-05333d84-d130-4516-8043-d1dd07e0822a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:47.948443 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 111/223] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:47.949472 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05333d84-d130-4516-8043-d1dd07e0822a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:47.967805 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f34c74-8e9d-4244-9a39-20c5c518f8bb None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:48.007981 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c6ff9-3693-4dda-9c25-ab408b832f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:48.008876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c6ff9-3693-4dda-9c25-ab408b832f03 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:48.009189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c6ff9-3693-4dda-9c25-ab408b832f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:48.009466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c6ff9-3693-4dda-9c25-ab408b832f03 None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf/users/1deca318db1b40339b0bfb1f95d8a63f/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:48.012227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c6ff9-3693-4dda-9c25-ab408b832f03 None admin] RBAC: Authorizing `identity:create_grant(project_id=91dff31874af45e2a47062d139da0caf, user_id=1deca318db1b40339b0bfb1f95d8a63f, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:48.014257 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c6ff9-3693-4dda-9c25-ab408b832f03 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:48.060552 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05333d84-d130-4516-8043-d1dd07e0822a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:48.094434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31313b78-282e-45b2-9aab-fbca63b01aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:48.095110 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31313b78-282e-45b2-9aab-fbca63b01aab None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:48.095392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31313b78-282e-45b2-9aab-fbca63b01aab None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:48.095665 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31313b78-282e-45b2-9aab-fbca63b01aab None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:48.096412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31313b78-282e-45b2-9aab-fbca63b01aab None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:48.096718 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31313b78-282e-45b2-9aab-fbca63b01aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:48.098277 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31313b78-282e-45b2-9aab-fbca63b01aab None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:48.107452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 112/224] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:48.112055 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31313b78-282e-45b2-9aab-fbca63b01aab None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:48.130217 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 113/225] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:48:47 2022] PUT /identity/v3/projects/91dff31874af45e2a47062d139da0caf/users/1deca318db1b40339b0bfb1f95d8a63f/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:48:48.130217 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c6ff9-3693-4dda-9c25-ab408b832f03 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:48.293916 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c6ff9-3693-4dda-9c25-ab408b832f03 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:48.320405 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31313b78-282e-45b2-9aab-fbca63b01aab None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:48.360851 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015e313-c399-41d3-8e03-4227599a1eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:48.361930 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015e313-c399-41d3-8e03-4227599a1eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:48.362222 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015e313-c399-41d3-8e03-4227599a1eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:48.362491 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015e313-c399-41d3-8e03-4227599a1eb1 None admin] PATH_INFO: `/v3/users/347317648695408abcb4c063e782a898` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:48.376596 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc81bf-9676-442c-86b5-a63c9be1a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:48.377380 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc81bf-9676-442c-86b5-a63c9be1a424 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:48.377659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc81bf-9676-442c-86b5-a63c9be1a424 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:48.377934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc81bf-9676-442c-86b5-a63c9be1a424 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:48.379099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015e313-c399-41d3-8e03-4227599a1eb1 None admin] RBAC: Authorizing `identity:get_user(user_id=347317648695408abcb4c063e782a898)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:48.380769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015e313-c399-41d3-8e03-4227599a1eb1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:48.384747 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 114/226] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:48 2022] GET /identity/v3/users/347317648695408abcb4c063e782a898 => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:48.393085 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc81bf-9676-442c-86b5-a63c9be1a424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:48.394354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015e313-c399-41d3-8e03-4227599a1eb1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:48.400232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-3efc81bf-9676-442c-86b5-a63c9be1a424 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 10:48:48.400232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 113/227] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:48:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:48.404623 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc81bf-9676-442c-86b5-a63c9be1a424 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:48.517988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc81bf-9676-442c-86b5-a63c9be1a424 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:48.561171 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f3200-092e-4ccd-bd83-55ca9138f93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:48.562093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f3200-092e-4ccd-bd83-55ca9138f93e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:48.562771 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f3200-092e-4ccd-bd83-55ca9138f93e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:48.563216 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f3200-092e-4ccd-bd83-55ca9138f93e None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:48.564126 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f3200-092e-4ccd-bd83-55ca9138f93e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:48.564574 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f3200-092e-4ccd-bd83-55ca9138f93e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:48.566527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f3200-092e-4ccd-bd83-55ca9138f93e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:48.573643 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015e313-c399-41d3-8e03-4227599a1eb1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:48.576996 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 114/228] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:48:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:48.591069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f3200-092e-4ccd-bd83-55ca9138f93e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:48.638313 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93a66b-95c0-46ee-8e93-e2ca812f275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:48.638968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93a66b-95c0-46ee-8e93-e2ca812f275a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:48.639300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93a66b-95c0-46ee-8e93-e2ca812f275a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:48.639576 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93a66b-95c0-46ee-8e93-e2ca812f275a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:48.739721 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f3200-092e-4ccd-bd83-55ca9138f93e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:48.787223 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93a66b-95c0-46ee-8e93-e2ca812f275a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:48.788684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93a66b-95c0-46ee-8e93-e2ca812f275a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:48.807041 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fddc5-8945-4b3c-b697-2916a11a219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:48.808203 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fddc5-8945-4b3c-b697-2916a11a219e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:48.808680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fddc5-8945-4b3c-b697-2916a11a219e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:48.809177 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fddc5-8945-4b3c-b697-2916a11a219e None admin] PATH_INFO: `/v3/users/1deca318db1b40339b0bfb1f95d8a63f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:48.813748 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fddc5-8945-4b3c-b697-2916a11a219e None admin] RBAC: Authorizing `identity:get_user(user_id=1deca318db1b40339b0bfb1f95d8a63f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:48.815458 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fddc5-8945-4b3c-b697-2916a11a219e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:48.820619 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 115/229] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:48 2022] GET /identity/v3/users/1deca318db1b40339b0bfb1f95d8a63f => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:48.824990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fddc5-8945-4b3c-b697-2916a11a219e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:48.892940 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 115/230] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:48:48.898358 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93a66b-95c0-46ee-8e93-e2ca812f275a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:48.997262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93a66b-95c0-46ee-8e93-e2ca812f275a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:48.999522 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fddc5-8945-4b3c-b697-2916a11a219e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:49.033898 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d36ef-69b1-4814-bf4f-e7098156282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:49.034592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d36ef-69b1-4814-bf4f-e7098156282f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:49.034870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d36ef-69b1-4814-bf4f-e7098156282f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:49.035156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d36ef-69b1-4814-bf4f-e7098156282f None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:49.035964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dd837-56c2-4f6f-8a36-bf0797bc5ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:49.036333 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d36ef-69b1-4814-bf4f-e7098156282f None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:49.037322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dd837-56c2-4f6f-8a36-bf0797bc5ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:49.037805 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dd837-56c2-4f6f-8a36-bf0797bc5ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:49.037922 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d36ef-69b1-4814-bf4f-e7098156282f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:49.038393 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dd837-56c2-4f6f-8a36-bf0797bc5ba7 None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:49.039947 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dd837-56c2-4f6f-8a36-bf0797bc5ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:49.040077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 116/231] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:48 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:49.045092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dd837-56c2-4f6f-8a36-bf0797bc5ba7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:49.047909 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 116/232] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:48 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:49.054041 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d36ef-69b1-4814-bf4f-e7098156282f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:49.056388 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dd837-56c2-4f6f-8a36-bf0797bc5ba7 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:49.172397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d36ef-69b1-4814-bf4f-e7098156282f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:49.210298 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a79434-78d7-460a-b2ad-4e3e175627e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:49.211089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a79434-78d7-460a-b2ad-4e3e175627e8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:49.211365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a79434-78d7-460a-b2ad-4e3e175627e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:49.211635 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a79434-78d7-460a-b2ad-4e3e175627e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:49.212453 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a79434-78d7-460a-b2ad-4e3e175627e8 None admin] RBAC: Adding query filter params (role.id=519c87ee2e424f1d81ce0c136c4b2d25, scope.project.id=91dff31874af45e2a47062d139da0caf, user.id=347317648695408abcb4c063e782a898) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:49.212759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a79434-78d7-460a-b2ad-4e3e175627e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:49.214257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a79434-78d7-460a-b2ad-4e3e175627e8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:49.222699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 117/233] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:49 2022] GET /identity/v3/role_assignments?user.id=347317648695408abcb4c063e782a898&scope.project.id=91dff31874af45e2a47062d139da0caf&role.id=519c87ee2e424f1d81ce0c136c4b2d25 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:49.239834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dd837-56c2-4f6f-8a36-bf0797bc5ba7 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:49.300818 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509f1a2-4460-435a-903e-788a18f307b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:49.301861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509f1a2-4460-435a-903e-788a18f307b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:49.302145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509f1a2-4460-435a-903e-788a18f307b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:49.302419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509f1a2-4460-435a-903e-788a18f307b1 None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf/users/1deca318db1b40339b0bfb1f95d8a63f/roles/ed823413bca240af87bbf99994bcd0f8` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:49.305391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509f1a2-4460-435a-903e-788a18f307b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=91dff31874af45e2a47062d139da0caf, user_id=1deca318db1b40339b0bfb1f95d8a63f, role_id=ed823413bca240af87bbf99994bcd0f8)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:49.306856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509f1a2-4460-435a-903e-788a18f307b1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:49.437399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 117/234] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:48:49 2022] PUT /identity/v3/projects/91dff31874af45e2a47062d139da0caf/users/1deca318db1b40339b0bfb1f95d8a63f/roles/ed823413bca240af87bbf99994bcd0f8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:48:50.468477 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409fd69-d94c-45c7-b681-2f963ef94716 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:50.468978 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409fd69-d94c-45c7-b681-2f963ef94716 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:50.469079 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409fd69-d94c-45c7-b681-2f963ef94716 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:50.470538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 118/235] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:50.475898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d146d3-4044-4efe-b8ad-e83db2fe639c None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:50.476827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d146d3-4044-4efe-b8ad-e83db2fe639c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:50.476994 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d146d3-4044-4efe-b8ad-e83db2fe639c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:50.498041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c6d146d3-4044-4efe-b8ad-e83db2fe639c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:50.499236 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c6d146d3-4044-4efe-b8ad-e83db2fe639c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:50.524072 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae889d3-db88-405e-9d5e-694ead4bc413 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:50.524370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae889d3-db88-405e-9d5e-694ead4bc413 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:50.524638 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae889d3-db88-405e-9d5e-694ead4bc413 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:50.527069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 119/236] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:48:50.531931 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4cf1b-c3cc-4cba-a7e1-7522099661d3 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:50.532218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4cf1b-c3cc-4cba-a7e1-7522099661d3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:50.532496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4cf1b-c3cc-4cba-a7e1-7522099661d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:50.551650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-69b4cf1b-c3cc-4cba-a7e1-7522099661d3 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:50.552837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-69b4cf1b-c3cc-4cba-a7e1-7522099661d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:50.609750 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 118/237] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:50.638599 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 120/238] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:50.655602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d146d3-4044-4efe-b8ad-e83db2fe639c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:50.664848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4cf1b-c3cc-4cba-a7e1-7522099661d3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:50.773336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4cf1b-c3cc-4cba-a7e1-7522099661d3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:50.815057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e9f5a-933d-4e35-8db5-07201a6d1e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:50.815871 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e9f5a-933d-4e35-8db5-07201a6d1e4d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:50.816147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e9f5a-933d-4e35-8db5-07201a6d1e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:50.816420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e9f5a-933d-4e35-8db5-07201a6d1e4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:50.828796 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e9f5a-933d-4e35-8db5-07201a6d1e4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:50.837811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-da2e9f5a-933d-4e35-8db5-07201a6d1e4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 10:48:50.839371 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 121/239] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:50.845258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e9f5a-933d-4e35-8db5-07201a6d1e4d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:50.890902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d146d3-4044-4efe-b8ad-e83db2fe639c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:50.937692 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6626a4-990c-4a02-9725-c3220270176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:50.939515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6626a4-990c-4a02-9725-c3220270176a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:50.940003 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6626a4-990c-4a02-9725-c3220270176a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:50.940372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6626a4-990c-4a02-9725-c3220270176a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:50.941625 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6626a4-990c-4a02-9725-c3220270176a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:50.943130 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6626a4-990c-4a02-9725-c3220270176a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:50.945119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 119/240] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:50.953987 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6626a4-990c-4a02-9725-c3220270176a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:51.007003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e9f5a-933d-4e35-8db5-07201a6d1e4d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:51.042270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b391d1-bd12-4597-9688-c9bbe2093359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:51.042852 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b391d1-bd12-4597-9688-c9bbe2093359 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:51.043132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b391d1-bd12-4597-9688-c9bbe2093359 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:51.043401 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b391d1-bd12-4597-9688-c9bbe2093359 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:51.044142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b391d1-bd12-4597-9688-c9bbe2093359 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:51.044707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b391d1-bd12-4597-9688-c9bbe2093359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:51.046153 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b391d1-bd12-4597-9688-c9bbe2093359 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:51.054590 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 122/241] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:51.055905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddf783-7757-49bb-bb50-048916e58934 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:51.056237 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddf783-7757-49bb-bb50-048916e58934 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:51.056512 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddf783-7757-49bb-bb50-048916e58934 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:51.058112 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 123/242] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:51.065871 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddf783-7757-49bb-bb50-048916e58934 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:51.102209 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6626a4-990c-4a02-9725-c3220270176a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:51.143793 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940499f-f426-46b4-8410-910e3fd66898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:51.144474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940499f-f426-46b4-8410-910e3fd66898 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:51.144768 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940499f-f426-46b4-8410-910e3fd66898 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:51.145048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940499f-f426-46b4-8410-910e3fd66898 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:51.145781 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940499f-f426-46b4-8410-910e3fd66898 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:51.147241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940499f-f426-46b4-8410-910e3fd66898 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:51.174218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddf783-7757-49bb-bb50-048916e58934 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:51.206083 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ca69c-f4e6-4254-a022-29ffb685349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:51.206925 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ca69c-f4e6-4254-a022-29ffb685349f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:51.207204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ca69c-f4e6-4254-a022-29ffb685349f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:51.207473 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ca69c-f4e6-4254-a022-29ffb685349f None admin] PATH_INFO: `/v3/users/13478df4a11c4d68a9707e219a374b90` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:51.223150 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ca69c-f4e6-4254-a022-29ffb685349f None admin] RBAC: Authorizing `identity:get_user(user_id=13478df4a11c4d68a9707e219a374b90)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:51.224743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ca69c-f4e6-4254-a022-29ffb685349f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:51.225892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 120/243] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:48:50 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:48:51.227964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04972c95-e0c5-4f1a-a57f-31d9879c2427 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:51.228468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04972c95-e0c5-4f1a-a57f-31d9879c2427 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:51.229123 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04972c95-e0c5-4f1a-a57f-31d9879c2427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:51.237214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 124/244] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:51 2022] GET /identity/v3/users/13478df4a11c4d68a9707e219a374b90 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:51.238453 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ca69c-f4e6-4254-a022-29ffb685349f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:51.267353 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-04972c95-e0c5-4f1a-a57f-31d9879c2427 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:51.271039 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-04972c95-e0c5-4f1a-a57f-31d9879c2427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:51.413249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 121/245] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:51.439116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04972c95-e0c5-4f1a-a57f-31d9879c2427 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:51.446374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ca69c-f4e6-4254-a022-29ffb685349f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:51.488693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8755d0-de60-41f6-a4ba-429d05d47bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:51.489479 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8755d0-de60-41f6-a4ba-429d05d47bac None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:51.489674 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8755d0-de60-41f6-a4ba-429d05d47bac None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:51.489955 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8755d0-de60-41f6-a4ba-429d05d47bac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:51.559041 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8755d0-de60-41f6-a4ba-429d05d47bac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:51.560557 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8755d0-de60-41f6-a4ba-429d05d47bac None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:51.563507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04972c95-e0c5-4f1a-a57f-31d9879c2427 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:51.599172 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa153e54-0fbe-4413-b3a2-127ca357b8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:51.599981 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa153e54-0fbe-4413-b3a2-127ca357b8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:51.600263 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa153e54-0fbe-4413-b3a2-127ca357b8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:51.600542 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa153e54-0fbe-4413-b3a2-127ca357b8a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:51.612931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa153e54-0fbe-4413-b3a2-127ca357b8a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:51.620040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-fa153e54-0fbe-4413-b3a2-127ca357b8a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:48:51.621758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 122/246] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:48:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:48:51.627289 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa153e54-0fbe-4413-b3a2-127ca357b8a0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:51.670520 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 125/247] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 10:48:51.676597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8755d0-de60-41f6-a4ba-429d05d47bac None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:51.752056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa153e54-0fbe-4413-b3a2-127ca357b8a0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:51.781955 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8755d0-de60-41f6-a4ba-429d05d47bac None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:51.788129 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9273e-c966-42e2-a278-c6dd24e5507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:51.788848 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9273e-c966-42e2-a278-c6dd24e5507c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:51.789166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9273e-c966-42e2-a278-c6dd24e5507c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:51.789445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9273e-c966-42e2-a278-c6dd24e5507c None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:51.790247 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9273e-c966-42e2-a278-c6dd24e5507c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:51.790566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9273e-c966-42e2-a278-c6dd24e5507c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:51.791955 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9273e-c966-42e2-a278-c6dd24e5507c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:51.809110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 123/248] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:51.810962 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9273e-c966-42e2-a278-c6dd24e5507c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:51.838611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad86cff-6afc-4742-b405-ed5d09cd430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:51.839778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad86cff-6afc-4742-b405-ed5d09cd430a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:51.840704 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad86cff-6afc-4742-b405-ed5d09cd430a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:51.841179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad86cff-6afc-4742-b405-ed5d09cd430a None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:51.842834 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad86cff-6afc-4742-b405-ed5d09cd430a None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:51.845336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad86cff-6afc-4742-b405-ed5d09cd430a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:51.848308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 126/249] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:51 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:51.853632 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad86cff-6afc-4742-b405-ed5d09cd430a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:51.925391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9273e-c966-42e2-a278-c6dd24e5507c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:51.954882 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad86cff-6afc-4742-b405-ed5d09cd430a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:51.961231 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f14bdf-fd89-41e0-acc4-da5b48a84ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:51.962384 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f14bdf-fd89-41e0-acc4-da5b48a84ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:51.962897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f14bdf-fd89-41e0-acc4-da5b48a84ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:51.963313 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f14bdf-fd89-41e0-acc4-da5b48a84ff1 None admin] PATH_INFO: `/v3/users/1deca318db1b40339b0bfb1f95d8a63f` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:51.964773 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f14bdf-fd89-41e0-acc4-da5b48a84ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=1deca318db1b40339b0bfb1f95d8a63f)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:51.966534 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f14bdf-fd89-41e0-acc4-da5b48a84ff1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:51.968443 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 124/250] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:51 2022] GET /identity/v3/users/1deca318db1b40339b0bfb1f95d8a63f => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:51.974214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f14bdf-fd89-41e0-acc4-da5b48a84ff1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:51.993514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530e7a2-cac3-4b4b-91ce-92a3e410ce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:51.994193 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530e7a2-cac3-4b4b-91ce-92a3e410ce30 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:51.994472 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530e7a2-cac3-4b4b-91ce-92a3e410ce30 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:51.994749 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530e7a2-cac3-4b4b-91ce-92a3e410ce30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:51.995590 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530e7a2-cac3-4b4b-91ce-92a3e410ce30 None admin] RBAC: Adding query filter params (role.id=223e41cadac841039801dd9dc1416608, scope.project.id=91dff31874af45e2a47062d139da0caf, user.id=13478df4a11c4d68a9707e219a374b90) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:51.995905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530e7a2-cac3-4b4b-91ce-92a3e410ce30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:51.997544 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530e7a2-cac3-4b4b-91ce-92a3e410ce30 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:52.003729 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 127/251] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:51 2022] GET /identity/v3/role_assignments?user.id=13478df4a11c4d68a9707e219a374b90&scope.project.id=91dff31874af45e2a47062d139da0caf&role.id=223e41cadac841039801dd9dc1416608 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:52.091125 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f14bdf-fd89-41e0-acc4-da5b48a84ff1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:52.129608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61791ebc-df1f-415f-a23f-ddf6b6111222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:52.130694 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61791ebc-df1f-415f-a23f-ddf6b6111222 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:52.131178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61791ebc-df1f-415f-a23f-ddf6b6111222 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:52.131649 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61791ebc-df1f-415f-a23f-ddf6b6111222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:52.147303 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd3fc7-3964-4ff3-b011-d87f35ef2082 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:52.147635 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd3fc7-3964-4ff3-b011-d87f35ef2082 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:52.147866 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd3fc7-3964-4ff3-b011-d87f35ef2082 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:52.149614 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 128/252] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:52.154880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c58407-9dad-4561-87bb-7e9d56ee0dce None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:52.155169 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c58407-9dad-4561-87bb-7e9d56ee0dce None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:52.155440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c58407-9dad-4561-87bb-7e9d56ee0dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:52.206341 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-49c58407-9dad-4561-87bb-7e9d56ee0dce None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:52.207591 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-49c58407-9dad-4561-87bb-7e9d56ee0dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:52.211359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61791ebc-df1f-415f-a23f-ddf6b6111222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:52.213343 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61791ebc-df1f-415f-a23f-ddf6b6111222 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:52.321416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 125/253] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 10:48:52.323240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddfc72-860b-4a94-92d8-be94683ec730 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:52.323735 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddfc72-860b-4a94-92d8-be94683ec730 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:52.328507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddfc72-860b-4a94-92d8-be94683ec730 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:52.328650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 129/254] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:52.330803 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 126/255] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:52.332140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c58407-9dad-4561-87bb-7e9d56ee0dce None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:52.335642 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0d817-34f1-4ef5-bb12-97577bd5ce04 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:52.336207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0d817-34f1-4ef5-bb12-97577bd5ce04 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:52.337473 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0d817-34f1-4ef5-bb12-97577bd5ce04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:52.374703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4ca0d817-34f1-4ef5-bb12-97577bd5ce04 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:52.375364 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4ca0d817-34f1-4ef5-bb12-97577bd5ce04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:52.440951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c58407-9dad-4561-87bb-7e9d56ee0dce None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:52.475147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 127/256] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:52.476721 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0d817-34f1-4ef5-bb12-97577bd5ce04 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:52.512757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996d57f-6de2-425e-ab48-0b22dc4db2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:52.513656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996d57f-6de2-425e-ab48-0b22dc4db2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:52.513937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996d57f-6de2-425e-ab48-0b22dc4db2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:52.514211 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996d57f-6de2-425e-ab48-0b22dc4db2f1 None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:52.516372 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996d57f-6de2-425e-ab48-0b22dc4db2f1 None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:52.517892 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996d57f-6de2-425e-ab48-0b22dc4db2f1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:52.519603 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 130/257] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:52 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:52.522995 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996d57f-6de2-425e-ab48-0b22dc4db2f1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:52.661838 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0d817-34f1-4ef5-bb12-97577bd5ce04 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:52.677238 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996d57f-6de2-425e-ab48-0b22dc4db2f1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:52.719544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a512-49fd-456a-851e-86ffabcaae25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:52.720345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a512-49fd-456a-851e-86ffabcaae25 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:52.720623 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a512-49fd-456a-851e-86ffabcaae25 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:52.720891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a512-49fd-456a-851e-86ffabcaae25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:52.733831 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64a512-49fd-456a-851e-86ffabcaae25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:52.741107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-af64a512-49fd-456a-851e-86ffabcaae25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:48:52.742461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 128/258] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:52.743237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a512-49fd-456a-851e-86ffabcaae25 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:52.748116 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf577eb-99eb-48e3-b095-3ffdb575a29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:52.748944 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf577eb-99eb-48e3-b095-3ffdb575a29e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:52.749259 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf577eb-99eb-48e3-b095-3ffdb575a29e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:52.750310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf577eb-99eb-48e3-b095-3ffdb575a29e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:52.781990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf577eb-99eb-48e3-b095-3ffdb575a29e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:52.793765 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-aaf577eb-99eb-48e3-b095-3ffdb575a29e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 10:48:52.795011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 131/259] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:48:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:52.795790 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf577eb-99eb-48e3-b095-3ffdb575a29e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:52.844892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a512-49fd-456a-851e-86ffabcaae25 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:52.878606 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ab3ba-d229-4355-879e-5c0b191fd676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:52.879269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ab3ba-d229-4355-879e-5c0b191fd676 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:52.879552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ab3ba-d229-4355-879e-5c0b191fd676 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:52.879826 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ab3ba-d229-4355-879e-5c0b191fd676 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:52.880662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ab3ba-d229-4355-879e-5c0b191fd676 None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=91dff31874af45e2a47062d139da0caf, user.id=1deca318db1b40339b0bfb1f95d8a63f) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:52.880973 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ab3ba-d229-4355-879e-5c0b191fd676 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:52.884645 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ab3ba-d229-4355-879e-5c0b191fd676 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:52.890858 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 129/260] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:52 2022] GET /identity/v3/role_assignments?user.id=1deca318db1b40339b0bfb1f95d8a63f&scope.project.id=91dff31874af45e2a47062d139da0caf&role.id=090ba4d1ae32495289276665920d4a2c => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:52.891576 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ab3ba-d229-4355-879e-5c0b191fd676 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:52.996458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ab3ba-d229-4355-879e-5c0b191fd676 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:53.014014 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf577eb-99eb-48e3-b095-3ffdb575a29e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:53.046223 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e154cd-578c-4238-a2f6-cec70a71dc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:53.046907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e154cd-578c-4238-a2f6-cec70a71dc13 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:53.047190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e154cd-578c-4238-a2f6-cec70a71dc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:53.047464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e154cd-578c-4238-a2f6-cec70a71dc13 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:53.048221 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e154cd-578c-4238-a2f6-cec70a71dc13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:53.048529 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e154cd-578c-4238-a2f6-cec70a71dc13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:53.049966 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e154cd-578c-4238-a2f6-cec70a71dc13 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:53.068142 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 130/261] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:48:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:53.075598 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e154cd-578c-4238-a2f6-cec70a71dc13 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:53.081183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f6cc0-852d-4ec7-8773-5c67233beb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:53.081867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f6cc0-852d-4ec7-8773-5c67233beb13 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:53.084797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f6cc0-852d-4ec7-8773-5c67233beb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:53.085159 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f6cc0-852d-4ec7-8773-5c67233beb13 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:53.088117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f6cc0-852d-4ec7-8773-5c67233beb13 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:53.088440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f6cc0-852d-4ec7-8773-5c67233beb13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:53.092423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f6cc0-852d-4ec7-8773-5c67233beb13 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:53.108763 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 132/262] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:53.115425 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f6cc0-852d-4ec7-8773-5c67233beb13 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:53.283847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f6cc0-852d-4ec7-8773-5c67233beb13 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:53.284855 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e154cd-578c-4238-a2f6-cec70a71dc13 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:53.323934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad577ef4-f5e5-43eb-8ad4-7e5bacb010b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:53.324835 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad577ef4-f5e5-43eb-8ad4-7e5bacb010b3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:53.325195 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad577ef4-f5e5-43eb-8ad4-7e5bacb010b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:53.325471 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad577ef4-f5e5-43eb-8ad4-7e5bacb010b3 None admin] PATH_INFO: `/v3/users/347317648695408abcb4c063e782a898` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:53.326761 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad577ef4-f5e5-43eb-8ad4-7e5bacb010b3 None admin] RBAC: Authorizing `identity:get_user(user_id=347317648695408abcb4c063e782a898)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:53.328281 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad577ef4-f5e5-43eb-8ad4-7e5bacb010b3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:53.330519 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 133/263] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:53 2022] GET /identity/v3/users/347317648695408abcb4c063e782a898 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:53.338181 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad577ef4-f5e5-43eb-8ad4-7e5bacb010b3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:53.357446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381a5cc-5bf4-47b8-bb22-97be66a1180c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:53.358339 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381a5cc-5bf4-47b8-bb22-97be66a1180c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:53.358617 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381a5cc-5bf4-47b8-bb22-97be66a1180c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:53.358885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381a5cc-5bf4-47b8-bb22-97be66a1180c None admin] PATH_INFO: `/v3/users/1deca318db1b40339b0bfb1f95d8a63f` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:53.361710 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381a5cc-5bf4-47b8-bb22-97be66a1180c None admin] RBAC: Authorizing `identity:get_user(user_id=1deca318db1b40339b0bfb1f95d8a63f)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:53.363163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381a5cc-5bf4-47b8-bb22-97be66a1180c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:53.364978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 131/264] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:53 2022] GET /identity/v3/users/1deca318db1b40339b0bfb1f95d8a63f => generated 283 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:53.372413 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381a5cc-5bf4-47b8-bb22-97be66a1180c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:53.514261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381a5cc-5bf4-47b8-bb22-97be66a1180c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:53.541418 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad577ef4-f5e5-43eb-8ad4-7e5bacb010b3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:53.556552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f06398-b0fe-45e5-8f15-c93a171f9ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:53.557237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f06398-b0fe-45e5-8f15-c93a171f9ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:53.557518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f06398-b0fe-45e5-8f15-c93a171f9ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:53.557792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f06398-b0fe-45e5-8f15-c93a171f9ec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:53.614288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e6078-0e41-46b7-92b6-ab3873b9bd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:53.615374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6078-0e41-46b7-92b6-ab3873b9bd8c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:53.615652 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6078-0e41-46b7-92b6-ab3873b9bd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:53.615927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6078-0e41-46b7-92b6-ab3873b9bd8c None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:53.619553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e6078-0e41-46b7-92b6-ab3873b9bd8c None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:53.621046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e6078-0e41-46b7-92b6-ab3873b9bd8c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:53.623173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 134/265] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:53 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:53.641085 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e6078-0e41-46b7-92b6-ab3873b9bd8c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:53.665504 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f06398-b0fe-45e5-8f15-c93a171f9ec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:53.666961 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f06398-b0fe-45e5-8f15-c93a171f9ec1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:53.763916 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 132/266] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 10:48:53.770767 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f06398-b0fe-45e5-8f15-c93a171f9ec1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:53.806571 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e6078-0e41-46b7-92b6-ab3873b9bd8c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:53.870374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92607923-1022-4d81-954f-3ff78929e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:53.871263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92607923-1022-4d81-954f-3ff78929e2e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:53.871543 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92607923-1022-4d81-954f-3ff78929e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:53.871812 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92607923-1022-4d81-954f-3ff78929e2e8 None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf/users/347317648695408abcb4c063e782a898/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:53.875245 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92607923-1022-4d81-954f-3ff78929e2e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=91dff31874af45e2a47062d139da0caf, user_id=347317648695408abcb4c063e782a898, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:53.876728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92607923-1022-4d81-954f-3ff78929e2e8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:53.913808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f06398-b0fe-45e5-8f15-c93a171f9ec1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:53.957508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be1332-5765-42ac-ba2c-6f144fa21296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:53.958398 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1332-5765-42ac-ba2c-6f144fa21296 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:53.958675 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1332-5765-42ac-ba2c-6f144fa21296 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:53.958949 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1332-5765-42ac-ba2c-6f144fa21296 None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:53.960196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be1332-5765-42ac-ba2c-6f144fa21296 None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:53.960314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 135/267] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:48:53 2022] PUT /identity/v3/projects/91dff31874af45e2a47062d139da0caf/users/347317648695408abcb4c063e782a898/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:48:53.962534 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be1332-5765-42ac-ba2c-6f144fa21296 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:53.967124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 133/268] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:53 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:53.973791 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92607923-1022-4d81-954f-3ff78929e2e8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:54.119450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92607923-1022-4d81-954f-3ff78929e2e8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:54.173897 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5f05-40dc-40ca-9093-6c18cc12bd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:54.174579 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5f05-40dc-40ca-9093-6c18cc12bd87 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:54.174892 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5f05-40dc-40ca-9093-6c18cc12bd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:54.175215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5f05-40dc-40ca-9093-6c18cc12bd87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:54.175950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb5f05-40dc-40ca-9093-6c18cc12bd87 None admin] RBAC: Adding query filter params (role.id=ed823413bca240af87bbf99994bcd0f8, scope.project.id=91dff31874af45e2a47062d139da0caf, user.id=1deca318db1b40339b0bfb1f95d8a63f) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:54.176258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb5f05-40dc-40ca-9093-6c18cc12bd87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:54.177778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb5f05-40dc-40ca-9093-6c18cc12bd87 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:54.184352 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 136/269] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:53 2022] GET /identity/v3/role_assignments?user.id=1deca318db1b40339b0bfb1f95d8a63f&scope.project.id=91dff31874af45e2a47062d139da0caf&role.id=ed823413bca240af87bbf99994bcd0f8 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:54.782214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c1c2-0f92-4da4-92a1-e0fd9878e404 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:54.782733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c1c2-0f92-4da4-92a1-e0fd9878e404 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:54.782817 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c1c2-0f92-4da4-92a1-e0fd9878e404 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:54.784411 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 134/270] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:54.789827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c88a6-2dce-4575-9e9b-4b9e9a478f91 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:54.790268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c88a6-2dce-4575-9e9b-4b9e9a478f91 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:54.790591 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c88a6-2dce-4575-9e9b-4b9e9a478f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:54.811259 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4c8c88a6-2dce-4575-9e9b-4b9e9a478f91 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:54.812715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4c8c88a6-2dce-4575-9e9b-4b9e9a478f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:54.872053 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbff79-a431-49b3-9a9a-f8ec477e5bbd None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:54.872357 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbff79-a431-49b3-9a9a-f8ec477e5bbd None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:54.872615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbff79-a431-49b3-9a9a-f8ec477e5bbd None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:54.875814 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 135/271] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:54.880065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b168-ea56-4d54-a602-3084857b5aa2 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:54.880356 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b168-ea56-4d54-a602-3084857b5aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:54.880637 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b168-ea56-4d54-a602-3084857b5aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:54.890924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 137/272] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:54.903776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-fac4b168-ea56-4d54-a602-3084857b5aa2 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:54.904979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fac4b168-ea56-4d54-a602-3084857b5aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:54.913087 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c88a6-2dce-4575-9e9b-4b9e9a478f91 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:54.974738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 136/273] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:48:54.975899 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09c1de-0de2-4178-900c-96e8878b6617 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:54.976221 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09c1de-0de2-4178-900c-96e8878b6617 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:54.976493 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09c1de-0de2-4178-900c-96e8878b6617 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:54.977772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 137/274] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:54.982958 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aec69-4e4e-4336-aacb-7369acd9ca43 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:54.983332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aec69-4e4e-4336-aacb-7369acd9ca43 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:54.983784 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aec69-4e4e-4336-aacb-7369acd9ca43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:55.000594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a43aec69-4e4e-4336-aacb-7369acd9ca43 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:55.001797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a43aec69-4e4e-4336-aacb-7369acd9ca43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:55.026591 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c88a6-2dce-4575-9e9b-4b9e9a478f91 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:55.061753 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242eec9-f3b6-4eca-8e55-792518ecf6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:55.062827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242eec9-f3b6-4eca-8e55-792518ecf6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:55.063110 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242eec9-f3b6-4eca-8e55-792518ecf6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:55.063380 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242eec9-f3b6-4eca-8e55-792518ecf6a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:55.066774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 138/275] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:55.070644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aec69-4e4e-4336-aacb-7369acd9ca43 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:55.073872 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242eec9-f3b6-4eca-8e55-792518ecf6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:55.080930 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-7242eec9-f3b6-4eca-8e55-792518ecf6a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 10:48:55.082181 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 138/276] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:48:55.088435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242eec9-f3b6-4eca-8e55-792518ecf6a1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:55.170615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aec69-4e4e-4336-aacb-7369acd9ca43 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:55.190465 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242eec9-f3b6-4eca-8e55-792518ecf6a1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:55.205758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42956405-0571-42eb-a51e-257443cd8a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:55.206558 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42956405-0571-42eb-a51e-257443cd8a16 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:55.206841 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42956405-0571-42eb-a51e-257443cd8a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:55.207113 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42956405-0571-42eb-a51e-257443cd8a16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:55.217662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42956405-0571-42eb-a51e-257443cd8a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:55.224409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223c15b-f756-4252-8f51-a929d32d11bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:55.224663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-42956405-0571-42eb-a51e-257443cd8a16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:48:55.225159 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223c15b-f756-4252-8f51-a929d32d11bb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:55.225384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223c15b-f756-4252-8f51-a929d32d11bb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:55.225659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223c15b-f756-4252-8f51-a929d32d11bb None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:55.230474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 139/277] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:55.230600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223c15b-f756-4252-8f51-a929d32d11bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:55.230600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223c15b-f756-4252-8f51-a929d32d11bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:55.230752 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42956405-0571-42eb-a51e-257443cd8a16 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:55.230821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223c15b-f756-4252-8f51-a929d32d11bb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:55.241111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 139/278] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:55.241111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223c15b-f756-4252-8f51-a929d32d11bb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:55.322761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42956405-0571-42eb-a51e-257443cd8a16 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:55.344266 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223c15b-f756-4252-8f51-a929d32d11bb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:55.357296 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a34f0-32c3-4820-8632-c653c39544e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:55.358099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a34f0-32c3-4820-8632-c653c39544e9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:55.358381 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a34f0-32c3-4820-8632-c653c39544e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:55.358657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a34f0-32c3-4820-8632-c653c39544e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:55.359831 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a34f0-32c3-4820-8632-c653c39544e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:55.361317 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a34f0-32c3-4820-8632-c653c39544e9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:55.363127 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 140/279] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:55.363709 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a34f0-32c3-4820-8632-c653c39544e9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:55.380884 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e512e-c194-44ed-bbe0-cd93f89f3ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:55.381573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e512e-c194-44ed-bbe0-cd93f89f3ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:55.381849 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e512e-c194-44ed-bbe0-cd93f89f3ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:55.382118 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e512e-c194-44ed-bbe0-cd93f89f3ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:55.383372 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e512e-c194-44ed-bbe0-cd93f89f3ae7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:55.383671 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e512e-c194-44ed-bbe0-cd93f89f3ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:55.385097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e512e-c194-44ed-bbe0-cd93f89f3ae7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:55.393124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 140/280] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:55.394178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e512e-c194-44ed-bbe0-cd93f89f3ae7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:55.468155 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a34f0-32c3-4820-8632-c653c39544e9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:55.491022 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e512e-c194-44ed-bbe0-cd93f89f3ae7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:55.499758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cd87b-afa2-491c-9147-1001eeeae983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:55.500624 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cd87b-afa2-491c-9147-1001eeeae983 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:55.500899 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cd87b-afa2-491c-9147-1001eeeae983 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:55.501195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cd87b-afa2-491c-9147-1001eeeae983 None admin] PATH_INFO: `/v3/users/13478df4a11c4d68a9707e219a374b90` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:55.502468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cd87b-afa2-491c-9147-1001eeeae983 None admin] RBAC: Authorizing `identity:get_user(user_id=13478df4a11c4d68a9707e219a374b90)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:55.503995 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cd87b-afa2-491c-9147-1001eeeae983 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:55.505942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 141/281] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:55 2022] GET /identity/v3/users/13478df4a11c4d68a9707e219a374b90 => generated 297 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:55.506553 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cd87b-afa2-491c-9147-1001eeeae983 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:55.528628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e0c71-ac73-4e61-b9fa-654c926e15c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:55.529592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e0c71-ac73-4e61-b9fa-654c926e15c4 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:55.529877 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e0c71-ac73-4e61-b9fa-654c926e15c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:55.530147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e0c71-ac73-4e61-b9fa-654c926e15c4 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:55.531007 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e0c71-ac73-4e61-b9fa-654c926e15c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:55.533014 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e0c71-ac73-4e61-b9fa-654c926e15c4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:55.601157 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cd87b-afa2-491c-9147-1001eeeae983 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:55.633224 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24e8e0-5268-422b-82c2-aa14b1305956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:55.634111 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24e8e0-5268-422b-82c2-aa14b1305956 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:55.634418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24e8e0-5268-422b-82c2-aa14b1305956 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:55.634689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24e8e0-5268-422b-82c2-aa14b1305956 None admin] PATH_INFO: `/v3/users/2b06efc0e71348b988253d9223a4a230` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:55.647240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24e8e0-5268-422b-82c2-aa14b1305956 None admin] RBAC: Authorizing `identity:get_user(user_id=2b06efc0e71348b988253d9223a4a230)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:55.649244 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24e8e0-5268-422b-82c2-aa14b1305956 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:55.651585 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 142/282] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:55 2022] GET /identity/v3/users/2b06efc0e71348b988253d9223a4a230 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:55.652406 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24e8e0-5268-422b-82c2-aa14b1305956 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:55.660350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 141/283] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:48:55 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:48:55.661516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e0c71-ac73-4e61-b9fa-654c926e15c4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:55.783212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e0c71-ac73-4e61-b9fa-654c926e15c4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:55.797125 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24e8e0-5268-422b-82c2-aa14b1305956 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:55.820480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f806173-756e-4765-a5eb-e0c0f7a88898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:55.821191 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f806173-756e-4765-a5eb-e0c0f7a88898 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:55.821476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f806173-756e-4765-a5eb-e0c0f7a88898 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:55.821756 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f806173-756e-4765-a5eb-e0c0f7a88898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:55.822606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f806173-756e-4765-a5eb-e0c0f7a88898 None admin] RBAC: Adding query filter params (role.id=519c87ee2e424f1d81ce0c136c4b2d25, user.id=2b06efc0e71348b988253d9223a4a230, scope.system=all) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:55.822924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f806173-756e-4765-a5eb-e0c0f7a88898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:55.824435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f806173-756e-4765-a5eb-e0c0f7a88898 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:55.830031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 142/284] 10.222.0.62 () {56 vars in 1308 bytes} [Wed Apr 6 10:48:55 2022] GET /identity/v3/role_assignments?user.id=2b06efc0e71348b988253d9223a4a230&scope.system=all&role.id=519c87ee2e424f1d81ce0c136c4b2d25 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:55.834368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77da7ec-6908-465d-8ff9-2904cea8b325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:55.835272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77da7ec-6908-465d-8ff9-2904cea8b325 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:55.836073 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77da7ec-6908-465d-8ff9-2904cea8b325 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:55.836351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77da7ec-6908-465d-8ff9-2904cea8b325 None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:55.837954 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77da7ec-6908-465d-8ff9-2904cea8b325 None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:55.839444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77da7ec-6908-465d-8ff9-2904cea8b325 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:55.841374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 143/285] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:55 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:55.847398 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f806173-756e-4765-a5eb-e0c0f7a88898 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:55.965013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f806173-756e-4765-a5eb-e0c0f7a88898 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:56.003479 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a6f6c-6628-43b9-b2e6-65b46384cc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:56.004411 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a6f6c-6628-43b9-b2e6-65b46384cc81 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:56.004686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a6f6c-6628-43b9-b2e6-65b46384cc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:56.004955 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a6f6c-6628-43b9-b2e6-65b46384cc81 None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf/users/13478df4a11c4d68a9707e219a374b90/roles/223e41cadac841039801dd9dc1416608` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:56.007073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a6f6c-6628-43b9-b2e6-65b46384cc81 None admin] RBAC: Authorizing `identity:create_grant(project_id=91dff31874af45e2a47062d139da0caf, user_id=13478df4a11c4d68a9707e219a374b90, role_id=223e41cadac841039801dd9dc1416608)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:56.009137 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a6f6c-6628-43b9-b2e6-65b46384cc81 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:56.082842 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 143/286] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:48:55 2022] PUT /identity/v3/projects/91dff31874af45e2a47062d139da0caf/users/13478df4a11c4d68a9707e219a374b90/roles/223e41cadac841039801dd9dc1416608 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:48:56.602174 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fec9e-d750-4913-8006-e3e56c34bf63 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:56.602825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fec9e-d750-4913-8006-e3e56c34bf63 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:56.603348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fec9e-d750-4913-8006-e3e56c34bf63 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:56.605173 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 144/287] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:56.610767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cff70-af3e-4d8e-a23d-e01ad73b6fed None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:56.611292 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cff70-af3e-4d8e-a23d-e01ad73b6fed None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:56.611789 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cff70-af3e-4d8e-a23d-e01ad73b6fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:56.629526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-665cff70-af3e-4d8e-a23d-e01ad73b6fed None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:56.631040 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-665cff70-af3e-4d8e-a23d-e01ad73b6fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:56.713212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 144/288] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:48:56.748707 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fec9e-d750-4913-8006-e3e56c34bf63 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:56.872764 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fec9e-d750-4913-8006-e3e56c34bf63 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:56.907672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68776771-59a2-45d3-9a9c-2a6c427b84c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:56.908878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68776771-59a2-45d3-9a9c-2a6c427b84c8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:56.909409 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68776771-59a2-45d3-9a9c-2a6c427b84c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:56.909882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68776771-59a2-45d3-9a9c-2a6c427b84c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:56.920966 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68776771-59a2-45d3-9a9c-2a6c427b84c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:56.928355 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-68776771-59a2-45d3-9a9c-2a6c427b84c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:48:56.930352 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 145/289] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:56.936410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cff70-af3e-4d8e-a23d-e01ad73b6fed None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:57.047868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cff70-af3e-4d8e-a23d-e01ad73b6fed None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:57.088564 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab2855-f052-44b5-908f-1f85d0c686b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:57.089276 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab2855-f052-44b5-908f-1f85d0c686b3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:57.089563 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab2855-f052-44b5-908f-1f85d0c686b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:57.089839 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab2855-f052-44b5-908f-1f85d0c686b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:57.090600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab2855-f052-44b5-908f-1f85d0c686b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:57.090906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab2855-f052-44b5-908f-1f85d0c686b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:57.092339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab2855-f052-44b5-908f-1f85d0c686b3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:57.101428 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 145/290] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:57.106844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68776771-59a2-45d3-9a9c-2a6c427b84c8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:57.237822 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68776771-59a2-45d3-9a9c-2a6c427b84c8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:57.274721 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d1063-bec8-4007-aa04-96db12e815fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:57.275877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d1063-bec8-4007-aa04-96db12e815fb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:57.276307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d1063-bec8-4007-aa04-96db12e815fb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:57.276729 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d1063-bec8-4007-aa04-96db12e815fb None admin] PATH_INFO: `/v3/users/347317648695408abcb4c063e782a898` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:57.278109 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d1063-bec8-4007-aa04-96db12e815fb None admin] RBAC: Authorizing `identity:get_user(user_id=347317648695408abcb4c063e782a898)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:57.279721 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d1063-bec8-4007-aa04-96db12e815fb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:57.281831 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 146/291] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:57 2022] GET /identity/v3/users/347317648695408abcb4c063e782a898 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:57.290400 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab2855-f052-44b5-908f-1f85d0c686b3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:57.417344 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab2855-f052-44b5-908f-1f85d0c686b3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:57.465908 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07597a74-5f00-46ed-87d6-c41a0a4fe71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:57.466824 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07597a74-5f00-46ed-87d6-c41a0a4fe71b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:57.467252 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07597a74-5f00-46ed-87d6-c41a0a4fe71b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:57.467670 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07597a74-5f00-46ed-87d6-c41a0a4fe71b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:57.559029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07597a74-5f00-46ed-87d6-c41a0a4fe71b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:57.560752 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07597a74-5f00-46ed-87d6-c41a0a4fe71b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:57.682050 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 146/292] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:48:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:48:57.687921 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d1063-bec8-4007-aa04-96db12e815fb None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:57.827265 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d1063-bec8-4007-aa04-96db12e815fb None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:57.874640 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9d7b5-7917-4735-a475-ea54462f94e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:57.876303 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9d7b5-7917-4735-a475-ea54462f94e0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:57.876779 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9d7b5-7917-4735-a475-ea54462f94e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:57.877267 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9d7b5-7917-4735-a475-ea54462f94e0 None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:57.881763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9d7b5-7917-4735-a475-ea54462f94e0 None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:57.883430 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9d7b5-7917-4735-a475-ea54462f94e0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:57.885375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 147/293] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:48:57 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:57.891477 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07597a74-5f00-46ed-87d6-c41a0a4fe71b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:58.034478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07597a74-5f00-46ed-87d6-c41a0a4fe71b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:58.082880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3a64f-083e-4693-a4e7-6321125b7ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:58.083460 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3a64f-083e-4693-a4e7-6321125b7ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:58.083744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3a64f-083e-4693-a4e7-6321125b7ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:58.084021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3a64f-083e-4693-a4e7-6321125b7ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:58.084858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3a64f-083e-4693-a4e7-6321125b7ca6 None admin] RBAC: Adding query filter params (role.id=519c87ee2e424f1d81ce0c136c4b2d25, scope.project.id=91dff31874af45e2a47062d139da0caf, user.id=347317648695408abcb4c063e782a898) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:58.085209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3a64f-083e-4693-a4e7-6321125b7ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:58.087294 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3a64f-083e-4693-a4e7-6321125b7ca6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:58.097894 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 147/294] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:48:57 2022] GET /identity/v3/role_assignments?user.id=347317648695408abcb4c063e782a898&scope.project.id=91dff31874af45e2a47062d139da0caf&role.id=519c87ee2e424f1d81ce0c136c4b2d25 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:58.421169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad98ca-17ad-4e91-a041-056aeb1dc98e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:58.421501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad98ca-17ad-4e91-a041-056aeb1dc98e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:58.421682 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad98ca-17ad-4e91-a041-056aeb1dc98e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:58.423394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 148/295] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:58.428887 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e6ec4-4f42-49ac-9d52-091350dc0bd9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:58.429497 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e6ec4-4f42-49ac-9d52-091350dc0bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:58.429976 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e6ec4-4f42-49ac-9d52-091350dc0bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:58.447517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c35e6ec4-4f42-49ac-9d52-091350dc0bd9 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:58.449017 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c35e6ec4-4f42-49ac-9d52-091350dc0bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:58.522763 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 148/296] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:58.543269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad98ca-17ad-4e91-a041-056aeb1dc98e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:58.669751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad98ca-17ad-4e91-a041-056aeb1dc98e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:58.707986 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acb794-193d-4333-8e66-4c6b1e9320f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:58.708798 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acb794-193d-4333-8e66-4c6b1e9320f7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:58.709099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acb794-193d-4333-8e66-4c6b1e9320f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:58.709381 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acb794-193d-4333-8e66-4c6b1e9320f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:58.719471 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f22e-7578-48b4-b419-c226a43ea7ee None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:58.720053 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f22e-7578-48b4-b419-c226a43ea7ee None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:58.720565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f22e-7578-48b4-b419-c226a43ea7ee None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:58.721318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acb794-193d-4333-8e66-4c6b1e9320f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:58.722489 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 149/297] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:58.728239 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7842d-c1fe-4f1f-8bd0-e074e10d35ff None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:58.728707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7842d-c1fe-4f1f-8bd0-e074e10d35ff None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:58.729178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7842d-c1fe-4f1f-8bd0-e074e10d35ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:58.729834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-c1acb794-193d-4333-8e66-4c6b1e9320f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:48:58.731483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 149/298] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:58.737521 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acb794-193d-4333-8e66-4c6b1e9320f7 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:58.753481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0bc7842d-c1fe-4f1f-8bd0-e074e10d35ff None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:58.755300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0bc7842d-c1fe-4f1f-8bd0-e074e10d35ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:58.853184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 150/299] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:58.862671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acb794-193d-4333-8e66-4c6b1e9320f7 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:58.876234 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7842d-c1fe-4f1f-8bd0-e074e10d35ff None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:58.902481 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6ff6e-6d4a-45ec-b449-5ca1a6d181cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:58.903210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6ff6e-6d4a-45ec-b449-5ca1a6d181cf None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:58.903827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6ff6e-6d4a-45ec-b449-5ca1a6d181cf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:58.904117 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6ff6e-6d4a-45ec-b449-5ca1a6d181cf None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:58.905165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6ff6e-6d4a-45ec-b449-5ca1a6d181cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:58.905480 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6ff6e-6d4a-45ec-b449-5ca1a6d181cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:58.907380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6ff6e-6d4a-45ec-b449-5ca1a6d181cf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:58.918442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 150/300] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:58.926489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6ff6e-6d4a-45ec-b449-5ca1a6d181cf None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:58.986967 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7842d-c1fe-4f1f-8bd0-e074e10d35ff None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:59.024336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695796bc-ea6e-4637-958f-f311a1999640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:59.025432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695796bc-ea6e-4637-958f-f311a1999640 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:59.025865 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695796bc-ea6e-4637-958f-f311a1999640 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:59.026288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695796bc-ea6e-4637-958f-f311a1999640 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:59.027604 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695796bc-ea6e-4637-958f-f311a1999640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:59.029120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695796bc-ea6e-4637-958f-f311a1999640 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:59.031207 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 151/301] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:48:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:59.032369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6ff6e-6d4a-45ec-b449-5ca1a6d181cf None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:59.032679 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0e799-bbcf-4503-a797-188677f2967d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:59.033123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0e799-bbcf-4503-a797-188677f2967d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:59.033532 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0e799-bbcf-4503-a797-188677f2967d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:59.034898 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 152/302] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:59.036167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0e799-bbcf-4503-a797-188677f2967d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:59.069423 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0dee5-245e-4853-b56d-39bf00c368b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:59.070836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0dee5-245e-4853-b56d-39bf00c368b5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:59.071116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0dee5-245e-4853-b56d-39bf00c368b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:59.071552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0dee5-245e-4853-b56d-39bf00c368b5 None admin] PATH_INFO: `/v3/users/2b06efc0e71348b988253d9223a4a230` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:59.072754 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0dee5-245e-4853-b56d-39bf00c368b5 None admin] RBAC: Authorizing `identity:get_user(user_id=2b06efc0e71348b988253d9223a4a230)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:59.074233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0dee5-245e-4853-b56d-39bf00c368b5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:59.080546 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 151/303] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:58 2022] GET /identity/v3/users/2b06efc0e71348b988253d9223a4a230 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:59.080546 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c7064-d807-41e4-bbc0-670b806d8203 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:59.080546 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c7064-d807-41e4-bbc0-670b806d8203 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:59.080546 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c7064-d807-41e4-bbc0-670b806d8203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:59.094353 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-8c2c7064-d807-41e4-bbc0-670b806d8203 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:59.095560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8c2c7064-d807-41e4-bbc0-670b806d8203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:59.139801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0e799-bbcf-4503-a797-188677f2967d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:59.175214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d55fdd-65eb-45b7-a291-82fcea8069ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:59.175888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d55fdd-65eb-45b7-a291-82fcea8069ca None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:59.176166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d55fdd-65eb-45b7-a291-82fcea8069ca None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:59.176437 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d55fdd-65eb-45b7-a291-82fcea8069ca None admin] PATH_INFO: `/v3/groups` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:59.177221 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d55fdd-65eb-45b7-a291-82fcea8069ca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:59.178676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d55fdd-65eb-45b7-a291-82fcea8069ca None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:59.230474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 153/304] 10.222.0.62 () {60 vars in 1134 bytes} [Wed Apr 6 10:48:59 2022] POST /identity/v3/groups => generated 229 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:48:59.231293 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d55fdd-65eb-45b7-a291-82fcea8069ca None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:59.278061 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 152/305] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:48:59.279750 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58defb6-1606-4921-be9d-e4dd797ea1f2 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:59.280041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58defb6-1606-4921-be9d-e4dd797ea1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:59.280315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58defb6-1606-4921-be9d-e4dd797ea1f2 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:59.281788 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 153/306] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:48:59.287596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc67642-ddc4-4623-ad03-6ed84d19a756 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:59.287967 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc67642-ddc4-4623-ad03-6ed84d19a756 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:59.288136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc67642-ddc4-4623-ad03-6ed84d19a756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:59.306534 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-ebc67642-ddc4-4623-ad03-6ed84d19a756 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:48:59.307759 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ebc67642-ddc4-4623-ad03-6ed84d19a756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:48:59.351504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d55fdd-65eb-45b7-a291-82fcea8069ca None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:59.376465 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 154/307] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:48:59.377166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc67642-ddc4-4623-ad03-6ed84d19a756 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:59.405685 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1598d7-e69b-4f50-b38a-825f8e32f1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:59.406545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1598d7-e69b-4f50-b38a-825f8e32f1d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:59.406826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1598d7-e69b-4f50-b38a-825f8e32f1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:59.407095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1598d7-e69b-4f50-b38a-825f8e32f1d7 None admin] PATH_INFO: `/v3/system/users/2b06efc0e71348b988253d9223a4a230/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:59.408557 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1598d7-e69b-4f50-b38a-825f8e32f1d7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2b06efc0e71348b988253d9223a4a230, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:59.410608 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1598d7-e69b-4f50-b38a-825f8e32f1d7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:59.465417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 154/308] 10.222.0.62 () {58 vars in 1334 bytes} [Wed Apr 6 10:48:59 2022] PUT /identity/v3/system/users/2b06efc0e71348b988253d9223a4a230/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:48:59.466708 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1598d7-e69b-4f50-b38a-825f8e32f1d7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:59.486900 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc67642-ddc4-4623-ad03-6ed84d19a756 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:59.525713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93942f2-8ed5-41d6-b7bf-dc8ce9d994e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:59.526529 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93942f2-8ed5-41d6-b7bf-dc8ce9d994e5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:59.526811 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93942f2-8ed5-41d6-b7bf-dc8ce9d994e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:59.527092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93942f2-8ed5-41d6-b7bf-dc8ce9d994e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:59.538941 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93942f2-8ed5-41d6-b7bf-dc8ce9d994e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:59.546574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-e93942f2-8ed5-41d6-b7bf-dc8ce9d994e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 10:48:59.548232 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 155/309] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:59.554869 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93942f2-8ed5-41d6-b7bf-dc8ce9d994e5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:59.580023 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1598d7-e69b-4f50-b38a-825f8e32f1d7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:59.617034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e64f3-55c0-472c-a450-120cf45a2045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:59.618216 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e64f3-55c0-472c-a450-120cf45a2045 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:59.618679 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e64f3-55c0-472c-a450-120cf45a2045 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:59.619131 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e64f3-55c0-472c-a450-120cf45a2045 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:59.630949 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e64f3-55c0-472c-a450-120cf45a2045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:48:59.638527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-d83e64f3-55c0-472c-a450-120cf45a2045 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 10:48:59.640580 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 155/310] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:48:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:48:59.649084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e64f3-55c0-472c-a450-120cf45a2045 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:59.666197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93942f2-8ed5-41d6-b7bf-dc8ce9d994e5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:59.713886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccef452-fc74-4163-891b-d26d7e77ffeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:59.714596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccef452-fc74-4163-891b-d26d7e77ffeb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:59.715379 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccef452-fc74-4163-891b-d26d7e77ffeb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:59.715895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccef452-fc74-4163-891b-d26d7e77ffeb None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:59.717676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccef452-fc74-4163-891b-d26d7e77ffeb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:59.718433 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccef452-fc74-4163-891b-d26d7e77ffeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:59.720464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccef452-fc74-4163-891b-d26d7e77ffeb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:59.733496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 156/311] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:59.739020 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccef452-fc74-4163-891b-d26d7e77ffeb None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:59.769350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e64f3-55c0-472c-a450-120cf45a2045 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:59.804075 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9277856-14ff-4cc0-9a91-50c9d05ef552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:59.804774 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9277856-14ff-4cc0-9a91-50c9d05ef552 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:59.805069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9277856-14ff-4cc0-9a91-50c9d05ef552 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:59.805615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9277856-14ff-4cc0-9a91-50c9d05ef552 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:59.806105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9277856-14ff-4cc0-9a91-50c9d05ef552 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:48:59.806414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9277856-14ff-4cc0-9a91-50c9d05ef552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:59.807831 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9277856-14ff-4cc0-9a91-50c9d05ef552 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:59.816867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 156/312] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:48:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:48:59.822721 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9277856-14ff-4cc0-9a91-50c9d05ef552 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:59.885043 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccef452-fc74-4163-891b-d26d7e77ffeb None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:48:59.918601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd4a0e-97ce-45f8-ae13-9ecb235c1b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:48:59.919478 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd4a0e-97ce-45f8-ae13-9ecb235c1b21 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:48:59.919814 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd4a0e-97ce-45f8-ae13-9ecb235c1b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:48:59.920686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd4a0e-97ce-45f8-ae13-9ecb235c1b21 None admin] PATH_INFO: `/v3/users/5f2b2fb718cf40b29fd9c90887e5df53` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:48:59.934005 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd4a0e-97ce-45f8-ae13-9ecb235c1b21 None admin] RBAC: Authorizing `identity:get_user(user_id=5f2b2fb718cf40b29fd9c90887e5df53)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:48:59.935697 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd4a0e-97ce-45f8-ae13-9ecb235c1b21 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:48:59.937888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 157/313] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:59 2022] GET /identity/v3/users/5f2b2fb718cf40b29fd9c90887e5df53 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:48:59.944197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd4a0e-97ce-45f8-ae13-9ecb235c1b21 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:48:59.957650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9277856-14ff-4cc0-9a91-50c9d05ef552 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:00.000168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c62c3-55ef-4cfa-8846-d0296a02d109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:00.001356 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c62c3-55ef-4cfa-8846-d0296a02d109 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:00.002295 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c62c3-55ef-4cfa-8846-d0296a02d109 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:00.002755 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c62c3-55ef-4cfa-8846-d0296a02d109 None admin] PATH_INFO: `/v3/users/13478df4a11c4d68a9707e219a374b90` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:00.004555 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c62c3-55ef-4cfa-8846-d0296a02d109 None admin] RBAC: Authorizing `identity:get_user(user_id=13478df4a11c4d68a9707e219a374b90)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:00.006880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c62c3-55ef-4cfa-8846-d0296a02d109 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:00.010000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 157/314] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:48:59 2022] GET /identity/v3/users/13478df4a11c4d68a9707e219a374b90 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:00.016143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c62c3-55ef-4cfa-8846-d0296a02d109 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:00.064225 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd4a0e-97ce-45f8-ae13-9ecb235c1b21 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:00.106910 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc4f1a-246c-482f-9232-0c7fe97149bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:00.107896 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc4f1a-246c-482f-9232-0c7fe97149bd None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:00.108359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc4f1a-246c-482f-9232-0c7fe97149bd None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:00.108842 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc4f1a-246c-482f-9232-0c7fe97149bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:00.109906 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc4f1a-246c-482f-9232-0c7fe97149bd None admin] RBAC: Adding query filter params (role.id=223e41cadac841039801dd9dc1416608, user.id=5f2b2fb718cf40b29fd9c90887e5df53, scope.system=all) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:00.110408 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc4f1a-246c-482f-9232-0c7fe97149bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:00.112068 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc4f1a-246c-482f-9232-0c7fe97149bd None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:00.119199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 158/315] 10.222.0.62 () {56 vars in 1308 bytes} [Wed Apr 6 10:48:59 2022] GET /identity/v3/role_assignments?user.id=5f2b2fb718cf40b29fd9c90887e5df53&scope.system=all&role.id=223e41cadac841039801dd9dc1416608 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:00.252657 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c62c3-55ef-4cfa-8846-d0296a02d109 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:00.293253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9605d8-8e76-4989-98e8-dcb790ce44f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:00.294362 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9605d8-8e76-4989-98e8-dcb790ce44f1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:00.294836 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9605d8-8e76-4989-98e8-dcb790ce44f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:00.295291 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9605d8-8e76-4989-98e8-dcb790ce44f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:00.366416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9605d8-8e76-4989-98e8-dcb790ce44f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:00.368002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9605d8-8e76-4989-98e8-dcb790ce44f1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:00.472960 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 158/316] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:00.478858 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc4f1a-246c-482f-9232-0c7fe97149bd None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:00.578751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc4f1a-246c-482f-9232-0c7fe97149bd None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:00.615880 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11ea6e-0077-444c-9b1d-276679ebe7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:00.616773 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ea6e-0077-444c-9b1d-276679ebe7bb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:00.617074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ea6e-0077-444c-9b1d-276679ebe7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:00.617348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ea6e-0077-444c-9b1d-276679ebe7bb None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:00.618808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11ea6e-0077-444c-9b1d-276679ebe7bb None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:00.620235 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11ea6e-0077-444c-9b1d-276679ebe7bb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:00.622129 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 159/317] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:00 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:00.627875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9605d8-8e76-4989-98e8-dcb790ce44f1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:00.733510 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9605d8-8e76-4989-98e8-dcb790ce44f1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:00.767371 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157de6c-e511-48ce-a885-9dcb2e33c554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:00.768030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157de6c-e511-48ce-a885-9dcb2e33c554 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:00.768309 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157de6c-e511-48ce-a885-9dcb2e33c554 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:00.768584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157de6c-e511-48ce-a885-9dcb2e33c554 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:00.769436 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157de6c-e511-48ce-a885-9dcb2e33c554 None admin] RBAC: Adding query filter params (role.id=223e41cadac841039801dd9dc1416608, scope.project.id=91dff31874af45e2a47062d139da0caf, user.id=13478df4a11c4d68a9707e219a374b90) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:00.769751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157de6c-e511-48ce-a885-9dcb2e33c554 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:00.771297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157de6c-e511-48ce-a885-9dcb2e33c554 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:00.783800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 159/318] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:49:00 2022] GET /identity/v3/role_assignments?user.id=13478df4a11c4d68a9707e219a374b90&scope.project.id=91dff31874af45e2a47062d139da0caf&role.id=223e41cadac841039801dd9dc1416608 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:01.605322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce46c1-0bab-4c45-ad79-4c0504893378 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:01.605868 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce46c1-0bab-4c45-ad79-4c0504893378 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:01.605868 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce46c1-0bab-4c45-ad79-4c0504893378 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:01.607432 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 160/319] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:01.612297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449ec51-e7b2-4b6c-ac6e-d3b06e8d1314 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:01.612673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449ec51-e7b2-4b6c-ac6e-d3b06e8d1314 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:01.612849 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449ec51-e7b2-4b6c-ac6e-d3b06e8d1314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:01.629098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f449ec51-e7b2-4b6c-ac6e-d3b06e8d1314 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:01.630288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f449ec51-e7b2-4b6c-ac6e-d3b06e8d1314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:01.696287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 160/320] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:01.720678 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce46c1-0bab-4c45-ad79-4c0504893378 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:01.819611 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce46c1-0bab-4c45-ad79-4c0504893378 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:01.852564 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654f6a7-6201-4d07-945d-4cad8c2bef68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:01.853391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654f6a7-6201-4d07-945d-4cad8c2bef68 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:01.853674 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654f6a7-6201-4d07-945d-4cad8c2bef68 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:01.853946 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654f6a7-6201-4d07-945d-4cad8c2bef68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:01.855113 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654f6a7-6201-4d07-945d-4cad8c2bef68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:01.856599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654f6a7-6201-4d07-945d-4cad8c2bef68 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:01.858464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 161/321] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:01.863723 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449ec51-e7b2-4b6c-ac6e-d3b06e8d1314 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:01.894428 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c4ef-9a31-4b0a-bb2a-fef9e6e51ae9 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:01.894750 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c4ef-9a31-4b0a-bb2a-fef9e6e51ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:01.894991 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c4ef-9a31-4b0a-bb2a-fef9e6e51ae9 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:01.896352 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 162/322] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:49:01.902145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216c1c0-4bf5-4ac9-8836-7d6d400529b1 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:01.902424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216c1c0-4bf5-4ac9-8836-7d6d400529b1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:01.902744 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216c1c0-4bf5-4ac9-8836-7d6d400529b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:01.920128 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5216c1c0-4bf5-4ac9-8836-7d6d400529b1 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:01.921331 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5216c1c0-4bf5-4ac9-8836-7d6d400529b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:01.969771 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449ec51-e7b2-4b6c-ac6e-d3b06e8d1314 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:01.986987 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 163/323] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:49:02.003466 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78de6f5-d9e5-4d1b-8403-a3b5ab5825d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:02.004140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78de6f5-d9e5-4d1b-8403-a3b5ab5825d9 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:02.004422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78de6f5-d9e5-4d1b-8403-a3b5ab5825d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:02.004698 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78de6f5-d9e5-4d1b-8403-a3b5ab5825d9 None admin] PATH_INFO: `/v3/groups` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:02.005480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78de6f5-d9e5-4d1b-8403-a3b5ab5825d9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:02.007009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78de6f5-d9e5-4d1b-8403-a3b5ab5825d9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:02.011777 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216c1c0-4bf5-4ac9-8836-7d6d400529b1 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:02.113184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 161/324] 10.222.0.62 () {60 vars in 1134 bytes} [Wed Apr 6 10:49:01 2022] POST /identity/v3/groups => generated 226 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:49:02.123332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216c1c0-4bf5-4ac9-8836-7d6d400529b1 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:02.160175 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c28520-edf4-4f9c-8835-f023268ddf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:02.160999 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c28520-edf4-4f9c-8835-f023268ddf39 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:02.161311 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c28520-edf4-4f9c-8835-f023268ddf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:02.161637 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c28520-edf4-4f9c-8835-f023268ddf39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:02.174234 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c28520-edf4-4f9c-8835-f023268ddf39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:02.182569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-39c28520-edf4-4f9c-8835-f023268ddf39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:49:02.189637 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 164/325] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:02.190756 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78de6f5-d9e5-4d1b-8403-a3b5ab5825d9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:02.294192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78de6f5-d9e5-4d1b-8403-a3b5ab5825d9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:02.327790 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669b270-2b79-4696-829b-f2722443c11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:02.328464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669b270-2b79-4696-829b-f2722443c11e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:02.328749 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669b270-2b79-4696-829b-f2722443c11e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:02.329021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669b270-2b79-4696-829b-f2722443c11e None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:02.329802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669b270-2b79-4696-829b-f2722443c11e None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:02.330109 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669b270-2b79-4696-829b-f2722443c11e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:02.331516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669b270-2b79-4696-829b-f2722443c11e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:02.340965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 162/326] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:49:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:02.346444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c28520-edf4-4f9c-8835-f023268ddf39 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:02.452033 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c28520-edf4-4f9c-8835-f023268ddf39 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:02.485260 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127ed71-a527-4119-80dc-100f91be9d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:02.486636 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127ed71-a527-4119-80dc-100f91be9d22 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:02.487167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127ed71-a527-4119-80dc-100f91be9d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:02.487635 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127ed71-a527-4119-80dc-100f91be9d22 None admin] PATH_INFO: `/v3/users/2b06efc0e71348b988253d9223a4a230` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:02.487739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a4079-3cdc-4504-a7fe-0dadb2ce21f2 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:02.487987 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a4079-3cdc-4504-a7fe-0dadb2ce21f2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:02.488265 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a4079-3cdc-4504-a7fe-0dadb2ce21f2 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:02.489666 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 163/327] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:49:02.489775 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127ed71-a527-4119-80dc-100f91be9d22 None admin] RBAC: Authorizing `identity:get_user(user_id=2b06efc0e71348b988253d9223a4a230)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:02.491484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127ed71-a527-4119-80dc-100f91be9d22 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:02.494201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 165/328] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:49:02 2022] GET /identity/v3/users/2b06efc0e71348b988253d9223a4a230 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:02.495347 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5239fd-6776-4235-9fab-711aa7eff3fd None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:02.495639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5239fd-6776-4235-9fab-711aa7eff3fd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:02.495917 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5239fd-6776-4235-9fab-711aa7eff3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:02.499612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127ed71-a527-4119-80dc-100f91be9d22 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:02.518243 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ae5239fd-6776-4235-9fab-711aa7eff3fd None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:02.519443 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ae5239fd-6776-4235-9fab-711aa7eff3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:02.608055 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 164/329] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:49:02.615064 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127ed71-a527-4119-80dc-100f91be9d22 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:02.633152 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5239fd-6776-4235-9fab-711aa7eff3fd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:02.651474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0f4b9-3c4c-4815-a396-fea2026f6fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:02.652467 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0f4b9-3c4c-4815-a396-fea2026f6fca None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:02.652970 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0f4b9-3c4c-4815-a396-fea2026f6fca None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:02.653473 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0f4b9-3c4c-4815-a396-fea2026f6fca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:02.654502 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0f4b9-3c4c-4815-a396-fea2026f6fca None admin] RBAC: Adding query filter params (role.id=519c87ee2e424f1d81ce0c136c4b2d25, user.id=2b06efc0e71348b988253d9223a4a230, scope.system=all) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:02.655014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0f4b9-3c4c-4815-a396-fea2026f6fca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:02.656637 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0f4b9-3c4c-4815-a396-fea2026f6fca None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:02.669761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 166/330] 10.222.0.62 () {56 vars in 1308 bytes} [Wed Apr 6 10:49:02 2022] GET /identity/v3/role_assignments?user.id=2b06efc0e71348b988253d9223a4a230&scope.system=all&role.id=519c87ee2e424f1d81ce0c136c4b2d25 => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:02.762227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5239fd-6776-4235-9fab-711aa7eff3fd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:02.808899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe5231-8c5a-496f-827c-ac27ae7a02e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:02.809831 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe5231-8c5a-496f-827c-ac27ae7a02e2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:02.810118 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe5231-8c5a-496f-827c-ac27ae7a02e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:02.810398 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe5231-8c5a-496f-827c-ac27ae7a02e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:02.824385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe5231-8c5a-496f-827c-ac27ae7a02e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:02.831745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-e4fe5231-8c5a-496f-827c-ac27ae7a02e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 10:49:02.833500 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 165/331] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:02.839577 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0f4b9-3c4c-4815-a396-fea2026f6fca None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:02.949378 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0f4b9-3c4c-4815-a396-fea2026f6fca None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:02.984841 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d060637-5209-43f2-980f-6271a0822231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:02.985572 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d060637-5209-43f2-980f-6271a0822231 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:02.985859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d060637-5209-43f2-980f-6271a0822231 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:02.986139 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d060637-5209-43f2-980f-6271a0822231 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:02.986891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d060637-5209-43f2-980f-6271a0822231 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:02.987199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d060637-5209-43f2-980f-6271a0822231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:02.988570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d060637-5209-43f2-980f-6271a0822231 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:02.998086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 167/332] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:49:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:03.004769 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe5231-8c5a-496f-827c-ac27ae7a02e2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:03.117438 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe5231-8c5a-496f-827c-ac27ae7a02e2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:03.156331 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9c4e4-9cd0-4ee2-bc40-15f2d977b2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:03.157245 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9c4e4-9cd0-4ee2-bc40-15f2d977b2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:03.157528 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9c4e4-9cd0-4ee2-bc40-15f2d977b2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:03.157798 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9c4e4-9cd0-4ee2-bc40-15f2d977b2a3 None admin] PATH_INFO: `/v3/users/5f2b2fb718cf40b29fd9c90887e5df53` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:03.160435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9c4e4-9cd0-4ee2-bc40-15f2d977b2a3 None admin] RBAC: Authorizing `identity:get_user(user_id=5f2b2fb718cf40b29fd9c90887e5df53)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:03.161959 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9c4e4-9cd0-4ee2-bc40-15f2d977b2a3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:03.163946 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 166/333] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:49:03 2022] GET /identity/v3/users/5f2b2fb718cf40b29fd9c90887e5df53 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:03.169666 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d060637-5209-43f2-980f-6271a0822231 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:03.296262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d060637-5209-43f2-980f-6271a0822231 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:03.331592 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e4ae-174f-4b7c-9695-76a7be988f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:03.332822 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e4ae-174f-4b7c-9695-76a7be988f8a None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:03.333343 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e4ae-174f-4b7c-9695-76a7be988f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:03.333850 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e4ae-174f-4b7c-9695-76a7be988f8a None admin] PATH_INFO: `/v3/system/users/5f2b2fb718cf40b29fd9c90887e5df53/roles/223e41cadac841039801dd9dc1416608` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:03.336079 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4e4ae-174f-4b7c-9695-76a7be988f8a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5f2b2fb718cf40b29fd9c90887e5df53, role_id=223e41cadac841039801dd9dc1416608)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:03.337770 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4e4ae-174f-4b7c-9695-76a7be988f8a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:03.426304 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 168/334] 10.222.0.62 () {58 vars in 1334 bytes} [Wed Apr 6 10:49:03 2022] PUT /identity/v3/system/users/5f2b2fb718cf40b29fd9c90887e5df53/roles/223e41cadac841039801dd9dc1416608 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:49:05.117449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4227b-9a43-473e-ab3a-dad7c444046a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:05.118054 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4227b-9a43-473e-ab3a-dad7c444046a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:05.118054 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4227b-9a43-473e-ab3a-dad7c444046a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:05.119350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 167/335] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:05.124695 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593670b-f7de-4bbd-a47f-2fdc46f09f9d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:05.125133 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593670b-f7de-4bbd-a47f-2fdc46f09f9d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:05.125306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593670b-f7de-4bbd-a47f-2fdc46f09f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:05.142600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a593670b-f7de-4bbd-a47f-2fdc46f09f9d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:05.143787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a593670b-f7de-4bbd-a47f-2fdc46f09f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:05.193982 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed976f-e497-4256-b3a1-915a926baef8 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:05.194628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed976f-e497-4256-b3a1-915a926baef8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:05.195647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed976f-e497-4256-b3a1-915a926baef8 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:05.200168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 168/336] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:05.204218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c5d3a-29f3-4d55-a5a4-1bf8335ffbcd None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:05.204740 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c5d3a-29f3-4d55-a5a4-1bf8335ffbcd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:05.205387 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c5d3a-29f3-4d55-a5a4-1bf8335ffbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:05.238046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1a3c5d3a-29f3-4d55-a5a4-1bf8335ffbcd None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:05.239624 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1a3c5d3a-29f3-4d55-a5a4-1bf8335ffbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:05.243722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 169/337] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:05.287820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593670b-f7de-4bbd-a47f-2fdc46f09f9d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:05.353391 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 169/338] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:05.401122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c5d3a-29f3-4d55-a5a4-1bf8335ffbcd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:05.444238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593670b-f7de-4bbd-a47f-2fdc46f09f9d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:05.517008 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2272cb-a71d-4539-8d6c-ed1d043bea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:05.517830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2272cb-a71d-4539-8d6c-ed1d043bea02 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:05.518105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2272cb-a71d-4539-8d6c-ed1d043bea02 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:05.518369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2272cb-a71d-4539-8d6c-ed1d043bea02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:05.540200 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2272cb-a71d-4539-8d6c-ed1d043bea02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:05.560033 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-ad2272cb-a71d-4539-8d6c-ed1d043bea02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:49:05.561314 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 170/339] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:05.568361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2272cb-a71d-4539-8d6c-ed1d043bea02 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:05.619163 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c5d3a-29f3-4d55-a5a4-1bf8335ffbcd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:05.696435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f4ff7-2074-4ec5-8451-fe1f85db9740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:05.697282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4ff7-2074-4ec5-8451-fe1f85db9740 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:05.697557 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4ff7-2074-4ec5-8451-fe1f85db9740 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:05.697826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4ff7-2074-4ec5-8451-fe1f85db9740 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:05.725671 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f4ff7-2074-4ec5-8451-fe1f85db9740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:05.733154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-8d1f4ff7-2074-4ec5-8451-fe1f85db9740 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 10:49:05.734700 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 170/340] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:49:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:05.745821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f4ff7-2074-4ec5-8451-fe1f85db9740 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:05.772882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2272cb-a71d-4539-8d6c-ed1d043bea02 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:05.853912 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c5915-3109-48ff-9513-0c1712a98954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:05.854616 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c5915-3109-48ff-9513-0c1712a98954 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:05.854904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c5915-3109-48ff-9513-0c1712a98954 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:05.855181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c5915-3109-48ff-9513-0c1712a98954 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:05.855946 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c5915-3109-48ff-9513-0c1712a98954 None admin] RBAC: Adding query filter params (name=member) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:05.856272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c5915-3109-48ff-9513-0c1712a98954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:05.857766 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c5915-3109-48ff-9513-0c1712a98954 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:05.871310 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 171/341] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:49:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:05.877957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c5915-3109-48ff-9513-0c1712a98954 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:05.980074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f4ff7-2074-4ec5-8451-fe1f85db9740 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:06.070960 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cf521-83c0-4c53-94ad-f330660c05f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:06.071643 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cf521-83c0-4c53-94ad-f330660c05f3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:06.071919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cf521-83c0-4c53-94ad-f330660c05f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:06.072187 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cf521-83c0-4c53-94ad-f330660c05f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:06.072988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cf521-83c0-4c53-94ad-f330660c05f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:06.073374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cf521-83c0-4c53-94ad-f330660c05f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:06.075018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cf521-83c0-4c53-94ad-f330660c05f3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:06.090966 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 171/342] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:06.098081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c5915-3109-48ff-9513-0c1712a98954 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:06.100536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cf521-83c0-4c53-94ad-f330660c05f3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:06.144352 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbf9d7-1586-4d97-851f-186a5a570d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:06.145080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbf9d7-1586-4d97-851f-186a5a570d89 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:06.145530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbf9d7-1586-4d97-851f-186a5a570d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:06.145980 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbf9d7-1586-4d97-851f-186a5a570d89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:06.222689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbf9d7-1586-4d97-851f-186a5a570d89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:06.224450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbf9d7-1586-4d97-851f-186a5a570d89 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:06.237187 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cf521-83c0-4c53-94ad-f330660c05f3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:06.279573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a5822-9e70-4945-b8ca-3369959a67f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:06.280615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a5822-9e70-4945-b8ca-3369959a67f4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:06.281152 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a5822-9e70-4945-b8ca-3369959a67f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:06.281580 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a5822-9e70-4945-b8ca-3369959a67f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:06.331995 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 172/343] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 10:49:06.338468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbf9d7-1586-4d97-851f-186a5a570d89 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:06.380963 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a5822-9e70-4945-b8ca-3369959a67f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:06.383310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a5822-9e70-4945-b8ca-3369959a67f4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:06.571892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbf9d7-1586-4d97-851f-186a5a570d89 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:06.580267 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 172/344] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:06.588571 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a5822-9e70-4945-b8ca-3369959a67f4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:06.649559 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23d364-7256-43cc-b91b-54d3b8e7ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:06.650748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23d364-7256-43cc-b91b-54d3b8e7ab03 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:06.651178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23d364-7256-43cc-b91b-54d3b8e7ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:06.651610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23d364-7256-43cc-b91b-54d3b8e7ab03 None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:06.653046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23d364-7256-43cc-b91b-54d3b8e7ab03 None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:06.654676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23d364-7256-43cc-b91b-54d3b8e7ab03 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:06.659015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 173/345] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:06 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:06.663342 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23d364-7256-43cc-b91b-54d3b8e7ab03 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:06.712031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a5822-9e70-4945-b8ca-3369959a67f4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:06.758359 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713be6a-bd32-4e2d-9d68-9e063eb9e659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:06.759285 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713be6a-bd32-4e2d-9d68-9e063eb9e659 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:06.759564 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713be6a-bd32-4e2d-9d68-9e063eb9e659 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:06.759833 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713be6a-bd32-4e2d-9d68-9e063eb9e659 None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:06.761034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713be6a-bd32-4e2d-9d68-9e063eb9e659 None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:06.762534 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713be6a-bd32-4e2d-9d68-9e063eb9e659 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:06.764239 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 173/346] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:06 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:06.773525 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713be6a-bd32-4e2d-9d68-9e063eb9e659 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:06.829518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23d364-7256-43cc-b91b-54d3b8e7ab03 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:06.878146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df3a1a-aaf0-46aa-9493-9f9391628c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:06.879317 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3a1a-aaf0-46aa-9493-9f9391628c92 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:06.879598 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3a1a-aaf0-46aa-9493-9f9391628c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:06.879873 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3a1a-aaf0-46aa-9493-9f9391628c92 None admin] PATH_INFO: `/v3/groups/b82f704150eb4069984f96c28a9c7eac` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:06.880700 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713be6a-bd32-4e2d-9d68-9e063eb9e659 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:06.889134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df3a1a-aaf0-46aa-9493-9f9391628c92 None admin] RBAC: Authorizing `identity:get_group(group_id=b82f704150eb4069984f96c28a9c7eac)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:06.891212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df3a1a-aaf0-46aa-9493-9f9391628c92 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:06.894178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 174/347] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:06 2022] GET /identity/v3/groups/b82f704150eb4069984f96c28a9c7eac => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:06.895953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32c3e2-6a80-4804-981f-947a71475f73 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:06.896462 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32c3e2-6a80-4804-981f-947a71475f73 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:06.896742 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32c3e2-6a80-4804-981f-947a71475f73 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:06.899572 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 175/348] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:06.901152 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7c31a-c606-4076-b82e-82f3326d756e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:06.901442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7c31a-c606-4076-b82e-82f3326d756e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:06.901718 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7c31a-c606-4076-b82e-82f3326d756e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:06.903340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 176/349] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:06.907659 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7c31a-c606-4076-b82e-82f3326d756e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:06.925870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdff40e-0a8b-4b19-a635-6680d507bb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:06.926781 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff40e-0a8b-4b19-a635-6680d507bb32 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:06.927057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff40e-0a8b-4b19-a635-6680d507bb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:06.927384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff40e-0a8b-4b19-a635-6680d507bb32 None admin] PATH_INFO: `/v3/groups/b82f704150eb4069984f96c28a9c7eac` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:06.928545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdff40e-0a8b-4b19-a635-6680d507bb32 None admin] RBAC: Authorizing `identity:get_group(group_id=b82f704150eb4069984f96c28a9c7eac)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:06.930264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdff40e-0a8b-4b19-a635-6680d507bb32 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:06.932305 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 174/350] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:06 2022] GET /identity/v3/groups/b82f704150eb4069984f96c28a9c7eac => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:06.933566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cf4cc-14e1-4de1-8fe7-035c934db782 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:06.933846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cf4cc-14e1-4de1-8fe7-035c934db782 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:06.934118 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cf4cc-14e1-4de1-8fe7-035c934db782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:06.953205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-931cf4cc-14e1-4de1-8fe7-035c934db782 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:06.954387 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-931cf4cc-14e1-4de1-8fe7-035c934db782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:07.024328 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 175/351] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:07.025811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de95d3c-4e7a-45ba-b4f2-d17ee72aa860 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:07.026097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de95d3c-4e7a-45ba-b4f2-d17ee72aa860 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:07.026376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de95d3c-4e7a-45ba-b4f2-d17ee72aa860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:07.029662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7c31a-c606-4076-b82e-82f3326d756e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:07.043826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8de95d3c-4e7a-45ba-b4f2-d17ee72aa860 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:07.045014 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8de95d3c-4e7a-45ba-b4f2-d17ee72aa860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:07.074423 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e410fda-ddf9-4fbe-8475-98eb258f5b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:07.075088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410fda-ddf9-4fbe-8475-98eb258f5b95 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:07.075370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410fda-ddf9-4fbe-8475-98eb258f5b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:07.075641 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410fda-ddf9-4fbe-8475-98eb258f5b95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:07.076475 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e410fda-ddf9-4fbe-8475-98eb258f5b95 None admin] RBAC: Adding query filter params (group.id=b82f704150eb4069984f96c28a9c7eac, role.id=519c87ee2e424f1d81ce0c136c4b2d25, scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:07.076785 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e410fda-ddf9-4fbe-8475-98eb258f5b95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:07.078270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e410fda-ddf9-4fbe-8475-98eb258f5b95 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:07.084819 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 177/352] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Apr 6 10:49:06 2022] GET /identity/v3/role_assignments?group.id=b82f704150eb4069984f96c28a9c7eac&scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5&role.id=519c87ee2e424f1d81ce0c136c4b2d25 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:07.085805 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e410fda-ddf9-4fbe-8475-98eb258f5b95 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:07.117881 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 176/353] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:07.119192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de95d3c-4e7a-45ba-b4f2-d17ee72aa860 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:07.214792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e410fda-ddf9-4fbe-8475-98eb258f5b95 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:07.257716 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cc6f1-13b9-4cfc-b4b3-84593280a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:07.258748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cc6f1-13b9-4cfc-b4b3-84593280a331 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:07.259237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cc6f1-13b9-4cfc-b4b3-84593280a331 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:07.259782 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cc6f1-13b9-4cfc-b4b3-84593280a331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:07.260863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cc6f1-13b9-4cfc-b4b3-84593280a331 None admin] RBAC: Adding query filter params (group.id=b82f704150eb4069984f96c28a9c7eac, role.id=ed823413bca240af87bbf99994bcd0f8, scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:07.261389 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de95d3c-4e7a-45ba-b4f2-d17ee72aa860 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:07.262254 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cc6f1-13b9-4cfc-b4b3-84593280a331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:07.263803 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cc6f1-13b9-4cfc-b4b3-84593280a331 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:07.270014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 178/354] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Apr 6 10:49:07 2022] GET /identity/v3/role_assignments?group.id=b82f704150eb4069984f96c28a9c7eac&scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5&role.id=ed823413bca240af87bbf99994bcd0f8 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:07.271087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cc6f1-13b9-4cfc-b4b3-84593280a331 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:07.299559 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ac48a-d71b-42d0-b318-ea07023ecdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:07.300738 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ac48a-d71b-42d0-b318-ea07023ecdda None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:07.301232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ac48a-d71b-42d0-b318-ea07023ecdda None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:07.301690 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ac48a-d71b-42d0-b318-ea07023ecdda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:07.315888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ac48a-d71b-42d0-b318-ea07023ecdda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:07.323641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-4d5ac48a-d71b-42d0-b318-ea07023ecdda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:49:07.325713 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 177/355] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:07.327227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7858a4-b230-4516-b361-ecd98774b018 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:07.327701 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7858a4-b230-4516-b361-ecd98774b018 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:07.328134 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7858a4-b230-4516-b361-ecd98774b018 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:07.333436 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 178/356] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:07.336322 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7858a4-b230-4516-b361-ecd98774b018 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:07.387868 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cc6f1-13b9-4cfc-b4b3-84593280a331 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:07.425886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6809de3-c531-426f-81d1-80a25bba85f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:07.426431 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6809de3-c531-426f-81d1-80a25bba85f4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:07.426714 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6809de3-c531-426f-81d1-80a25bba85f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:07.426988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6809de3-c531-426f-81d1-80a25bba85f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:07.439453 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6809de3-c531-426f-81d1-80a25bba85f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:07.447328 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-d6809de3-c531-426f-81d1-80a25bba85f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 10:49:07.449018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 179/357] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:07.450348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8abce9-72d1-4a0c-acde-804324f55132 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:07.450639 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8abce9-72d1-4a0c-acde-804324f55132 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:07.450917 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8abce9-72d1-4a0c-acde-804324f55132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:07.456471 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7858a4-b230-4516-b361-ecd98774b018 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:07.470421 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-fe8abce9-72d1-4a0c-acde-804324f55132 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:07.471649 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fe8abce9-72d1-4a0c-acde-804324f55132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:07.494610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2664e-0f18-4921-b17d-f82bfa7cad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:07.495684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2664e-0f18-4921-b17d-f82bfa7cad58 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:07.496182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2664e-0f18-4921-b17d-f82bfa7cad58 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:07.496678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2664e-0f18-4921-b17d-f82bfa7cad58 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:07.497702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2664e-0f18-4921-b17d-f82bfa7cad58 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:07.498282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2664e-0f18-4921-b17d-f82bfa7cad58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:07.500091 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2664e-0f18-4921-b17d-f82bfa7cad58 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:07.510272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 179/358] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:49:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:07.512010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916949ef-0446-4c51-b564-8aa3f5f673da None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:07.512584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916949ef-0446-4c51-b564-8aa3f5f673da None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:07.517079 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916949ef-0446-4c51-b564-8aa3f5f673da None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:07.519117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 180/359] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:07.520114 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916949ef-0446-4c51-b564-8aa3f5f673da None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:07.544887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 180/360] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:07.545917 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8abce9-72d1-4a0c-acde-804324f55132 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:07.627010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916949ef-0446-4c51-b564-8aa3f5f673da None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:07.650407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8abce9-72d1-4a0c-acde-804324f55132 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:07.664004 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dc171-7708-4c36-a4f5-7db3a6e5034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:07.665019 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dc171-7708-4c36-a4f5-7db3a6e5034c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:07.665534 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dc171-7708-4c36-a4f5-7db3a6e5034c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:07.666012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dc171-7708-4c36-a4f5-7db3a6e5034c None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:07.666958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44dc171-7708-4c36-a4f5-7db3a6e5034c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:07.667509 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44dc171-7708-4c36-a4f5-7db3a6e5034c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:07.669248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44dc171-7708-4c36-a4f5-7db3a6e5034c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:07.679678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 181/361] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:49:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:07.681373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec5605-c88a-4177-8248-0784ef521c5b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:07.681896 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec5605-c88a-4177-8248-0784ef521c5b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:07.682384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec5605-c88a-4177-8248-0784ef521c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:07.686709 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f7d98-a671-485a-8dfd-e34111dae293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:07.687623 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f7d98-a671-485a-8dfd-e34111dae293 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:07.687907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f7d98-a671-485a-8dfd-e34111dae293 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:07.688182 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f7d98-a671-485a-8dfd-e34111dae293 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:07.702599 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5aec5605-c88a-4177-8248-0784ef521c5b None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:07.704138 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5aec5605-c88a-4177-8248-0784ef521c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:07.757770 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f7d98-a671-485a-8dfd-e34111dae293 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:07.759307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f7d98-a671-485a-8dfd-e34111dae293 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:07.781083 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 182/362] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:07.782320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec5605-c88a-4177-8248-0784ef521c5b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:07.870151 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 181/363] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:07.871147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f7d98-a671-485a-8dfd-e34111dae293 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:07.886187 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec5605-c88a-4177-8248-0784ef521c5b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:07.922510 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd50c95-e9d6-4d6e-bfa1-7be1d2e81749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:07.923709 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd50c95-e9d6-4d6e-bfa1-7be1d2e81749 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:07.924194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd50c95-e9d6-4d6e-bfa1-7be1d2e81749 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:07.924671 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd50c95-e9d6-4d6e-bfa1-7be1d2e81749 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:07.935970 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd50c95-e9d6-4d6e-bfa1-7be1d2e81749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:07.943953 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-4fd50c95-e9d6-4d6e-bfa1-7be1d2e81749 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 10:49:07.946004 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 183/364] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:49:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:07.946992 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd50c95-e9d6-4d6e-bfa1-7be1d2e81749 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:07.970389 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f7d98-a671-485a-8dfd-e34111dae293 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:08.006073 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa891c-e8a6-49a1-a0fb-f27785a37d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:08.006960 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa891c-e8a6-49a1-a0fb-f27785a37d02 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:08.007867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa891c-e8a6-49a1-a0fb-f27785a37d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:08.008045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa891c-e8a6-49a1-a0fb-f27785a37d02 None admin] PATH_INFO: `/v3/users/5f2b2fb718cf40b29fd9c90887e5df53` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:08.009278 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa891c-e8a6-49a1-a0fb-f27785a37d02 None admin] RBAC: Authorizing `identity:get_user(user_id=5f2b2fb718cf40b29fd9c90887e5df53)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:08.010711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa891c-e8a6-49a1-a0fb-f27785a37d02 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:08.012671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 182/365] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:49:07 2022] GET /identity/v3/users/5f2b2fb718cf40b29fd9c90887e5df53 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:08.013536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa891c-e8a6-49a1-a0fb-f27785a37d02 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:08.061268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd50c95-e9d6-4d6e-bfa1-7be1d2e81749 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:08.105674 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b21446-9750-48eb-a23c-c35a78e0f19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:08.106843 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b21446-9750-48eb-a23c-c35a78e0f19f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:08.107355 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b21446-9750-48eb-a23c-c35a78e0f19f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:08.107830 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b21446-9750-48eb-a23c-c35a78e0f19f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:08.122953 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b21446-9750-48eb-a23c-c35a78e0f19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:08.131196 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-e4b21446-9750-48eb-a23c-c35a78e0f19f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:49:08.133421 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 184/366] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:49:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:08.134570 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b21446-9750-48eb-a23c-c35a78e0f19f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:08.158269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa891c-e8a6-49a1-a0fb-f27785a37d02 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:08.203931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b7e07-e7f5-480c-8cb2-7518c2209a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:08.205205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b7e07-e7f5-480c-8cb2-7518c2209a11 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:08.205766 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b7e07-e7f5-480c-8cb2-7518c2209a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:08.206260 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b7e07-e7f5-480c-8cb2-7518c2209a11 None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:08.207735 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b7e07-e7f5-480c-8cb2-7518c2209a11 None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:08.210172 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b7e07-e7f5-480c-8cb2-7518c2209a11 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:08.212505 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 183/367] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:08 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:08.213583 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b7e07-e7f5-480c-8cb2-7518c2209a11 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:08.246420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b21446-9750-48eb-a23c-c35a78e0f19f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:08.280554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150510c-d668-4831-a865-aa8fa5467706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:08.281340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150510c-d668-4831-a865-aa8fa5467706 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:08.281532 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150510c-d668-4831-a865-aa8fa5467706 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:08.281809 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150510c-d668-4831-a865-aa8fa5467706 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:08.282561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150510c-d668-4831-a865-aa8fa5467706 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:08.282904 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150510c-d668-4831-a865-aa8fa5467706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:08.284273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150510c-d668-4831-a865-aa8fa5467706 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:08.294522 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 185/368] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:08.295348 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150510c-d668-4831-a865-aa8fa5467706 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:08.323664 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b7e07-e7f5-480c-8cb2-7518c2209a11 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:08.359396 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4e354-8382-4436-970b-5769e1ca2e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:08.360420 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4e354-8382-4436-970b-5769e1ca2e32 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:08.360915 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4e354-8382-4436-970b-5769e1ca2e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:08.361471 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4e354-8382-4436-970b-5769e1ca2e32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:08.362585 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4e354-8382-4436-970b-5769e1ca2e32 None admin] RBAC: Adding query filter params (role.id=223e41cadac841039801dd9dc1416608, user.id=5f2b2fb718cf40b29fd9c90887e5df53, scope.system=all) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:08.363117 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4e354-8382-4436-970b-5769e1ca2e32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:08.364806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4e354-8382-4436-970b-5769e1ca2e32 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:08.377526 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 184/369] 10.222.0.62 () {56 vars in 1308 bytes} [Wed Apr 6 10:49:08 2022] GET /identity/v3/role_assignments?user.id=5f2b2fb718cf40b29fd9c90887e5df53&scope.system=all&role.id=223e41cadac841039801dd9dc1416608 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:08.378751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4e354-8382-4436-970b-5769e1ca2e32 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:08.402073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150510c-d668-4831-a865-aa8fa5467706 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:08.444126 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbaff0-4c53-42d1-95f6-74e13db04b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:08.445365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbaff0-4c53-42d1-95f6-74e13db04b0a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:08.445660 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbaff0-4c53-42d1-95f6-74e13db04b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:08.445938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbaff0-4c53-42d1-95f6-74e13db04b0a None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:08.446761 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbaff0-4c53-42d1-95f6-74e13db04b0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:08.447074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbaff0-4c53-42d1-95f6-74e13db04b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:08.448538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbaff0-4c53-42d1-95f6-74e13db04b0a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:08.458064 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 186/370] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:08.459054 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbaff0-4c53-42d1-95f6-74e13db04b0a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:08.493146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4e354-8382-4436-970b-5769e1ca2e32 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:08.529878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f382c-b545-47d5-9d39-c8a21518e5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:08.531138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f382c-b545-47d5-9d39-c8a21518e5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:08.531671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f382c-b545-47d5-9d39-c8a21518e5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:08.532161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f382c-b545-47d5-9d39-c8a21518e5f0 None admin] PATH_INFO: `/v3/groups/b82f704150eb4069984f96c28a9c7eac` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:08.533642 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f382c-b545-47d5-9d39-c8a21518e5f0 None admin] RBAC: Authorizing `identity:get_group(group_id=b82f704150eb4069984f96c28a9c7eac)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:08.535370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f382c-b545-47d5-9d39-c8a21518e5f0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:08.537346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 185/371] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:08 2022] GET /identity/v3/groups/b82f704150eb4069984f96c28a9c7eac => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:08.538322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f382c-b545-47d5-9d39-c8a21518e5f0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:08.567307 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbaff0-4c53-42d1-95f6-74e13db04b0a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:08.605828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03c52-1f59-4f1f-901b-910c884c96b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:08.605828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03c52-1f59-4f1f-901b-910c884c96b9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:08.606095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03c52-1f59-4f1f-901b-910c884c96b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:08.606345 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03c52-1f59-4f1f-901b-910c884c96b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:08.648471 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f382c-b545-47d5-9d39-c8a21518e5f0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:08.680448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f03c52-1f59-4f1f-901b-910c884c96b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:08.681983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f03c52-1f59-4f1f-901b-910c884c96b9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:08.685503 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985d5b5-83de-49be-8bc6-8f3e8830351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:08.686446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985d5b5-83de-49be-8bc6-8f3e8830351f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:08.686958 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985d5b5-83de-49be-8bc6-8f3e8830351f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:08.687753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985d5b5-83de-49be-8bc6-8f3e8830351f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:08.762234 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985d5b5-83de-49be-8bc6-8f3e8830351f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:08.764115 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985d5b5-83de-49be-8bc6-8f3e8830351f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:08.794084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 187/372] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:08.795076 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03c52-1f59-4f1f-901b-910c884c96b9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:08.867663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 186/373] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:08.868843 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985d5b5-83de-49be-8bc6-8f3e8830351f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:08.900676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03c52-1f59-4f1f-901b-910c884c96b9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:08.935706 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50ee65-224e-41dd-b32b-061b4d5fb1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:08.936398 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50ee65-224e-41dd-b32b-061b4d5fb1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:08.936678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50ee65-224e-41dd-b32b-061b4d5fb1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:08.936954 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50ee65-224e-41dd-b32b-061b4d5fb1b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:08.938079 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50ee65-224e-41dd-b32b-061b4d5fb1b6 None admin] RBAC: Adding query filter params (group.id=b82f704150eb4069984f96c28a9c7eac, role.id=519c87ee2e424f1d81ce0c136c4b2d25, scope.project.id=91dff31874af45e2a47062d139da0caf) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:08.938388 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50ee65-224e-41dd-b32b-061b4d5fb1b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:08.939859 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50ee65-224e-41dd-b32b-061b4d5fb1b6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:08.947247 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 188/374] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Apr 6 10:49:08 2022] GET /identity/v3/role_assignments?group.id=b82f704150eb4069984f96c28a9c7eac&scope.project.id=91dff31874af45e2a47062d139da0caf&role.id=519c87ee2e424f1d81ce0c136c4b2d25 => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:08.948209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50ee65-224e-41dd-b32b-061b4d5fb1b6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:08.973124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985d5b5-83de-49be-8bc6-8f3e8830351f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:09.010174 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efe01b-7817-40c4-af87-ec5e22164e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:09.011412 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efe01b-7817-40c4-af87-ec5e22164e61 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:09.011898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efe01b-7817-40c4-af87-ec5e22164e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:09.012442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efe01b-7817-40c4-af87-ec5e22164e61 None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:09.014007 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efe01b-7817-40c4-af87-ec5e22164e61 None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:09.015691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efe01b-7817-40c4-af87-ec5e22164e61 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:09.017960 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 187/375] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:08 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:09.023744 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efe01b-7817-40c4-af87-ec5e22164e61 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:09.055693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50ee65-224e-41dd-b32b-061b4d5fb1b6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:09.092415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8bb10-873c-42b4-bbc0-0cc86cec0794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:09.093630 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8bb10-873c-42b4-bbc0-0cc86cec0794 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:09.093915 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8bb10-873c-42b4-bbc0-0cc86cec0794 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:09.094188 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8bb10-873c-42b4-bbc0-0cc86cec0794 None admin] PATH_INFO: `/v3/projects/279d4a89a1294ac096e396e32f9abd36` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:09.095450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8bb10-873c-42b4-bbc0-0cc86cec0794 None admin] RBAC: Authorizing `identity:get_project(project_id=279d4a89a1294ac096e396e32f9abd36)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:09.096931 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8bb10-873c-42b4-bbc0-0cc86cec0794 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:09.099063 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 189/376] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:08 2022] GET /identity/v3/projects/279d4a89a1294ac096e396e32f9abd36 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:09.104676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8bb10-873c-42b4-bbc0-0cc86cec0794 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:09.141243 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efe01b-7817-40c4-af87-ec5e22164e61 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:09.181133 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739caab-27f3-432d-abd6-ab26f0021350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:09.182409 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739caab-27f3-432d-abd6-ab26f0021350 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:09.182873 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739caab-27f3-432d-abd6-ab26f0021350 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:09.183320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739caab-27f3-432d-abd6-ab26f0021350 None admin] PATH_INFO: `/v3/groups/b82f704150eb4069984f96c28a9c7eac` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:09.184724 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739caab-27f3-432d-abd6-ab26f0021350 None admin] RBAC: Authorizing `identity:get_group(group_id=b82f704150eb4069984f96c28a9c7eac)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:09.186463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739caab-27f3-432d-abd6-ab26f0021350 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:09.188855 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 188/377] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:09 2022] GET /identity/v3/groups/b82f704150eb4069984f96c28a9c7eac => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:09.194327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739caab-27f3-432d-abd6-ab26f0021350 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:09.231875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8bb10-873c-42b4-bbc0-0cc86cec0794 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:09.277260 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632f55f-fee8-411d-aad1-49c529e979c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:09.278237 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f55f-fee8-411d-aad1-49c529e979c7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:09.278587 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f55f-fee8-411d-aad1-49c529e979c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:09.278933 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f55f-fee8-411d-aad1-49c529e979c7 None admin] PATH_INFO: `/v3/groups/cffb991eab654a8bab39a0396ff4c21b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:09.287094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632f55f-fee8-411d-aad1-49c529e979c7 None admin] RBAC: Authorizing `identity:get_group(group_id=cffb991eab654a8bab39a0396ff4c21b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:09.288938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632f55f-fee8-411d-aad1-49c529e979c7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:09.291919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 190/378] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:09 2022] GET /identity/v3/groups/cffb991eab654a8bab39a0396ff4c21b => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:09.297361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632f55f-fee8-411d-aad1-49c529e979c7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:09.318193 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739caab-27f3-432d-abd6-ab26f0021350 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:09.377958 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a275b-f842-4db6-a77a-c1d71d952a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:09.379415 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a275b-f842-4db6-a77a-c1d71d952a8e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:09.379917 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a275b-f842-4db6-a77a-c1d71d952a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:09.381031 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a275b-f842-4db6-a77a-c1d71d952a8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:09.382730 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a275b-f842-4db6-a77a-c1d71d952a8e None admin] RBAC: Adding query filter params (group.id=b82f704150eb4069984f96c28a9c7eac, role.id=ed823413bca240af87bbf99994bcd0f8, scope.project.id=91dff31874af45e2a47062d139da0caf) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:09.383964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a275b-f842-4db6-a77a-c1d71d952a8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:09.385809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a275b-f842-4db6-a77a-c1d71d952a8e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:09.396689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 189/379] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Apr 6 10:49:09 2022] GET /identity/v3/role_assignments?group.id=b82f704150eb4069984f96c28a9c7eac&scope.project.id=91dff31874af45e2a47062d139da0caf&role.id=ed823413bca240af87bbf99994bcd0f8 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:09.470761 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632f55f-fee8-411d-aad1-49c529e979c7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:09.518806 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d7f85-a6b4-4268-84e9-d7a9d9a0c687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:09.519846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d7f85-a6b4-4268-84e9-d7a9d9a0c687 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:09.520350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d7f85-a6b4-4268-84e9-d7a9d9a0c687 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:09.520850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d7f85-a6b4-4268-84e9-d7a9d9a0c687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:09.521975 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d7f85-a6b4-4268-84e9-d7a9d9a0c687 None admin] RBAC: Adding query filter params (group.id=cffb991eab654a8bab39a0396ff4c21b, role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=279d4a89a1294ac096e396e32f9abd36) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:09.522522 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d7f85-a6b4-4268-84e9-d7a9d9a0c687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:09.524336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d7f85-a6b4-4268-84e9-d7a9d9a0c687 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:09.534003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 191/380] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Apr 6 10:49:09 2022] GET /identity/v3/role_assignments?group.id=cffb991eab654a8bab39a0396ff4c21b&scope.project.id=279d4a89a1294ac096e396e32f9abd36&role.id=090ba4d1ae32495289276665920d4a2c => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:10.217941 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cd2d2-e713-477d-ad6b-b968768e518f None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:10.218625 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cd2d2-e713-477d-ad6b-b968768e518f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:10.219122 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cd2d2-e713-477d-ad6b-b968768e518f None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:10.220974 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 190/381] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:10.226536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e04c8c-7cef-43d2-917c-3591c810143c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:10.227157 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e04c8c-7cef-43d2-917c-3591c810143c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:10.227648 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e04c8c-7cef-43d2-917c-3591c810143c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:10.250503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-23e04c8c-7cef-43d2-917c-3591c810143c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:10.252005 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-23e04c8c-7cef-43d2-917c-3591c810143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:10.331151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 192/382] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:10.354585 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cd2d2-e713-477d-ad6b-b968768e518f None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:10.389675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9ff86-490e-4daf-b3b3-1aa7207bc7e3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:10.390289 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9ff86-490e-4daf-b3b3-1aa7207bc7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:10.390769 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9ff86-490e-4daf-b3b3-1aa7207bc7e3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:10.392595 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 193/383] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:49:10.399950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37386-42ad-4c36-9bb5-d3f4621c40bf None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:10.400529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37386-42ad-4c36-9bb5-d3f4621c40bf None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:10.401043 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37386-42ad-4c36-9bb5-d3f4621c40bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:10.427562 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-63d37386-42ad-4c36-9bb5-d3f4621c40bf None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:10.431265 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-63d37386-42ad-4c36-9bb5-d3f4621c40bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:10.548219 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cd2d2-e713-477d-ad6b-b968768e518f None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:10.551961 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 194/384] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:49:10.594046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b6eee-bff4-49ad-965a-3db6d4269887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:10.595215 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b6eee-bff4-49ad-965a-3db6d4269887 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:10.595717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b6eee-bff4-49ad-965a-3db6d4269887 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:10.596205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b6eee-bff4-49ad-965a-3db6d4269887 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:10.610476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b6eee-bff4-49ad-965a-3db6d4269887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:10.618489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-1e8b6eee-bff4-49ad-965a-3db6d4269887 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:49:10.620259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 191/385] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:10.625695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d37386-42ad-4c36-9bb5-d3f4621c40bf None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:10.635261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b6eee-bff4-49ad-965a-3db6d4269887 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:10.795129 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d37386-42ad-4c36-9bb5-d3f4621c40bf None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:10.830125 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b6eee-bff4-49ad-965a-3db6d4269887 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:10.866087 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a59eb-7b3d-455d-8cb3-92a99da39c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:10.868139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a59eb-7b3d-455d-8cb3-92a99da39c18 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:10.871691 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a59eb-7b3d-455d-8cb3-92a99da39c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:10.872204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a59eb-7b3d-455d-8cb3-92a99da39c18 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:10.873204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a59eb-7b3d-455d-8cb3-92a99da39c18 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:10.873718 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a59eb-7b3d-455d-8cb3-92a99da39c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:10.875362 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a59eb-7b3d-455d-8cb3-92a99da39c18 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:10.884911 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 195/386] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:49:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:10.894414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a59eb-7b3d-455d-8cb3-92a99da39c18 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:10.911668 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71b576-402f-4d9d-b41c-646ea7f3b89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:10.912508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71b576-402f-4d9d-b41c-646ea7f3b89e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:10.912789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71b576-402f-4d9d-b41c-646ea7f3b89e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:10.913082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71b576-402f-4d9d-b41c-646ea7f3b89e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:10.945583 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71b576-402f-4d9d-b41c-646ea7f3b89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:10.953146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-7f71b576-402f-4d9d-b41c-646ea7f3b89e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 10:49:10.954708 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 192/387] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:49:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:10.960380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71b576-402f-4d9d-b41c-646ea7f3b89e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:11.016862 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a59eb-7b3d-455d-8cb3-92a99da39c18 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:11.058269 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f679f-df7f-4ce0-93c3-82629cc83bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:11.062002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f679f-df7f-4ce0-93c3-82629cc83bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:11.062814 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f679f-df7f-4ce0-93c3-82629cc83bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:11.063318 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f679f-df7f-4ce0-93c3-82629cc83bc4 None admin] PATH_INFO: `/v3/groups/b82f704150eb4069984f96c28a9c7eac` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:11.065475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f679f-df7f-4ce0-93c3-82629cc83bc4 None admin] RBAC: Authorizing `identity:get_group(group_id=b82f704150eb4069984f96c28a9c7eac)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:11.067979 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f679f-df7f-4ce0-93c3-82629cc83bc4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:11.072467 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 196/388] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:10 2022] GET /identity/v3/groups/b82f704150eb4069984f96c28a9c7eac => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:11.078669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f679f-df7f-4ce0-93c3-82629cc83bc4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:11.198249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f679f-df7f-4ce0-93c3-82629cc83bc4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:11.203142 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71b576-402f-4d9d-b41c-646ea7f3b89e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:11.236007 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d5fa0-02bd-4964-80a7-db22257ae11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:11.237294 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d5fa0-02bd-4964-80a7-db22257ae11f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:11.237821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d5fa0-02bd-4964-80a7-db22257ae11f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:11.238299 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d5fa0-02bd-4964-80a7-db22257ae11f None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:11.239697 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d5fa0-02bd-4964-80a7-db22257ae11f None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:11.241547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d5fa0-02bd-4964-80a7-db22257ae11f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:11.244270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 197/389] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:11 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:11.249655 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d5fa0-02bd-4964-80a7-db22257ae11f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:11.259319 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6eecb-bb91-45f7-9f2f-ee2062cbf057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:11.260282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6eecb-bb91-45f7-9f2f-ee2062cbf057 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:11.261296 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6eecb-bb91-45f7-9f2f-ee2062cbf057 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:11.262354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6eecb-bb91-45f7-9f2f-ee2062cbf057 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:11.263329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6eecb-bb91-45f7-9f2f-ee2062cbf057 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:11.265708 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6eecb-bb91-45f7-9f2f-ee2062cbf057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:11.268865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6eecb-bb91-45f7-9f2f-ee2062cbf057 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:11.286346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 193/390] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:11.293881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6eecb-bb91-45f7-9f2f-ee2062cbf057 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:11.388751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d5fa0-02bd-4964-80a7-db22257ae11f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:11.413383 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6eecb-bb91-45f7-9f2f-ee2062cbf057 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:11.424385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e4358-4dd8-467c-a60d-0b956eabe6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:11.425374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e4358-4dd8-467c-a60d-0b956eabe6f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:11.425651 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e4358-4dd8-467c-a60d-0b956eabe6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:11.425926 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e4358-4dd8-467c-a60d-0b956eabe6f1 None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5/groups/b82f704150eb4069984f96c28a9c7eac/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:11.427958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e4358-4dd8-467c-a60d-0b956eabe6f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0acfd6cac5d493e9d1064ecf9357aa5, group_id=b82f704150eb4069984f96c28a9c7eac, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:11.430649 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e4358-4dd8-467c-a60d-0b956eabe6f1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:11.459500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa092d7-491c-4402-a915-77c709d11252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:11.460829 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa092d7-491c-4402-a915-77c709d11252 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:11.461136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa092d7-491c-4402-a915-77c709d11252 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:11.461415 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa092d7-491c-4402-a915-77c709d11252 None admin] PATH_INFO: `/v3/groups/b82f704150eb4069984f96c28a9c7eac` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:11.462767 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa092d7-491c-4402-a915-77c709d11252 None admin] RBAC: Authorizing `identity:get_group(group_id=b82f704150eb4069984f96c28a9c7eac)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:11.464279 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa092d7-491c-4402-a915-77c709d11252 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:11.466422 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 194/391] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:11 2022] GET /identity/v3/groups/b82f704150eb4069984f96c28a9c7eac => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:11.471390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa092d7-491c-4402-a915-77c709d11252 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:11.577271 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 198/392] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Apr 6 10:49:11 2022] PUT /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5/groups/b82f704150eb4069984f96c28a9c7eac/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:49:11.591236 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa092d7-491c-4402-a915-77c709d11252 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:11.638574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f95b8-7307-4bf1-905d-5583fadad5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:11.639877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f95b8-7307-4bf1-905d-5583fadad5fe None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:11.640367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f95b8-7307-4bf1-905d-5583fadad5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:11.640844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f95b8-7307-4bf1-905d-5583fadad5fe None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:11.644994 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f95b8-7307-4bf1-905d-5583fadad5fe None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:11.646830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f95b8-7307-4bf1-905d-5583fadad5fe None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:11.648964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 195/393] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:11 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:11.658524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e4358-4dd8-467c-a60d-0b956eabe6f1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:11.787734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e4358-4dd8-467c-a60d-0b956eabe6f1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:11.835435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbcd37-5b4b-473a-b267-12ebfca1008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:11.836339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbcd37-5b4b-473a-b267-12ebfca1008f None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:11.836623 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbcd37-5b4b-473a-b267-12ebfca1008f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:11.836901 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbcd37-5b4b-473a-b267-12ebfca1008f None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5/groups/b82f704150eb4069984f96c28a9c7eac/roles/ed823413bca240af87bbf99994bcd0f8` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:11.839256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbcd37-5b4b-473a-b267-12ebfca1008f None admin] RBAC: Authorizing `identity:create_grant(project_id=c0acfd6cac5d493e9d1064ecf9357aa5, group_id=b82f704150eb4069984f96c28a9c7eac, role_id=ed823413bca240af87bbf99994bcd0f8)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:11.840746 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbcd37-5b4b-473a-b267-12ebfca1008f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:11.918361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 199/394] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Apr 6 10:49:11 2022] PUT /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5/groups/b82f704150eb4069984f96c28a9c7eac/roles/ed823413bca240af87bbf99994bcd0f8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:49:12.027092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb2971-eca9-4e18-ac6e-6b31e4a2828a None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:12.027092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb2971-eca9-4e18-ac6e-6b31e4a2828a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:12.027092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb2971-eca9-4e18-ac6e-6b31e4a2828a None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:12.027092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 196/395] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:12.033441 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e306dc-08a3-45d0-9781-65624ffc1250 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:12.033886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e306dc-08a3-45d0-9781-65624ffc1250 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:12.034269 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e306dc-08a3-45d0-9781-65624ffc1250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:12.053838 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-33e306dc-08a3-45d0-9781-65624ffc1250 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:12.055038 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-33e306dc-08a3-45d0-9781-65624ffc1250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:12.134284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 200/396] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:12.158649 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb2971-eca9-4e18-ac6e-6b31e4a2828a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:12.270914 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb2971-eca9-4e18-ac6e-6b31e4a2828a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:12.306911 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fbc53-ad4a-4c1e-9e38-29f9bcce0279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:12.307692 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fbc53-ad4a-4c1e-9e38-29f9bcce0279 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:12.307979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fbc53-ad4a-4c1e-9e38-29f9bcce0279 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:12.308256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fbc53-ad4a-4c1e-9e38-29f9bcce0279 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:12.319466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fbc53-ad4a-4c1e-9e38-29f9bcce0279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:12.326845 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-835fbc53-ad4a-4c1e-9e38-29f9bcce0279 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:49:12.332944 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 197/397] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:12.334306 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e306dc-08a3-45d0-9781-65624ffc1250 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:12.437127 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e306dc-08a3-45d0-9781-65624ffc1250 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:12.443708 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3c04c-996e-467b-baea-678b450bd43c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:12.443996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3c04c-996e-467b-baea-678b450bd43c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:12.444273 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3c04c-996e-467b-baea-678b450bd43c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:12.446158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 198/398] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:12.454087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1797845-71e4-402d-8e0a-c42103592cb7 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:12.454523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1797845-71e4-402d-8e0a-c42103592cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:12.454945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1797845-71e4-402d-8e0a-c42103592cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:12.472771 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e1797845-71e4-402d-8e0a-c42103592cb7 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:12.474601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e1797845-71e4-402d-8e0a-c42103592cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:12.485076 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72daf3f-e821-4282-b312-149a783a2391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:12.485076 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72daf3f-e821-4282-b312-149a783a2391 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:12.485076 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72daf3f-e821-4282-b312-149a783a2391 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:12.485076 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72daf3f-e821-4282-b312-149a783a2391 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:12.485456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72daf3f-e821-4282-b312-149a783a2391 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:12.485456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72daf3f-e821-4282-b312-149a783a2391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:12.485456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72daf3f-e821-4282-b312-149a783a2391 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:12.499280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 201/399] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:49:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:12.518091 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72daf3f-e821-4282-b312-149a783a2391 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:12.555125 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 199/400] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:49:12.610281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1797845-71e4-402d-8e0a-c42103592cb7 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:12.691910 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72daf3f-e821-4282-b312-149a783a2391 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:12.742187 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10822e02-461d-4409-89b9-eaad414599db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:12.743061 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10822e02-461d-4409-89b9-eaad414599db None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:12.743497 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10822e02-461d-4409-89b9-eaad414599db None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:12.743776 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10822e02-461d-4409-89b9-eaad414599db None admin] PATH_INFO: `/v3/groups/b82f704150eb4069984f96c28a9c7eac` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:12.747685 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10822e02-461d-4409-89b9-eaad414599db None admin] RBAC: Authorizing `identity:get_group(group_id=b82f704150eb4069984f96c28a9c7eac)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:12.749224 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10822e02-461d-4409-89b9-eaad414599db None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:12.751410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 202/401] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:12 2022] GET /identity/v3/groups/b82f704150eb4069984f96c28a9c7eac => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:12.766267 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10822e02-461d-4409-89b9-eaad414599db None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:12.786039 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1797845-71e4-402d-8e0a-c42103592cb7 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:12.822921 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99c70c-6068-4167-907d-b4ca67b57987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:12.824071 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99c70c-6068-4167-907d-b4ca67b57987 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:12.824355 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99c70c-6068-4167-907d-b4ca67b57987 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:12.824714 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99c70c-6068-4167-907d-b4ca67b57987 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:12.839486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99c70c-6068-4167-907d-b4ca67b57987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:12.848665 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-8f99c70c-6068-4167-907d-b4ca67b57987 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 10:49:12.851396 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 200/402] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:49:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:12.853382 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee96e8-183c-4737-bcfd-12095d9837ae None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:12.853670 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee96e8-183c-4737-bcfd-12095d9837ae None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:12.853951 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee96e8-183c-4737-bcfd-12095d9837ae None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:12.859603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 201/403] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:12.861459 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee96e8-183c-4737-bcfd-12095d9837ae None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:12.879846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10822e02-461d-4409-89b9-eaad414599db None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:12.915306 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c07e6-6fcf-4542-a098-45d879d7cc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:12.916517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c07e6-6fcf-4542-a098-45d879d7cc08 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:12.917019 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c07e6-6fcf-4542-a098-45d879d7cc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:12.917519 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c07e6-6fcf-4542-a098-45d879d7cc08 None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:12.918901 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c07e6-6fcf-4542-a098-45d879d7cc08 None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:12.920618 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c07e6-6fcf-4542-a098-45d879d7cc08 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:12.922872 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 203/404] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:12 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:12.924224 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c890-e3d1-4b5c-827e-8a2ce385172f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:12.924703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c890-e3d1-4b5c-827e-8a2ce385172f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:12.925223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c890-e3d1-4b5c-827e-8a2ce385172f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:12.942310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a6f5c890-e3d1-4b5c-827e-8a2ce385172f None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:12.943820 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a6f5c890-e3d1-4b5c-827e-8a2ce385172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:12.974240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee96e8-183c-4737-bcfd-12095d9837ae None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:13.009713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c92f6d-f04d-4196-8ba0-85aa521c77f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:13.010391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c92f6d-f04d-4196-8ba0-85aa521c77f0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:13.010678 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c92f6d-f04d-4196-8ba0-85aa521c77f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:13.010956 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c92f6d-f04d-4196-8ba0-85aa521c77f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:13.011711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c92f6d-f04d-4196-8ba0-85aa521c77f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:13.012021 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c92f6d-f04d-4196-8ba0-85aa521c77f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:13.012951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 204/405] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:13.013522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c92f6d-f04d-4196-8ba0-85aa521c77f0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:13.014220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c890-e3d1-4b5c-827e-8a2ce385172f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:13.022457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 202/406] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:13.029591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c92f6d-f04d-4196-8ba0-85aa521c77f0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:13.148043 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c92f6d-f04d-4196-8ba0-85aa521c77f0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:13.159015 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c890-e3d1-4b5c-827e-8a2ce385172f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:13.188203 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049732dd-95b3-42c5-9136-89e4edd083f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:13.189092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049732dd-95b3-42c5-9136-89e4edd083f1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:13.189389 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049732dd-95b3-42c5-9136-89e4edd083f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:13.189663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049732dd-95b3-42c5-9136-89e4edd083f1 None admin] PATH_INFO: `/v3/groups/b82f704150eb4069984f96c28a9c7eac` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:13.190857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049732dd-95b3-42c5-9136-89e4edd083f1 None admin] RBAC: Authorizing `identity:get_group(group_id=b82f704150eb4069984f96c28a9c7eac)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:13.192577 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049732dd-95b3-42c5-9136-89e4edd083f1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:13.197221 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 203/407] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:13 2022] GET /identity/v3/groups/b82f704150eb4069984f96c28a9c7eac => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:13.198045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049732dd-95b3-42c5-9136-89e4edd083f1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:13.200503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d30b97-cd7f-4e80-a8db-62577e26d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:13.201372 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d30b97-cd7f-4e80-a8db-62577e26d002 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:13.201651 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d30b97-cd7f-4e80-a8db-62577e26d002 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:13.201925 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d30b97-cd7f-4e80-a8db-62577e26d002 None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf/groups/b82f704150eb4069984f96c28a9c7eac/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:13.206922 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d30b97-cd7f-4e80-a8db-62577e26d002 None admin] RBAC: Authorizing `identity:create_grant(project_id=91dff31874af45e2a47062d139da0caf, group_id=b82f704150eb4069984f96c28a9c7eac, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:13.208303 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d30b97-cd7f-4e80-a8db-62577e26d002 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:13.287763 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 205/408] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Apr 6 10:49:13 2022] PUT /identity/v3/projects/91dff31874af45e2a47062d139da0caf/groups/b82f704150eb4069984f96c28a9c7eac/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:49:13.288981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d30b97-cd7f-4e80-a8db-62577e26d002 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:13.351522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049732dd-95b3-42c5-9136-89e4edd083f1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:13.396340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6cdae-80af-46a9-bc1c-07c67abef167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:13.397253 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6cdae-80af-46a9-bc1c-07c67abef167 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:13.397541 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6cdae-80af-46a9-bc1c-07c67abef167 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:13.397850 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6cdae-80af-46a9-bc1c-07c67abef167 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:13.410049 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6cdae-80af-46a9-bc1c-07c67abef167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:13.419251 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-c8e6cdae-80af-46a9-bc1c-07c67abef167 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:49:13.420904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 204/409] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:49:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:13.428006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6cdae-80af-46a9-bc1c-07c67abef167 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:13.516031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d30b97-cd7f-4e80-a8db-62577e26d002 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:13.569141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdaa58-8598-468f-9d23-0bd9682c2f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:13.569141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdaa58-8598-468f-9d23-0bd9682c2f50 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:13.569989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdaa58-8598-468f-9d23-0bd9682c2f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:13.570276 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdaa58-8598-468f-9d23-0bd9682c2f50 None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:13.571514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babdaa58-8598-468f-9d23-0bd9682c2f50 None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:13.573481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babdaa58-8598-468f-9d23-0bd9682c2f50 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:13.577122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 206/410] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:13 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:13.581159 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdaa58-8598-468f-9d23-0bd9682c2f50 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:13.625973 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6cdae-80af-46a9-bc1c-07c67abef167 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:13.711708 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdaa58-8598-468f-9d23-0bd9682c2f50 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:13.714964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e344737-3d88-433c-ac8b-2cb1953ee7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:13.716349 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e344737-3d88-433c-ac8b-2cb1953ee7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:13.716349 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e344737-3d88-433c-ac8b-2cb1953ee7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:13.716349 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e344737-3d88-433c-ac8b-2cb1953ee7b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:13.716933 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e344737-3d88-433c-ac8b-2cb1953ee7b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:13.717269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e344737-3d88-433c-ac8b-2cb1953ee7b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:13.718632 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e344737-3d88-433c-ac8b-2cb1953ee7b0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:13.731660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 205/411] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:13.738156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e344737-3d88-433c-ac8b-2cb1953ee7b0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:13.752540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a6b95-a55f-4ac2-9781-d7c93b5c751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:13.754005 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a6b95-a55f-4ac2-9781-d7c93b5c751f None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:13.768379 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a6b95-a55f-4ac2-9781-d7c93b5c751f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:13.768379 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a6b95-a55f-4ac2-9781-d7c93b5c751f None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf/groups/b82f704150eb4069984f96c28a9c7eac/roles/ed823413bca240af87bbf99994bcd0f8` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:13.768379 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a6b95-a55f-4ac2-9781-d7c93b5c751f None admin] RBAC: Authorizing `identity:create_grant(project_id=91dff31874af45e2a47062d139da0caf, group_id=b82f704150eb4069984f96c28a9c7eac, role_id=ed823413bca240af87bbf99994bcd0f8)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:13.768379 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a6b95-a55f-4ac2-9781-d7c93b5c751f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:13.848623 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e344737-3d88-433c-ac8b-2cb1953ee7b0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:13.873163 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 207/412] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Apr 6 10:49:13 2022] PUT /identity/v3/projects/91dff31874af45e2a47062d139da0caf/groups/b82f704150eb4069984f96c28a9c7eac/roles/ed823413bca240af87bbf99994bcd0f8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:49:13.884336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6429a-34f5-42fe-abec-0afae32ae9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:13.889080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6429a-34f5-42fe-abec-0afae32ae9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:13.889080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6429a-34f5-42fe-abec-0afae32ae9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:13.889080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6429a-34f5-42fe-abec-0afae32ae9c1 None admin] PATH_INFO: `/v3/groups/cffb991eab654a8bab39a0396ff4c21b` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:13.890307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6429a-34f5-42fe-abec-0afae32ae9c1 None admin] RBAC: Authorizing `identity:get_group(group_id=cffb991eab654a8bab39a0396ff4c21b)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:13.891937 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6429a-34f5-42fe-abec-0afae32ae9c1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:13.894122 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 206/413] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:13 2022] GET /identity/v3/groups/cffb991eab654a8bab39a0396ff4c21b => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:13.900215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a6b95-a55f-4ac2-9781-d7c93b5c751f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:14.043846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a6b95-a55f-4ac2-9781-d7c93b5c751f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:14.082340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e575a9c-6eff-463a-a7f3-3c447bfa860f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:14.083205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e575a9c-6eff-463a-a7f3-3c447bfa860f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:14.083486 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e575a9c-6eff-463a-a7f3-3c447bfa860f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:14.083760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e575a9c-6eff-463a-a7f3-3c447bfa860f None admin] PATH_INFO: `/v3/projects/279d4a89a1294ac096e396e32f9abd36` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:14.089915 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e575a9c-6eff-463a-a7f3-3c447bfa860f None admin] RBAC: Authorizing `identity:get_project(project_id=279d4a89a1294ac096e396e32f9abd36)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:14.091585 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e575a9c-6eff-463a-a7f3-3c447bfa860f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:14.093421 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 208/414] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:13 2022] GET /identity/v3/projects/279d4a89a1294ac096e396e32f9abd36 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:14.099335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6429a-34f5-42fe-abec-0afae32ae9c1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:14.217897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6429a-34f5-42fe-abec-0afae32ae9c1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:14.252937 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa5f3e-90bf-4e52-a39d-038efbc99742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:14.253878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa5f3e-90bf-4e52-a39d-038efbc99742 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:14.254163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa5f3e-90bf-4e52-a39d-038efbc99742 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:14.254507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa5f3e-90bf-4e52-a39d-038efbc99742 None admin] PATH_INFO: `/v3/projects/279d4a89a1294ac096e396e32f9abd36/groups/cffb991eab654a8bab39a0396ff4c21b/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:14.256560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa5f3e-90bf-4e52-a39d-038efbc99742 None admin] RBAC: Authorizing `identity:create_grant(project_id=279d4a89a1294ac096e396e32f9abd36, group_id=cffb991eab654a8bab39a0396ff4c21b, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:14.258144 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa5f3e-90bf-4e52-a39d-038efbc99742 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:14.353123 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 207/415] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Apr 6 10:49:14 2022] PUT /identity/v3/projects/279d4a89a1294ac096e396e32f9abd36/groups/cffb991eab654a8bab39a0396ff4c21b/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:49:14.582495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51771c50-9a18-40fc-b207-0a773c387ae3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:14.583024 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51771c50-9a18-40fc-b207-0a773c387ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:14.583024 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51771c50-9a18-40fc-b207-0a773c387ae3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:14.584743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 209/416] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:14.590991 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07f226-3509-4238-8402-46221df070dd None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:14.591282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07f226-3509-4238-8402-46221df070dd None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:14.591557 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07f226-3509-4238-8402-46221df070dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:14.614779 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-3e07f226-3509-4238-8402-46221df070dd None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:14.615931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3e07f226-3509-4238-8402-46221df070dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:14.698053 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 208/417] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:14.734464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51771c50-9a18-40fc-b207-0a773c387ae3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:14.846310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51771c50-9a18-40fc-b207-0a773c387ae3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:14.893940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75e6d1-09bd-4d1e-8b4a-005c232268f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:14.894659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75e6d1-09bd-4d1e-8b4a-005c232268f5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:14.894992 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75e6d1-09bd-4d1e-8b4a-005c232268f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:14.895263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75e6d1-09bd-4d1e-8b4a-005c232268f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:14.909791 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75e6d1-09bd-4d1e-8b4a-005c232268f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:14.917144 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-0e75e6d1-09bd-4d1e-8b4a-005c232268f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:49:14.922894 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 210/418] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:14.924128 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07f226-3509-4238-8402-46221df070dd None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:15.028518 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43cfeb-09e2-4726-ba23-7f7e4a659040 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:15.028849 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43cfeb-09e2-4726-ba23-7f7e4a659040 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:15.029658 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43cfeb-09e2-4726-ba23-7f7e4a659040 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:15.031270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 211/419] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:49:15.033542 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07f226-3509-4238-8402-46221df070dd None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:15.040890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3cceb-10ea-41ef-8cdc-14eb789303eb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:15.041199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3cceb-10ea-41ef-8cdc-14eb789303eb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:15.041476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3cceb-10ea-41ef-8cdc-14eb789303eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:15.060633 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b9f3cceb-10ea-41ef-8cdc-14eb789303eb None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:15.062078 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b9f3cceb-10ea-41ef-8cdc-14eb789303eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:15.098567 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c20608-58f8-495c-963d-28bda15007a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:15.099616 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20608-58f8-495c-963d-28bda15007a8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:15.100814 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20608-58f8-495c-963d-28bda15007a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:15.101932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20608-58f8-495c-963d-28bda15007a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:15.102905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c20608-58f8-495c-963d-28bda15007a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:15.103566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c20608-58f8-495c-963d-28bda15007a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:15.106129 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c20608-58f8-495c-963d-28bda15007a8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:15.127290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 209/420] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:49:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:15.129663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c20608-58f8-495c-963d-28bda15007a8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:15.199488 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 212/421] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:49:15.244863 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3cceb-10ea-41ef-8cdc-14eb789303eb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:15.267175 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c20608-58f8-495c-963d-28bda15007a8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:15.305653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55ee01-2ed7-4b03-a6a8-a9b59cbc4a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:15.306309 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55ee01-2ed7-4b03-a6a8-a9b59cbc4a12 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:15.306592 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55ee01-2ed7-4b03-a6a8-a9b59cbc4a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:15.306867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55ee01-2ed7-4b03-a6a8-a9b59cbc4a12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:15.390692 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55ee01-2ed7-4b03-a6a8-a9b59cbc4a12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:15.392159 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55ee01-2ed7-4b03-a6a8-a9b59cbc4a12 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:15.433097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3cceb-10ea-41ef-8cdc-14eb789303eb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:15.492470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 210/422] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 10:49:15.498248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55ee01-2ed7-4b03-a6a8-a9b59cbc4a12 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:15.516211 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05131d13-557b-4ed9-a2b7-3348c86a3bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:15.517037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05131d13-557b-4ed9-a2b7-3348c86a3bcb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:15.517340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05131d13-557b-4ed9-a2b7-3348c86a3bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:15.517613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05131d13-557b-4ed9-a2b7-3348c86a3bcb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:15.546325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05131d13-557b-4ed9-a2b7-3348c86a3bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:15.562772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-05131d13-557b-4ed9-a2b7-3348c86a3bcb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 10:49:15.564253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 213/423] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:49:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:15.572040 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05131d13-557b-4ed9-a2b7-3348c86a3bcb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:15.613699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55ee01-2ed7-4b03-a6a8-a9b59cbc4a12 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:15.665764 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cb708-363f-466c-8d36-017962953c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:15.666645 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cb708-363f-466c-8d36-017962953c53 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:15.666925 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cb708-363f-466c-8d36-017962953c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:15.667200 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cb708-363f-466c-8d36-017962953c53 None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:15.673441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cb708-363f-466c-8d36-017962953c53 None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:15.674660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cb708-363f-466c-8d36-017962953c53 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:15.676737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 211/424] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:15 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:15.682207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cb708-363f-466c-8d36-017962953c53 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:15.760866 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05131d13-557b-4ed9-a2b7-3348c86a3bcb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:15.823694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167949d-bb9c-4a71-91be-63c755e97de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:15.824791 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167949d-bb9c-4a71-91be-63c755e97de6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:15.825366 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167949d-bb9c-4a71-91be-63c755e97de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:15.825850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167949d-bb9c-4a71-91be-63c755e97de6 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:15.826790 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167949d-bb9c-4a71-91be-63c755e97de6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:15.828643 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167949d-bb9c-4a71-91be-63c755e97de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:15.830359 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167949d-bb9c-4a71-91be-63c755e97de6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:15.850093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 214/425] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:15.855145 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167949d-bb9c-4a71-91be-63c755e97de6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:15.873513 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cb708-363f-466c-8d36-017962953c53 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:15.971162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643b4cb-a32b-419e-b907-ef3b629299ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:15.972059 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643b4cb-a32b-419e-b907-ef3b629299ea None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:15.972334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643b4cb-a32b-419e-b907-ef3b629299ea None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:15.972603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643b4cb-a32b-419e-b907-ef3b629299ea None admin] PATH_INFO: `/v3/groups/b82f704150eb4069984f96c28a9c7eac` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:15.975367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643b4cb-a32b-419e-b907-ef3b629299ea None admin] RBAC: Authorizing `identity:get_group(group_id=b82f704150eb4069984f96c28a9c7eac)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:15.977315 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167949d-bb9c-4a71-91be-63c755e97de6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:15.977533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643b4cb-a32b-419e-b907-ef3b629299ea None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:15.979366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 212/426] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:15 2022] GET /identity/v3/groups/b82f704150eb4069984f96c28a9c7eac => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:15.984977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643b4cb-a32b-419e-b907-ef3b629299ea None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:16.017194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b164e6-dd81-476a-ad2d-4055b78d6af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:16.018219 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b164e6-dd81-476a-ad2d-4055b78d6af4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:16.018703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b164e6-dd81-476a-ad2d-4055b78d6af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:16.019336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b164e6-dd81-476a-ad2d-4055b78d6af4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:16.097691 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b164e6-dd81-476a-ad2d-4055b78d6af4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:16.100395 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b164e6-dd81-476a-ad2d-4055b78d6af4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:16.146142 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643b4cb-a32b-419e-b907-ef3b629299ea None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:16.190090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5d6de-ddd4-45e3-a542-ce142f8baf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:16.191138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5d6de-ddd4-45e3-a542-ce142f8baf64 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:16.191984 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5d6de-ddd4-45e3-a542-ce142f8baf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:16.192996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5d6de-ddd4-45e3-a542-ce142f8baf64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:16.194222 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5d6de-ddd4-45e3-a542-ce142f8baf64 None admin] RBAC: Adding query filter params (group.id=b82f704150eb4069984f96c28a9c7eac, role.id=519c87ee2e424f1d81ce0c136c4b2d25, scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:16.195570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5d6de-ddd4-45e3-a542-ce142f8baf64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:16.197465 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5d6de-ddd4-45e3-a542-ce142f8baf64 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:16.205688 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 213/427] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Apr 6 10:49:15 2022] GET /identity/v3/role_assignments?group.id=b82f704150eb4069984f96c28a9c7eac&scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5&role.id=519c87ee2e424f1d81ce0c136c4b2d25 => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:16.207312 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693a2a4-e6ac-4d24-a9d2-e55b83654b87 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:16.207805 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693a2a4-e6ac-4d24-a9d2-e55b83654b87 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:16.208307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693a2a4-e6ac-4d24-a9d2-e55b83654b87 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:16.210809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 214/428] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:16.221434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 215/429] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 10:49:16.230452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693a2a4-e6ac-4d24-a9d2-e55b83654b87 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:16.232297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e360-43bd-4d68-9442-2a6685e73418 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:16.232812 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e360-43bd-4d68-9442-2a6685e73418 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:16.233619 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e360-43bd-4d68-9442-2a6685e73418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:16.274868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a964e360-43bd-4d68-9442-2a6685e73418 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:16.275988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a964e360-43bd-4d68-9442-2a6685e73418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:16.412267 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 216/430] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:16.423560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693a2a4-e6ac-4d24-a9d2-e55b83654b87 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:16.450414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964e360-43bd-4d68-9442-2a6685e73418 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:16.479748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e500a7-34ad-4510-8607-258438891d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:16.481405 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e500a7-34ad-4510-8607-258438891d85 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:16.482096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e500a7-34ad-4510-8607-258438891d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:16.482900 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e500a7-34ad-4510-8607-258438891d85 None admin] PATH_INFO: `/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:16.486051 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e500a7-34ad-4510-8607-258438891d85 None admin] RBAC: Authorizing `identity:get_project(project_id=c0acfd6cac5d493e9d1064ecf9357aa5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:16.488379 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e500a7-34ad-4510-8607-258438891d85 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:16.491630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 215/431] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:16 2022] GET /identity/v3/projects/c0acfd6cac5d493e9d1064ecf9357aa5 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:16.497208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e500a7-34ad-4510-8607-258438891d85 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:16.600257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964e360-43bd-4d68-9442-2a6685e73418 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:16.638932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e500a7-34ad-4510-8607-258438891d85 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:16.646803 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c632e-2238-4209-b499-a55bff083272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:16.647784 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c632e-2238-4209-b499-a55bff083272 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:16.648100 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c632e-2238-4209-b499-a55bff083272 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:16.648400 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c632e-2238-4209-b499-a55bff083272 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:16.661518 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c632e-2238-4209-b499-a55bff083272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:16.669846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-442c632e-2238-4209-b499-a55bff083272 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 10:49:16.671921 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 217/432] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:16.678046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c632e-2238-4209-b499-a55bff083272 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:16.690898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d42a5b-abc5-49bb-86bd-a39f31babe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:16.692653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d42a5b-abc5-49bb-86bd-a39f31babe8c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:16.693324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d42a5b-abc5-49bb-86bd-a39f31babe8c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:16.693842 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d42a5b-abc5-49bb-86bd-a39f31babe8c None admin] PATH_INFO: `/v3/groups/b82f704150eb4069984f96c28a9c7eac` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:16.695929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d42a5b-abc5-49bb-86bd-a39f31babe8c None admin] RBAC: Authorizing `identity:get_group(group_id=b82f704150eb4069984f96c28a9c7eac)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:16.698418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d42a5b-abc5-49bb-86bd-a39f31babe8c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:16.700672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 216/433] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:16 2022] GET /identity/v3/groups/b82f704150eb4069984f96c28a9c7eac => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:16.706563 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d42a5b-abc5-49bb-86bd-a39f31babe8c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:16.809639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c632e-2238-4209-b499-a55bff083272 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:16.829709 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d42a5b-abc5-49bb-86bd-a39f31babe8c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:16.848000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be6d90-bce6-4749-9606-35f97e8aca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:16.848679 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6d90-bce6-4749-9606-35f97e8aca8a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:16.848955 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6d90-bce6-4749-9606-35f97e8aca8a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:16.850497 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6d90-bce6-4749-9606-35f97e8aca8a None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:16.852774 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be6d90-bce6-4749-9606-35f97e8aca8a None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:16.853112 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be6d90-bce6-4749-9606-35f97e8aca8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:16.854545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be6d90-bce6-4749-9606-35f97e8aca8a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:16.863132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 218/434] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:49:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:16.864491 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c365fa7-4b8e-4d74-ab76-6b97857f5aec None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:16.864781 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c365fa7-4b8e-4d74-ab76-6b97857f5aec None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:16.865092 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c365fa7-4b8e-4d74-ab76-6b97857f5aec None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:16.867160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 219/435] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:16.872272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c365fa7-4b8e-4d74-ab76-6b97857f5aec None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:16.880272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d8066-926b-4117-bc2b-8e0a2a5db95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:16.881630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d8066-926b-4117-bc2b-8e0a2a5db95d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:16.882628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d8066-926b-4117-bc2b-8e0a2a5db95d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:16.883046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d8066-926b-4117-bc2b-8e0a2a5db95d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:16.884063 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d8066-926b-4117-bc2b-8e0a2a5db95d None admin] RBAC: Adding query filter params (group.id=b82f704150eb4069984f96c28a9c7eac, role.id=ed823413bca240af87bbf99994bcd0f8, scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:16.884382 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d8066-926b-4117-bc2b-8e0a2a5db95d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:16.887136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d8066-926b-4117-bc2b-8e0a2a5db95d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:16.897326 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 217/436] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Apr 6 10:49:16 2022] GET /identity/v3/role_assignments?group.id=b82f704150eb4069984f96c28a9c7eac&scope.project.id=c0acfd6cac5d493e9d1064ecf9357aa5&role.id=ed823413bca240af87bbf99994bcd0f8 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:16.899143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b235c-9a8b-4918-a583-9b40fdaa3639 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:16.899384 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b235c-9a8b-4918-a583-9b40fdaa3639 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:16.899651 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b235c-9a8b-4918-a583-9b40fdaa3639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:16.923563 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-6b2b235c-9a8b-4918-a583-9b40fdaa3639 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:16.924774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6b2b235c-9a8b-4918-a583-9b40fdaa3639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:16.997483 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c365fa7-4b8e-4d74-ab76-6b97857f5aec None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:16.998375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 218/437] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:17.029340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b235c-9a8b-4918-a583-9b40fdaa3639 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:17.037663 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacf87d-f008-461d-8863-47aa7b8eafe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:17.039326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacf87d-f008-461d-8863-47aa7b8eafe9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:17.039870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacf87d-f008-461d-8863-47aa7b8eafe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:17.040377 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacf87d-f008-461d-8863-47aa7b8eafe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:17.115307 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caacf87d-f008-461d-8863-47aa7b8eafe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:17.117759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caacf87d-f008-461d-8863-47aa7b8eafe9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:17.139271 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b235c-9a8b-4918-a583-9b40fdaa3639 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:17.185122 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2c5fd-0434-4e75-ba1e-5eed2c52656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:17.185952 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2c5fd-0434-4e75-ba1e-5eed2c52656e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:17.186644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2c5fd-0434-4e75-ba1e-5eed2c52656e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:17.186644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2c5fd-0434-4e75-ba1e-5eed2c52656e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:17.197369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2c5fd-0434-4e75-ba1e-5eed2c52656e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:17.205148 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-6ec2c5fd-0434-4e75-ba1e-5eed2c52656e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 10:49:17.207359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 219/438] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:49:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:17.212367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2c5fd-0434-4e75-ba1e-5eed2c52656e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:17.249034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 220/439] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:17.254538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacf87d-f008-461d-8863-47aa7b8eafe9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:17.335874 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2c5fd-0434-4e75-ba1e-5eed2c52656e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:17.365572 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacf87d-f008-461d-8863-47aa7b8eafe9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:17.377413 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f22d4-c58e-474d-90df-30879ff8d209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:17.378433 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f22d4-c58e-474d-90df-30879ff8d209 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:17.378970 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f22d4-c58e-474d-90df-30879ff8d209 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:17.379456 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f22d4-c58e-474d-90df-30879ff8d209 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:17.380280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f22d4-c58e-474d-90df-30879ff8d209 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:17.380594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f22d4-c58e-474d-90df-30879ff8d209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:17.382114 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f22d4-c58e-474d-90df-30879ff8d209 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:17.391560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 220/440] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:17.392876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601570-2974-4880-b85e-400b181a49b9 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:17.393259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601570-2974-4880-b85e-400b181a49b9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:17.393543 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601570-2974-4880-b85e-400b181a49b9 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:17.394760 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 221/441] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:17.397026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48601570-2974-4880-b85e-400b181a49b9 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:17.404797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e212a7-33f9-49fa-8f31-54c52b6519df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:17.405688 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e212a7-33f9-49fa-8f31-54c52b6519df None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:17.405970 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e212a7-33f9-49fa-8f31-54c52b6519df None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:17.406253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e212a7-33f9-49fa-8f31-54c52b6519df None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:17.407424 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e212a7-33f9-49fa-8f31-54c52b6519df None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:17.408902 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e212a7-33f9-49fa-8f31-54c52b6519df None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:17.410694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 221/442] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:17 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:17.411823 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eda7a6-3e32-4e35-a1be-00d70e44cb7b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:17.412106 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eda7a6-3e32-4e35-a1be-00d70e44cb7b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:17.412443 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eda7a6-3e32-4e35-a1be-00d70e44cb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:17.428512 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b6eda7a6-3e32-4e35-a1be-00d70e44cb7b None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:17.429757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b6eda7a6-3e32-4e35-a1be-00d70e44cb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:17.492434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 222/443] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:17.493279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eda7a6-3e32-4e35-a1be-00d70e44cb7b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:17.502048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48601570-2974-4880-b85e-400b181a49b9 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:17.535176 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe29de-eb6e-4c16-b2f5-7bf43857d8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:17.535824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe29de-eb6e-4c16-b2f5-7bf43857d8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:17.536107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe29de-eb6e-4c16-b2f5-7bf43857d8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:17.536384 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe29de-eb6e-4c16-b2f5-7bf43857d8c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:17.586890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eda7a6-3e32-4e35-a1be-00d70e44cb7b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:17.599507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe29de-eb6e-4c16-b2f5-7bf43857d8c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:17.601526 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe29de-eb6e-4c16-b2f5-7bf43857d8c9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:17.619275 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace11e95-b22b-41db-9830-21fb478e568c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:17.620071 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11e95-b22b-41db-9830-21fb478e568c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:17.620351 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11e95-b22b-41db-9830-21fb478e568c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:17.620623 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11e95-b22b-41db-9830-21fb478e568c None admin] PATH_INFO: `/v3/groups/b82f704150eb4069984f96c28a9c7eac` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:17.621819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace11e95-b22b-41db-9830-21fb478e568c None admin] RBAC: Authorizing `identity:get_group(group_id=b82f704150eb4069984f96c28a9c7eac)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:17.623286 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace11e95-b22b-41db-9830-21fb478e568c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:17.624905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 223/444] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:17 2022] GET /identity/v3/groups/b82f704150eb4069984f96c28a9c7eac => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:17.625689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace11e95-b22b-41db-9830-21fb478e568c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:17.695243 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 222/445] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:17.696261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe29de-eb6e-4c16-b2f5-7bf43857d8c9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:17.719920 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace11e95-b22b-41db-9830-21fb478e568c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:17.752098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71b2f-d7be-40e9-8044-166fdbebe35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:17.752888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71b2f-d7be-40e9-8044-166fdbebe35d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:17.753197 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71b2f-d7be-40e9-8044-166fdbebe35d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:17.753484 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71b2f-d7be-40e9-8044-166fdbebe35d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:17.763040 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f71b2f-d7be-40e9-8044-166fdbebe35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:17.769975 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-84f71b2f-d7be-40e9-8044-166fdbebe35d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:49:17.771282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 224/446] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:49:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:17.772046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71b2f-d7be-40e9-8044-166fdbebe35d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:17.789648 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe29de-eb6e-4c16-b2f5-7bf43857d8c9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:17.823131 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece719e-a263-4148-ba67-3b33d10b2664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:17.823780 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece719e-a263-4148-ba67-3b33d10b2664 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:17.824066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece719e-a263-4148-ba67-3b33d10b2664 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:17.824342 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece719e-a263-4148-ba67-3b33d10b2664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:17.825191 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece719e-a263-4148-ba67-3b33d10b2664 None admin] RBAC: Adding query filter params (group.id=b82f704150eb4069984f96c28a9c7eac, role.id=519c87ee2e424f1d81ce0c136c4b2d25, scope.project.id=91dff31874af45e2a47062d139da0caf) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:17.825504 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece719e-a263-4148-ba67-3b33d10b2664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:17.826931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece719e-a263-4148-ba67-3b33d10b2664 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:17.832447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 223/447] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Apr 6 10:49:17 2022] GET /identity/v3/role_assignments?group.id=b82f704150eb4069984f96c28a9c7eac&scope.project.id=91dff31874af45e2a47062d139da0caf&role.id=519c87ee2e424f1d81ce0c136c4b2d25 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:17.833242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece719e-a263-4148-ba67-3b33d10b2664 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:17.873505 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71b2f-d7be-40e9-8044-166fdbebe35d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:17.908611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f201d9-5c29-4b08-b63a-b91179a5673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:17.909945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f201d9-5c29-4b08-b63a-b91179a5673a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:17.910412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f201d9-5c29-4b08-b63a-b91179a5673a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:17.910760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f201d9-5c29-4b08-b63a-b91179a5673a None admin] PATH_INFO: `/v3/projects/91dff31874af45e2a47062d139da0caf` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:17.912020 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f201d9-5c29-4b08-b63a-b91179a5673a None admin] RBAC: Authorizing `identity:get_project(project_id=91dff31874af45e2a47062d139da0caf)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:17.914057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f201d9-5c29-4b08-b63a-b91179a5673a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:17.915978 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 225/448] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:17 2022] GET /identity/v3/projects/91dff31874af45e2a47062d139da0caf => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:17.921489 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f201d9-5c29-4b08-b63a-b91179a5673a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:17.937111 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece719e-a263-4148-ba67-3b33d10b2664 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:17.971461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41470f21-4038-42f2-9e39-fa742a90219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:17.972144 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41470f21-4038-42f2-9e39-fa742a90219e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:17.972426 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41470f21-4038-42f2-9e39-fa742a90219e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:17.972704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41470f21-4038-42f2-9e39-fa742a90219e None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:17.973497 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41470f21-4038-42f2-9e39-fa742a90219e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:17.973804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41470f21-4038-42f2-9e39-fa742a90219e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:17.975195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41470f21-4038-42f2-9e39-fa742a90219e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:17.985088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 224/449] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:17.989930 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41470f21-4038-42f2-9e39-fa742a90219e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:18.032038 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f201d9-5c29-4b08-b63a-b91179a5673a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:18.067910 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5bd35-98e8-4080-b1c8-d2403ab4de5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:18.068775 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5bd35-98e8-4080-b1c8-d2403ab4de5f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:18.069088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5bd35-98e8-4080-b1c8-d2403ab4de5f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:18.069386 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5bd35-98e8-4080-b1c8-d2403ab4de5f None admin] PATH_INFO: `/v3/groups/b82f704150eb4069984f96c28a9c7eac` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:18.070609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5bd35-98e8-4080-b1c8-d2403ab4de5f None admin] RBAC: Authorizing `identity:get_group(group_id=b82f704150eb4069984f96c28a9c7eac)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:18.072242 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5bd35-98e8-4080-b1c8-d2403ab4de5f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:18.073795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 226/450] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:17 2022] GET /identity/v3/groups/b82f704150eb4069984f96c28a9c7eac => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:18.079648 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5bd35-98e8-4080-b1c8-d2403ab4de5f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:18.108063 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41470f21-4038-42f2-9e39-fa742a90219e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:18.146804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cb818-61f8-423f-83f6-7e4df7c9acaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:18.149409 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb818-61f8-423f-83f6-7e4df7c9acaf None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:18.149409 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb818-61f8-423f-83f6-7e4df7c9acaf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:18.149409 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb818-61f8-423f-83f6-7e4df7c9acaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:18.190934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5bd35-98e8-4080-b1c8-d2403ab4de5f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:18.229488 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cb818-61f8-423f-83f6-7e4df7c9acaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:18.231119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cb818-61f8-423f-83f6-7e4df7c9acaf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:18.233687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be213439-ddae-4adb-a473-40063b041734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:18.234348 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be213439-ddae-4adb-a473-40063b041734 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:18.234628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be213439-ddae-4adb-a473-40063b041734 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:18.234906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be213439-ddae-4adb-a473-40063b041734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:18.235731 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be213439-ddae-4adb-a473-40063b041734 None admin] RBAC: Adding query filter params (group.id=b82f704150eb4069984f96c28a9c7eac, role.id=ed823413bca240af87bbf99994bcd0f8, scope.project.id=91dff31874af45e2a47062d139da0caf) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:18.236037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be213439-ddae-4adb-a473-40063b041734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:18.237559 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be213439-ddae-4adb-a473-40063b041734 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:18.244266 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 227/451] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Apr 6 10:49:18 2022] GET /identity/v3/role_assignments?group.id=b82f704150eb4069984f96c28a9c7eac&scope.project.id=91dff31874af45e2a47062d139da0caf&role.id=ed823413bca240af87bbf99994bcd0f8 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:18.340145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 225/452] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 10:49:18.345828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be213439-ddae-4adb-a473-40063b041734 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:18.445457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be213439-ddae-4adb-a473-40063b041734 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:18.477772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4af4b5-09a5-4a28-8c49-05f79a3c2ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:18.478707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af4b5-09a5-4a28-8c49-05f79a3c2ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:18.479016 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af4b5-09a5-4a28-8c49-05f79a3c2ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:18.479289 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af4b5-09a5-4a28-8c49-05f79a3c2ee7 None admin] PATH_INFO: `/v3/projects/279d4a89a1294ac096e396e32f9abd36` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:18.480469 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4af4b5-09a5-4a28-8c49-05f79a3c2ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=279d4a89a1294ac096e396e32f9abd36)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:18.481979 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4af4b5-09a5-4a28-8c49-05f79a3c2ee7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:18.483677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 228/453] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:49:18 2022] GET /identity/v3/projects/279d4a89a1294ac096e396e32f9abd36 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:18.489180 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cb818-61f8-423f-83f6-7e4df7c9acaf None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:18.590313 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cb818-61f8-423f-83f6-7e4df7c9acaf None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:18.622998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8768d-7b80-4af8-a37e-4b0220869525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:18.623853 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8768d-7b80-4af8-a37e-4b0220869525 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:18.624420 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8768d-7b80-4af8-a37e-4b0220869525 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:18.624706 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8768d-7b80-4af8-a37e-4b0220869525 None admin] PATH_INFO: `/v3/groups/cffb991eab654a8bab39a0396ff4c21b` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:18.625909 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8768d-7b80-4af8-a37e-4b0220869525 None admin] RBAC: Authorizing `identity:get_group(group_id=cffb991eab654a8bab39a0396ff4c21b)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:18.627340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8768d-7b80-4af8-a37e-4b0220869525 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:18.628949 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 226/454] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Apr 6 10:49:18 2022] GET /identity/v3/groups/cffb991eab654a8bab39a0396ff4c21b => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:18.635307 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4af4b5-09a5-4a28-8c49-05f79a3c2ee7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:18.729103 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4af4b5-09a5-4a28-8c49-05f79a3c2ee7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:18.760018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5c3de-14ab-4119-ae4b-0f7bb0173d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:18.760659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5c3de-14ab-4119-ae4b-0f7bb0173d57 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:18.760940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5c3de-14ab-4119-ae4b-0f7bb0173d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:18.761249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5c3de-14ab-4119-ae4b-0f7bb0173d57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:18.762068 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5c3de-14ab-4119-ae4b-0f7bb0173d57 None admin] RBAC: Adding query filter params (group.id=cffb991eab654a8bab39a0396ff4c21b, role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=279d4a89a1294ac096e396e32f9abd36) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:18.762380 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5c3de-14ab-4119-ae4b-0f7bb0173d57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:18.763843 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5c3de-14ab-4119-ae4b-0f7bb0173d57 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:18.769401 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 229/455] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Apr 6 10:49:18 2022] GET /identity/v3/role_assignments?group.id=cffb991eab654a8bab39a0396ff4c21b&scope.project.id=279d4a89a1294ac096e396e32f9abd36&role.id=090ba4d1ae32495289276665920d4a2c => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:21.640777 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934ef13-9774-4fc6-a2dc-18aa6e7b1742 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:21.641317 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934ef13-9774-4fc6-a2dc-18aa6e7b1742 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:21.641391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934ef13-9774-4fc6-a2dc-18aa6e7b1742 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:21.642998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 227/456] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:21.653751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4cd63-7640-4e5d-958b-d602dc6c858c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:21.654214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4cd63-7640-4e5d-958b-d602dc6c858c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:21.654421 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4cd63-7640-4e5d-958b-d602dc6c858c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:21.679107 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-03f4cd63-7640-4e5d-958b-d602dc6c858c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:21.680303 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-03f4cd63-7640-4e5d-958b-d602dc6c858c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:21.768528 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 230/457] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:21.783172 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02786d3e-e788-4661-bd76-1fa90466f191 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:21.783462 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02786d3e-e788-4661-bd76-1fa90466f191 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:21.783746 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02786d3e-e788-4661-bd76-1fa90466f191 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:21.785392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 228/458] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:21.791160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee53ac9-3e81-46a1-8aa1-93710dc2fd24 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:21.791452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee53ac9-3e81-46a1-8aa1-93710dc2fd24 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:21.791730 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee53ac9-3e81-46a1-8aa1-93710dc2fd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:21.809347 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2ee53ac9-3e81-46a1-8aa1-93710dc2fd24 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:21.810853 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2ee53ac9-3e81-46a1-8aa1-93710dc2fd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:21.818713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02786d3e-e788-4661-bd76-1fa90466f191 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:21.918520 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 231/459] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:21.962706 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02786d3e-e788-4661-bd76-1fa90466f191 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:21.999201 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef4ad2-9463-4de2-8168-c8cd0dbc8231 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:21.999508 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef4ad2-9463-4de2-8168-c8cd0dbc8231 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:21.999755 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef4ad2-9463-4de2-8168-c8cd0dbc8231 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:22.001390 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 232/460] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:49:22.002088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef4ad2-9463-4de2-8168-c8cd0dbc8231 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:22.006350 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2253128-717a-4f06-9321-9138756c8ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:22.007439 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2253128-717a-4f06-9321-9138756c8ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:22.008004 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2253128-717a-4f06-9321-9138756c8ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:22.013103 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2253128-717a-4f06-9321-9138756c8ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:22.018701 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2253128-717a-4f06-9321-9138756c8ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:22.020157 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2253128-717a-4f06-9321-9138756c8ab2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:22.038949 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-c2253128-717a-4f06-9321-9138756c8ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:22.040607 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 229/461] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:22.041913 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d9210-7fa0-4200-8759-3f8686ab4978 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:22.042199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d9210-7fa0-4200-8759-3f8686ab4978 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:22.042474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d9210-7fa0-4200-8759-3f8686ab4978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:22.059402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e83d9210-7fa0-4200-8759-3f8686ab4978 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:22.060592 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e83d9210-7fa0-4200-8759-3f8686ab4978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:22.108432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef4ad2-9463-4de2-8168-c8cd0dbc8231 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:22.129084 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 230/462] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:22.130012 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d9210-7fa0-4200-8759-3f8686ab4978 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:22.156434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bb9cf-4030-447b-92df-64421d6dbb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:22.157687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bb9cf-4030-447b-92df-64421d6dbb53 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:22.158191 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bb9cf-4030-447b-92df-64421d6dbb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:22.158662 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bb9cf-4030-447b-92df-64421d6dbb53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:22.170354 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bb9cf-4030-447b-92df-64421d6dbb53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:22.172183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bb9cf-4030-447b-92df-64421d6dbb53 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:22.192601 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-1d6bb9cf-4030-447b-92df-64421d6dbb53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:22.194046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 233/463] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:22.195250 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bb9cf-4030-447b-92df-64421d6dbb53 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:22.241164 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d9210-7fa0-4200-8759-3f8686ab4978 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:22.280022 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a073c-66b0-41ce-9d35-f91f8d167dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:22.281087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a073c-66b0-41ce-9d35-f91f8d167dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:22.281513 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a073c-66b0-41ce-9d35-f91f8d167dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:22.281931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a073c-66b0-41ce-9d35-f91f8d167dc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:22.282797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a073c-66b0-41ce-9d35-f91f8d167dc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:22.283245 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a073c-66b0-41ce-9d35-f91f8d167dc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:22.284768 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a073c-66b0-41ce-9d35-f91f8d167dc5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:22.297902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 231/464] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:22.299228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a073c-66b0-41ce-9d35-f91f8d167dc5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:22.300523 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bb9cf-4030-447b-92df-64421d6dbb53 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:22.337582 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5475955-af2f-4206-ac1b-871c5225fbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:22.338366 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5475955-af2f-4206-ac1b-871c5225fbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:22.338648 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5475955-af2f-4206-ac1b-871c5225fbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:22.338917 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5475955-af2f-4206-ac1b-871c5225fbf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:22.348632 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5475955-af2f-4206-ac1b-871c5225fbf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:22.350136 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5475955-af2f-4206-ac1b-871c5225fbf5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:22.368121 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-f5475955-af2f-4206-ac1b-871c5225fbf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:22.369354 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 234/465] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:22.370634 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e797be2-a569-4014-94b8-8b4f1c7bdb21 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:22.370917 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e797be2-a569-4014-94b8-8b4f1c7bdb21 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:22.371190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e797be2-a569-4014-94b8-8b4f1c7bdb21 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:22.372472 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 235/466] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:22.373323 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e797be2-a569-4014-94b8-8b4f1c7bdb21 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:22.402718 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a073c-66b0-41ce-9d35-f91f8d167dc5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:22.437992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1293ae-b6c8-48a8-8b1e-15d564cfb407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:22.438873 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1293ae-b6c8-48a8-8b1e-15d564cfb407 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:22.439323 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1293ae-b6c8-48a8-8b1e-15d564cfb407 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:22.439741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1293ae-b6c8-48a8-8b1e-15d564cfb407 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:22.440762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1293ae-b6c8-48a8-8b1e-15d564cfb407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:22.441698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1293ae-b6c8-48a8-8b1e-15d564cfb407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:22.443461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1293ae-b6c8-48a8-8b1e-15d564cfb407 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:22.456245 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 232/467] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:22.457081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1293ae-b6c8-48a8-8b1e-15d564cfb407 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:22.479623 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e797be2-a569-4014-94b8-8b4f1c7bdb21 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:22.512911 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13902762-827a-4a3c-9647-270be27781ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:22.513616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13902762-827a-4a3c-9647-270be27781ef None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:22.513897 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13902762-827a-4a3c-9647-270be27781ef None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:22.514168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13902762-827a-4a3c-9647-270be27781ef None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:22.514866 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13902762-827a-4a3c-9647-270be27781ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:22.516335 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13902762-827a-4a3c-9647-270be27781ef None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:22.555340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1293ae-b6c8-48a8-8b1e-15d564cfb407 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:22.588251 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e64fa9-7db9-458b-81d1-8e5a32b93b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:22.588948 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64fa9-7db9-458b-81d1-8e5a32b93b5c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:22.589258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64fa9-7db9-458b-81d1-8e5a32b93b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:22.589533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64fa9-7db9-458b-81d1-8e5a32b93b5c None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:22.590248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e64fa9-7db9-458b-81d1-8e5a32b93b5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:22.590552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e64fa9-7db9-458b-81d1-8e5a32b93b5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:22.591957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e64fa9-7db9-458b-81d1-8e5a32b93b5c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:22.603281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 233/468] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:22.604733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93113fad-e2cf-4a79-b562-59ee6828a4f4 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:22.604979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93113fad-e2cf-4a79-b562-59ee6828a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:22.605282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93113fad-e2cf-4a79-b562-59ee6828a4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:22.623457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-93113fad-e2cf-4a79-b562-59ee6828a4f4 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:22.624721 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-93113fad-e2cf-4a79-b562-59ee6828a4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:22.633387 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 236/469] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:49:22 2022] POST /identity/v3/users => generated 246 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:49:22.634378 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13902762-827a-4a3c-9647-270be27781ef None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:22.713649 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 234/470] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:22.714717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93113fad-e2cf-4a79-b562-59ee6828a4f4 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:22.761796 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13902762-827a-4a3c-9647-270be27781ef None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:22.798737 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acac9e1-e242-4039-978d-4b5b8fb96759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:22.799784 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acac9e1-e242-4039-978d-4b5b8fb96759 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:22.800219 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acac9e1-e242-4039-978d-4b5b8fb96759 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:22.800645 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acac9e1-e242-4039-978d-4b5b8fb96759 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:22.801531 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acac9e1-e242-4039-978d-4b5b8fb96759 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:22.803198 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acac9e1-e242-4039-978d-4b5b8fb96759 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:22.841345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93113fad-e2cf-4a79-b562-59ee6828a4f4 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:22.877717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd03f7-2177-4e24-8ec9-64c17de51d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:22.878598 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd03f7-2177-4e24-8ec9-64c17de51d87 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:22.878806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd03f7-2177-4e24-8ec9-64c17de51d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:22.879086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd03f7-2177-4e24-8ec9-64c17de51d87 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:22.879789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd03f7-2177-4e24-8ec9-64c17de51d87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:22.881300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd03f7-2177-4e24-8ec9-64c17de51d87 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:22.887501 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 237/471] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:49:22 2022] POST /identity/v3/users => generated 248 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:49:22.888139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acac9e1-e242-4039-978d-4b5b8fb96759 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:22.962491 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 235/472] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:49:22 2022] POST /identity/v3/users => generated 248 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:49:23.002055 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623bb8-6319-4662-a63c-2066ead9dcd2 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:23.002402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623bb8-6319-4662-a63c-2066ead9dcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:23.002734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623bb8-6319-4662-a63c-2066ead9dcd2 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:23.004147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 236/473] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:23.010151 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abc3bd-c737-47ba-859d-16b7df121f0a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:23.010650 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abc3bd-c737-47ba-859d-16b7df121f0a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:23.011000 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abc3bd-c737-47ba-859d-16b7df121f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:23.024410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acac9e1-e242-4039-978d-4b5b8fb96759 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:23.042183 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-52abc3bd-c737-47ba-859d-16b7df121f0a None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:23.043949 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-52abc3bd-c737-47ba-859d-16b7df121f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:23.099201 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9341d9e-cb8c-4fe3-8855-f1359a16460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:23.100027 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9341d9e-cb8c-4fe3-8855-f1359a16460f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:23.100307 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9341d9e-cb8c-4fe3-8855-f1359a16460f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:23.101128 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9341d9e-cb8c-4fe3-8855-f1359a16460f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:23.115759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9341d9e-cb8c-4fe3-8855-f1359a16460f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:23.117961 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9341d9e-cb8c-4fe3-8855-f1359a16460f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:23.136040 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-f9341d9e-cb8c-4fe3-8855-f1359a16460f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:23.137711 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 238/474] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:23.147535 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9341d9e-cb8c-4fe3-8855-f1359a16460f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:23.159834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 237/475] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:49:23.186441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abc3bd-c737-47ba-859d-16b7df121f0a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:23.276227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9341d9e-cb8c-4fe3-8855-f1359a16460f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:23.318877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abc3bd-c737-47ba-859d-16b7df121f0a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:23.323693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8131f9-2774-4d59-bea0-7a57f1780ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:23.324329 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8131f9-2774-4d59-bea0-7a57f1780ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:23.324606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8131f9-2774-4d59-bea0-7a57f1780ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:23.324874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8131f9-2774-4d59-bea0-7a57f1780ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:23.325677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8131f9-2774-4d59-bea0-7a57f1780ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:23.325981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8131f9-2774-4d59-bea0-7a57f1780ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:23.327393 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8131f9-2774-4d59-bea0-7a57f1780ef6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:23.339661 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 239/476] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:23.347751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8131f9-2774-4d59-bea0-7a57f1780ef6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:23.383640 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee492a1f-47ab-43e3-af76-b749586b25e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:23.384305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee492a1f-47ab-43e3-af76-b749586b25e0 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:23.384578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee492a1f-47ab-43e3-af76-b749586b25e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:23.384845 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee492a1f-47ab-43e3-af76-b749586b25e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:23.385634 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee492a1f-47ab-43e3-af76-b749586b25e0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:23.387138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee492a1f-47ab-43e3-af76-b749586b25e0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:23.435359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.sql.core [None req-ee492a1f-47ab-43e3-af76-b749586b25e0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 06 10:49:23.435359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 06 10:49:23.435359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [parameters: {'id': '7b8786d624a4467ca48656553249ef34', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 06 10:49:23.435359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80201) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 06 10:49:23.451143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-ee492a1f-47ab-43e3-af76-b749586b25e0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 06 10:49:23.452878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 238/477] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Apr 6 10:49:23 2022] POST /identity/v3/roles => generated 144 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:23.459589 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee492a1f-47ab-43e3-af76-b749586b25e0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:23.477785 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8131f9-2774-4d59-bea0-7a57f1780ef6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:23.523252 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbca60a-9868-4e96-81f3-99aa3cf5c685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:23.524418 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbca60a-9868-4e96-81f3-99aa3cf5c685 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:23.524702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbca60a-9868-4e96-81f3-99aa3cf5c685 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:23.524979 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbca60a-9868-4e96-81f3-99aa3cf5c685 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:23.526879 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbca60a-9868-4e96-81f3-99aa3cf5c685 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:23.530898 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbca60a-9868-4e96-81f3-99aa3cf5c685 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:23.618616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 240/478] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:49:23 2022] POST /identity/v3/users => generated 249 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:49:23.623104 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee492a1f-47ab-43e3-af76-b749586b25e0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:23.660429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f27f2-9dca-4a5f-a98a-57c4f8344904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:23.661356 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f27f2-9dca-4a5f-a98a-57c4f8344904 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:23.661698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f27f2-9dca-4a5f-a98a-57c4f8344904 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:23.661976 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f27f2-9dca-4a5f-a98a-57c4f8344904 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:23.677093 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f27f2-9dca-4a5f-a98a-57c4f8344904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:23.682709 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-206f27f2-9dca-4a5f-a98a-57c4f8344904 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 10:49:23.683987 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 239/479] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:49:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:23.690064 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbca60a-9868-4e96-81f3-99aa3cf5c685 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:23.812513 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbca60a-9868-4e96-81f3-99aa3cf5c685 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:23.855735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdba8b-a555-4f08-8624-496bb5591ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:23.856423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdba8b-a555-4f08-8624-496bb5591ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:23.856707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdba8b-a555-4f08-8624-496bb5591ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:23.856983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdba8b-a555-4f08-8624-496bb5591ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:23.857830 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdba8b-a555-4f08-8624-496bb5591ef8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:23.858138 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdba8b-a555-4f08-8624-496bb5591ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:23.859633 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdba8b-a555-4f08-8624-496bb5591ef8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:23.873346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 241/480] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:25.637593 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87650bd1-78ae-4413-a06b-03bbd9be5c68 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:25.638611 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87650bd1-78ae-4413-a06b-03bbd9be5c68 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:25.639098 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87650bd1-78ae-4413-a06b-03bbd9be5c68 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:25.640902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 240/481] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:25.646405 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698a3d7-adb0-4ca0-9359-7a110ebf94fe None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:25.647227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698a3d7-adb0-4ca0-9359-7a110ebf94fe None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:25.648222 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698a3d7-adb0-4ca0-9359-7a110ebf94fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:25.670012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5698a3d7-adb0-4ca0-9359-7a110ebf94fe None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:25.671546 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5698a3d7-adb0-4ca0-9359-7a110ebf94fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:25.681673 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27eab0-c26a-4dee-8896-de3625385216 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:25.681962 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27eab0-c26a-4dee-8896-de3625385216 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:25.682254 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27eab0-c26a-4dee-8896-de3625385216 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:25.683639 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 241/482] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:25.689169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bf65a-596e-4a3d-8945-25b52bbde980 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:25.689458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bf65a-596e-4a3d-8945-25b52bbde980 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:25.689737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bf65a-596e-4a3d-8945-25b52bbde980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:25.711197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-9e0bf65a-596e-4a3d-8945-25b52bbde980 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:25.712404 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9e0bf65a-596e-4a3d-8945-25b52bbde980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:25.782874 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 242/483] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 06 10:49:25.811394 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 242/484] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:25.818941 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bf65a-596e-4a3d-8945-25b52bbde980 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:25.838811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698a3d7-adb0-4ca0-9359-7a110ebf94fe None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:25.959726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bf65a-596e-4a3d-8945-25b52bbde980 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:25.983384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698a3d7-adb0-4ca0-9359-7a110ebf94fe None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:25.995587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13090abb-2d5b-4b63-9bba-ad99b261171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:25.996606 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13090abb-2d5b-4b63-9bba-ad99b261171c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:25.997025 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13090abb-2d5b-4b63-9bba-ad99b261171c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:25.997704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13090abb-2d5b-4b63-9bba-ad99b261171c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.010572 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13090abb-2d5b-4b63-9bba-ad99b261171c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:26.019291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-13090abb-2d5b-4b63-9bba-ad99b261171c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:26.019457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1ca9d-0711-4963-8bdf-b7a7c19eb619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:26.020422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1ca9d-0711-4963-8bdf-b7a7c19eb619 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.020848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1ca9d-0711-4963-8bdf-b7a7c19eb619 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.020984 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 243/485] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:26.021420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1ca9d-0711-4963-8bdf-b7a7c19eb619 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.022401 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e371a-ba84-4ac3-a2bc-7de96c25402d None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.023269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e371a-ba84-4ac3-a2bc-7de96c25402d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.023544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e371a-ba84-4ac3-a2bc-7de96c25402d None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.025171 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 244/486] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:26.030209 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e371a-ba84-4ac3-a2bc-7de96c25402d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:26.037713 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1ca9d-0711-4963-8bdf-b7a7c19eb619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:26.046472 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-08d1ca9d-0711-4963-8bdf-b7a7c19eb619 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:26.052536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 243/487] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:26.052536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f017-a7fd-456f-8ff8-1d14bdaff729 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.052536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f017-a7fd-456f-8ff8-1d14bdaff729 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.052536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f017-a7fd-456f-8ff8-1d14bdaff729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.072682 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5820f017-a7fd-456f-8ff8-1d14bdaff729 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:26.073924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5820f017-a7fd-456f-8ff8-1d14bdaff729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:26.153990 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e371a-ba84-4ac3-a2bc-7de96c25402d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:26.165095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 244/488] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:26.165095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f017-a7fd-456f-8ff8-1d14bdaff729 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:26.211827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d417eb5-b121-4c73-a0d1-8dc4e093a153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:26.212844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d417eb5-b121-4c73-a0d1-8dc4e093a153 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.213399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d417eb5-b121-4c73-a0d1-8dc4e093a153 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.213869 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d417eb5-b121-4c73-a0d1-8dc4e093a153 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.214810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d417eb5-b121-4c73-a0d1-8dc4e093a153 None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:26.215308 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d417eb5-b121-4c73-a0d1-8dc4e093a153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:26.216899 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d417eb5-b121-4c73-a0d1-8dc4e093a153 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:26.225940 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 245/489] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:26.227096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d417eb5-b121-4c73-a0d1-8dc4e093a153 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:26.270748 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f017-a7fd-456f-8ff8-1d14bdaff729 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:26.306011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa303431-51ea-4cdc-9f43-ebde741dc55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:26.306429 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa303431-51ea-4cdc-9f43-ebde741dc55b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.306716 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa303431-51ea-4cdc-9f43-ebde741dc55b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.306989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa303431-51ea-4cdc-9f43-ebde741dc55b None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.307732 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa303431-51ea-4cdc-9f43-ebde741dc55b None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:26.308037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa303431-51ea-4cdc-9f43-ebde741dc55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:26.309484 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa303431-51ea-4cdc-9f43-ebde741dc55b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:26.318054 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 245/490] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:26.318870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa303431-51ea-4cdc-9f43-ebde741dc55b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:26.333726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d417eb5-b121-4c73-a0d1-8dc4e093a153 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:26.374272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb20b5-4b69-437d-9119-840aca52da98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:26.375697 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb20b5-4b69-437d-9119-840aca52da98 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.376195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb20b5-4b69-437d-9119-840aca52da98 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.376664 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb20b5-4b69-437d-9119-840aca52da98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.389542 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb20b5-4b69-437d-9119-840aca52da98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:26.397480 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-d1cb20b5-4b69-437d-9119-840aca52da98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:26.405444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 246/491] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:26.406673 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb20b5-4b69-437d-9119-840aca52da98 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:26.426473 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa303431-51ea-4cdc-9f43-ebde741dc55b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:26.462176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5c888-d511-4d88-b3d6-2e0ca2815def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:26.462969 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5c888-d511-4d88-b3d6-2e0ca2815def None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.463321 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5c888-d511-4d88-b3d6-2e0ca2815def None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.463507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5c888-d511-4d88-b3d6-2e0ca2815def None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.474113 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5c888-d511-4d88-b3d6-2e0ca2815def None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:26.476169 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5c888-d511-4d88-b3d6-2e0ca2815def None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:26.493174 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-adf5c888-d511-4d88-b3d6-2e0ca2815def None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:26.494796 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 246/492] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:26.495647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5c888-d511-4d88-b3d6-2e0ca2815def None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:26.511745 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb20b5-4b69-437d-9119-840aca52da98 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:26.546616 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5651d6e-72b4-479e-aecb-94fe18034d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:26.548138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5651d6e-72b4-479e-aecb-94fe18034d20 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.548655 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5651d6e-72b4-479e-aecb-94fe18034d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.549322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5651d6e-72b4-479e-aecb-94fe18034d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.564145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5651d6e-72b4-479e-aecb-94fe18034d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:26.566814 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5651d6e-72b4-479e-aecb-94fe18034d20 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:26.589391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-c5651d6e-72b4-479e-aecb-94fe18034d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:26.591680 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 247/493] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:26.593784 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5651d6e-72b4-479e-aecb-94fe18034d20 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:26.595608 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5c888-d511-4d88-b3d6-2e0ca2815def None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:26.629757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e661a27-4139-4f4a-80a2-d8f1e5f7e60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:26.630422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e661a27-4139-4f4a-80a2-d8f1e5f7e60a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.630702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e661a27-4139-4f4a-80a2-d8f1e5f7e60a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.630975 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e661a27-4139-4f4a-80a2-d8f1e5f7e60a None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.632085 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e661a27-4139-4f4a-80a2-d8f1e5f7e60a None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:26.632085 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e661a27-4139-4f4a-80a2-d8f1e5f7e60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:26.633560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e661a27-4139-4f4a-80a2-d8f1e5f7e60a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:26.646472 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 247/494] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:26.646472 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e661a27-4139-4f4a-80a2-d8f1e5f7e60a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:26.704317 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5651d6e-72b4-479e-aecb-94fe18034d20 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:26.739768 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb130db9-cd28-4bb0-952e-7dfa61d43fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:26.740521 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb130db9-cd28-4bb0-952e-7dfa61d43fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.740807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb130db9-cd28-4bb0-952e-7dfa61d43fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.741097 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb130db9-cd28-4bb0-952e-7dfa61d43fb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.741857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb130db9-cd28-4bb0-952e-7dfa61d43fb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:26.742191 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb130db9-cd28-4bb0-952e-7dfa61d43fb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:26.743525 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb130db9-cd28-4bb0-952e-7dfa61d43fb7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:26.743945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e661a27-4139-4f4a-80a2-d8f1e5f7e60a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:26.755344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 248/495] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:26.764971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb130db9-cd28-4bb0-952e-7dfa61d43fb7 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:26.778450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f2552-8203-4f4e-a03f-f0015176f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:26.779114 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f2552-8203-4f4e-a03f-f0015176f474 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.779394 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f2552-8203-4f4e-a03f-f0015176f474 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.779666 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f2552-8203-4f4e-a03f-f0015176f474 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.780381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f2552-8203-4f4e-a03f-f0015176f474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:26.780684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f2552-8203-4f4e-a03f-f0015176f474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:26.782127 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f2552-8203-4f4e-a03f-f0015176f474 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:26.794265 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 248/496] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:26.795557 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c920cb2-84b3-4dfc-ab8f-5176ea9864c6 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.795846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c920cb2-84b3-4dfc-ab8f-5176ea9864c6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.796122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c920cb2-84b3-4dfc-ab8f-5176ea9864c6 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.801334 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 249/497] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:26.801334 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c920cb2-84b3-4dfc-ab8f-5176ea9864c6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:26.852829 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb130db9-cd28-4bb0-952e-7dfa61d43fb7 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:26.884556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d97c6-7dde-4439-b8f5-7276eab8b5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:26.885377 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d97c6-7dde-4439-b8f5-7276eab8b5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.885657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d97c6-7dde-4439-b8f5-7276eab8b5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.885928 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d97c6-7dde-4439-b8f5-7276eab8b5f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.892215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c920cb2-84b3-4dfc-ab8f-5176ea9864c6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:26.895555 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d97c6-7dde-4439-b8f5-7276eab8b5f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:26.897008 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d97c6-7dde-4439-b8f5-7276eab8b5f3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:26.914610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-fb4d97c6-7dde-4439-b8f5-7276eab8b5f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:26.915943 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 249/498] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:26.917124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eec98-5fa5-4c24-8865-f19d376b118c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.917415 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eec98-5fa5-4c24-8865-f19d376b118c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.917722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eec98-5fa5-4c24-8865-f19d376b118c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.918999 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 250/499] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:26.919690 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876eec98-5fa5-4c24-8865-f19d376b118c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:26.927110 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e8614-2055-461a-acab-e18cffbd807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:26.927898 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e8614-2055-461a-acab-e18cffbd807d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.928178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e8614-2055-461a-acab-e18cffbd807d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.928449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e8614-2055-461a-acab-e18cffbd807d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.936176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e8614-2055-461a-acab-e18cffbd807d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:26.938086 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e8614-2055-461a-acab-e18cffbd807d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:26.951376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-588e8614-2055-461a-acab-e18cffbd807d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 10:49:26.952541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 250/500] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Apr 6 10:49:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:26.953775 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c18d0b-6678-49b9-8d36-1a8e00e95062 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:26.954058 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c18d0b-6678-49b9-8d36-1a8e00e95062 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:26.954338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c18d0b-6678-49b9-8d36-1a8e00e95062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:26.969926 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c4c18d0b-6678-49b9-8d36-1a8e00e95062 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:26.971096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c4c18d0b-6678-49b9-8d36-1a8e00e95062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:27.015863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876eec98-5fa5-4c24-8865-f19d376b118c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:27.033690 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 251/501] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:27.034499 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c18d0b-6678-49b9-8d36-1a8e00e95062 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:27.054699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d0273-7e4d-4a25-87f3-532f367a6f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:27.055503 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d0273-7e4d-4a25-87f3-532f367a6f64 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:27.055785 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d0273-7e4d-4a25-87f3-532f367a6f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:27.056058 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d0273-7e4d-4a25-87f3-532f367a6f64 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:27.063643 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d0273-7e4d-4a25-87f3-532f367a6f64 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:27.065119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d0273-7e4d-4a25-87f3-532f367a6f64 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:27.078577 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-845d0273-7e4d-4a25-87f3-532f367a6f64 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 06 10:49:27.079750 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 251/502] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:27.080909 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48914d-7d11-4b48-bdba-b30be92a53d0 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:27.081227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48914d-7d11-4b48-bdba-b30be92a53d0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:27.081504 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48914d-7d11-4b48-bdba-b30be92a53d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:27.097351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5f48914d-7d11-4b48-bdba-b30be92a53d0 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:27.098542 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5f48914d-7d11-4b48-bdba-b30be92a53d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:27.128808 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c18d0b-6678-49b9-8d36-1a8e00e95062 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:27.160527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec03cac-21df-49c2-8b58-26faa18e0ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:27.160684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 252/503] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:27.161217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec03cac-21df-49c2-8b58-26faa18e0ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:27.161472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48914d-7d11-4b48-bdba-b30be92a53d0 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:27.161590 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec03cac-21df-49c2-8b58-26faa18e0ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:27.161764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec03cac-21df-49c2-8b58-26faa18e0ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:27.162519 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec03cac-21df-49c2-8b58-26faa18e0ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:27.162821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec03cac-21df-49c2-8b58-26faa18e0ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:27.164807 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec03cac-21df-49c2-8b58-26faa18e0ae9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:27.180000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 252/504] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:27.180000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec03cac-21df-49c2-8b58-26faa18e0ae9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:27.260753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48914d-7d11-4b48-bdba-b30be92a53d0 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:27.272139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec03cac-21df-49c2-8b58-26faa18e0ae9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:27.291939 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1056cf-5887-455e-9b32-0416228e640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:27.292612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1056cf-5887-455e-9b32-0416228e640a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:27.292899 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1056cf-5887-455e-9b32-0416228e640a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:27.293211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1056cf-5887-455e-9b32-0416228e640a None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:27.294029 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1056cf-5887-455e-9b32-0416228e640a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:27.294338 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1056cf-5887-455e-9b32-0416228e640a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:27.295773 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1056cf-5887-455e-9b32-0416228e640a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:27.302653 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbb0d7-6fcd-4342-a4b1-f31bb7d45a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:27.303438 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbb0d7-6fcd-4342-a4b1-f31bb7d45a42 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:27.304249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbb0d7-6fcd-4342-a4b1-f31bb7d45a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:27.304524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbb0d7-6fcd-4342-a4b1-f31bb7d45a42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:27.314438 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecbb0d7-6fcd-4342-a4b1-f31bb7d45a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:27.321926 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-aecbb0d7-6fcd-4342-a4b1-f31bb7d45a42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:27.323109 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 253/505] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:27.323869 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbb0d7-6fcd-4342-a4b1-f31bb7d45a42 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:27.332548 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 253/506] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Apr 6 10:49:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:27.333339 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1056cf-5887-455e-9b32-0416228e640a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:27.417838 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbb0d7-6fcd-4342-a4b1-f31bb7d45a42 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:27.426689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1056cf-5887-455e-9b32-0416228e640a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:27.450468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe3905-ecee-4bd2-b945-d276ee202a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:27.451130 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe3905-ecee-4bd2-b945-d276ee202a1d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:27.451412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe3905-ecee-4bd2-b945-d276ee202a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:27.451685 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe3905-ecee-4bd2-b945-d276ee202a1d None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:27.452506 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe3905-ecee-4bd2-b945-d276ee202a1d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:27.452815 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe3905-ecee-4bd2-b945-d276ee202a1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:27.454361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe3905-ecee-4bd2-b945-d276ee202a1d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:27.458214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33f07d-db89-46fd-9ffa-18df97de50ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:27.459001 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f07d-db89-46fd-9ffa-18df97de50ac None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:27.459285 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f07d-db89-46fd-9ffa-18df97de50ac None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:27.459560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f07d-db89-46fd-9ffa-18df97de50ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:27.466854 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33f07d-db89-46fd-9ffa-18df97de50ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:27.468293 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33f07d-db89-46fd-9ffa-18df97de50ac None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:27.482594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-6b33f07d-db89-46fd-9ffa-18df97de50ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 06 10:49:27.483780 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 254/507] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:27.484546 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33f07d-db89-46fd-9ffa-18df97de50ac None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:27.496055 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 254/508] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Apr 6 10:49:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:27.496894 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe3905-ecee-4bd2-b945-d276ee202a1d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:27.578714 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33f07d-db89-46fd-9ffa-18df97de50ac None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:27.589491 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe3905-ecee-4bd2-b945-d276ee202a1d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:27.609859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000d8a8-78f0-4194-bdd0-6888b2c3fcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:27.610649 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000d8a8-78f0-4194-bdd0-6888b2c3fcff None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:27.610929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000d8a8-78f0-4194-bdd0-6888b2c3fcff None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:27.611203 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000d8a8-78f0-4194-bdd0-6888b2c3fcff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:27.620568 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f6e4-c21b-4418-b2f6-781981b39ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:27.621251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f6e4-c21b-4418-b2f6-781981b39ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:27.621439 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000d8a8-78f0-4194-bdd0-6888b2c3fcff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:27.621551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f6e4-c21b-4418-b2f6-781981b39ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:27.621789 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f6e4-c21b-4418-b2f6-781981b39ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:27.622520 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476f6e4-c21b-4418-b2f6-781981b39ff0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:27.622827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476f6e4-c21b-4418-b2f6-781981b39ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:27.622912 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000d8a8-78f0-4194-bdd0-6888b2c3fcff None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:27.624225 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476f6e4-c21b-4418-b2f6-781981b39ff0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:27.632320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 255/509] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:27.637046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f6e4-c21b-4418-b2f6-781981b39ff0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:27.639472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-0000d8a8-78f0-4194-bdd0-6888b2c3fcff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:27.640662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 255/510] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:27.641453 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000d8a8-78f0-4194-bdd0-6888b2c3fcff None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:27.729751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f6e4-c21b-4418-b2f6-781981b39ff0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:27.735302 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000d8a8-78f0-4194-bdd0-6888b2c3fcff None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:27.760856 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c674756-63a6-4120-9a26-0d08b2dc1dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:27.764300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c674756-63a6-4120-9a26-0d08b2dc1dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:27.764300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c674756-63a6-4120-9a26-0d08b2dc1dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:27.764300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c674756-63a6-4120-9a26-0d08b2dc1dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:27.766879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2616e-9ec5-48c9-8177-ec6cf66e7ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:27.767537 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2616e-9ec5-48c9-8177-ec6cf66e7ced None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:27.767820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2616e-9ec5-48c9-8177-ec6cf66e7ced None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:27.768089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2616e-9ec5-48c9-8177-ec6cf66e7ced None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:27.768908 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2616e-9ec5-48c9-8177-ec6cf66e7ced None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:27.769242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2616e-9ec5-48c9-8177-ec6cf66e7ced None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:27.770707 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2616e-9ec5-48c9-8177-ec6cf66e7ced None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:27.787936 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 256/511] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Apr 6 10:49:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:27.788843 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2616e-9ec5-48c9-8177-ec6cf66e7ced None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:27.830801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c674756-63a6-4120-9a26-0d08b2dc1dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:27.832215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c674756-63a6-4120-9a26-0d08b2dc1dc8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:27.881203 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2616e-9ec5-48c9-8177-ec6cf66e7ced None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:27.913892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edbcaf-820c-437b-8238-92e5d11b7d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:27.914526 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edbcaf-820c-437b-8238-92e5d11b7d07 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:27.914809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edbcaf-820c-437b-8238-92e5d11b7d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:27.915083 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edbcaf-820c-437b-8238-92e5d11b7d07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:27.922533 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 256/512] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:27.923341 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c674756-63a6-4120-9a26-0d08b2dc1dc8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:27.982087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edbcaf-820c-437b-8238-92e5d11b7d07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:27.983528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edbcaf-820c-437b-8238-92e5d11b7d07 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:28.013726 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c674756-63a6-4120-9a26-0d08b2dc1dc8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:28.045750 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f13bf-8c4a-4daf-92d5-20dfd3ba852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:28.046527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f13bf-8c4a-4daf-92d5-20dfd3ba852f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:28.046802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f13bf-8c4a-4daf-92d5-20dfd3ba852f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:28.047072 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f13bf-8c4a-4daf-92d5-20dfd3ba852f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:28.056493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f13bf-8c4a-4daf-92d5-20dfd3ba852f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:28.058028 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f13bf-8c4a-4daf-92d5-20dfd3ba852f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:28.074284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-5f1f13bf-8c4a-4daf-92d5-20dfd3ba852f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:28.074479 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 257/513] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:28.075538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edbcaf-820c-437b-8238-92e5d11b7d07 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:28.075700 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 257/514] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:28.076484 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f13bf-8c4a-4daf-92d5-20dfd3ba852f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:28.172650 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edbcaf-820c-437b-8238-92e5d11b7d07 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:28.173474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f13bf-8c4a-4daf-92d5-20dfd3ba852f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:28.204456 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0d51d-03c4-44ae-81a4-260e71fa8bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:28.204612 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae34f6-406b-4740-8f42-e2e0ce72b4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:28.205134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0d51d-03c4-44ae-81a4-260e71fa8bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:28.205257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae34f6-406b-4740-8f42-e2e0ce72b4bb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:28.205416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0d51d-03c4-44ae-81a4-260e71fa8bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:28.205504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae34f6-406b-4740-8f42-e2e0ce72b4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:28.205685 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0d51d-03c4-44ae-81a4-260e71fa8bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:28.205771 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae34f6-406b-4740-8f42-e2e0ce72b4bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:28.206390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0d51d-03c4-44ae-81a4-260e71fa8bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:28.206689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0d51d-03c4-44ae-81a4-260e71fa8bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:28.208026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0d51d-03c4-44ae-81a4-260e71fa8bb9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:28.219442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 258/515] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:28.220215 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0d51d-03c4-44ae-81a4-260e71fa8bb9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:28.269355 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae34f6-406b-4740-8f42-e2e0ce72b4bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:28.270837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae34f6-406b-4740-8f42-e2e0ce72b4bb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:28.316028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0d51d-03c4-44ae-81a4-260e71fa8bb9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:28.348430 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799c8d5-473f-4326-9cb0-cc85a1244a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:28.349251 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799c8d5-473f-4326-9cb0-cc85a1244a92 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:28.349530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799c8d5-473f-4326-9cb0-cc85a1244a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:28.349803 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799c8d5-473f-4326-9cb0-cc85a1244a92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:28.364005 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799c8d5-473f-4326-9cb0-cc85a1244a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:28.366596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799c8d5-473f-4326-9cb0-cc85a1244a92 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:28.371949 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 258/516] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:28.371949 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae34f6-406b-4740-8f42-e2e0ce72b4bb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:28.395330 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-2799c8d5-473f-4326-9cb0-cc85a1244a92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:28.397337 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 259/517] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:28.399032 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799c8d5-473f-4326-9cb0-cc85a1244a92 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:28.464486 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae34f6-406b-4740-8f42-e2e0ce72b4bb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:28.495405 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe25f1a-14a5-436e-b604-857bffd13c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:28.496182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe25f1a-14a5-436e-b604-857bffd13c56 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:28.496460 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe25f1a-14a5-436e-b604-857bffd13c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:28.496735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe25f1a-14a5-436e-b604-857bffd13c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:28.497965 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799c8d5-473f-4326-9cb0-cc85a1244a92 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:28.506204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe25f1a-14a5-436e-b604-857bffd13c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:28.508191 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe25f1a-14a5-436e-b604-857bffd13c56 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:28.525701 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-bbe25f1a-14a5-436e-b604-857bffd13c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:28.527052 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 259/518] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:28.527711 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe25f1a-14a5-436e-b604-857bffd13c56 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:28.532210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab7b35-dcc4-4d2c-89d7-5671911f5df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:28.532880 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7b35-dcc4-4d2c-89d7-5671911f5df1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:28.533204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7b35-dcc4-4d2c-89d7-5671911f5df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:28.533479 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7b35-dcc4-4d2c-89d7-5671911f5df1 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:28.534202 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab7b35-dcc4-4d2c-89d7-5671911f5df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:28.534508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab7b35-dcc4-4d2c-89d7-5671911f5df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:28.535870 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab7b35-dcc4-4d2c-89d7-5671911f5df1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:28.547492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 260/519] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:28.548277 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab7b35-dcc4-4d2c-89d7-5671911f5df1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:28.625352 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe25f1a-14a5-436e-b604-857bffd13c56 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:28.640884 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab7b35-dcc4-4d2c-89d7-5671911f5df1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:28.657238 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9322ea-d4dd-4ebf-bb08-46b3dded8631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:28.657900 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9322ea-d4dd-4ebf-bb08-46b3dded8631 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:28.658176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9322ea-d4dd-4ebf-bb08-46b3dded8631 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:28.658447 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9322ea-d4dd-4ebf-bb08-46b3dded8631 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:28.659136 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9322ea-d4dd-4ebf-bb08-46b3dded8631 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:28.660626 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9322ea-d4dd-4ebf-bb08-46b3dded8631 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:28.674307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a991e93-ad19-4a97-a165-34d95a1e883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:28.675105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a991e93-ad19-4a97-a165-34d95a1e883b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:28.675415 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a991e93-ad19-4a97-a165-34d95a1e883b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:28.675684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a991e93-ad19-4a97-a165-34d95a1e883b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:28.685403 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a991e93-ad19-4a97-a165-34d95a1e883b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:28.686877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a991e93-ad19-4a97-a165-34d95a1e883b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:28.704302 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-3a991e93-ad19-4a97-a165-34d95a1e883b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:28.705484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 261/520] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:28.706241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a991e93-ad19-4a97-a165-34d95a1e883b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:28.766802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 260/521] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:49:28 2022] POST /identity/v3/users => generated 247 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:49:28.767631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9322ea-d4dd-4ebf-bb08-46b3dded8631 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:28.805808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a991e93-ad19-4a97-a165-34d95a1e883b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:28.843006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e078695-768f-4dd7-a51d-bd3a6c029a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:28.843689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e078695-768f-4dd7-a51d-bd3a6c029a67 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:28.843979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e078695-768f-4dd7-a51d-bd3a6c029a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:28.844259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e078695-768f-4dd7-a51d-bd3a6c029a67 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:28.844997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e078695-768f-4dd7-a51d-bd3a6c029a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:28.845340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e078695-768f-4dd7-a51d-bd3a6c029a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:28.846771 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e078695-768f-4dd7-a51d-bd3a6c029a67 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:28.864481 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 262/522] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:28.865337 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e078695-768f-4dd7-a51d-bd3a6c029a67 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:28.880904 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9322ea-d4dd-4ebf-bb08-46b3dded8631 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:28.916066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5796cf4-e7a5-4232-911f-9e07765b20af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:28.916738 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5796cf4-e7a5-4232-911f-9e07765b20af None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:28.917018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5796cf4-e7a5-4232-911f-9e07765b20af None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:28.917321 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5796cf4-e7a5-4232-911f-9e07765b20af None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:28.918056 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5796cf4-e7a5-4232-911f-9e07765b20af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:28.918364 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5796cf4-e7a5-4232-911f-9e07765b20af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:28.919843 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5796cf4-e7a5-4232-911f-9e07765b20af None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:28.932927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 261/523] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:28.933854 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5796cf4-e7a5-4232-911f-9e07765b20af None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:28.979382 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e078695-768f-4dd7-a51d-bd3a6c029a67 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:29.018261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803204b-e51d-4385-8992-91836d0e8482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:29.019130 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803204b-e51d-4385-8992-91836d0e8482 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:29.019510 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803204b-e51d-4385-8992-91836d0e8482 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:29.019788 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803204b-e51d-4385-8992-91836d0e8482 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:29.028150 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803204b-e51d-4385-8992-91836d0e8482 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:29.029613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803204b-e51d-4385-8992-91836d0e8482 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:29.040304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5796cf4-e7a5-4232-911f-9e07765b20af None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:29.042979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-a803204b-e51d-4385-8992-91836d0e8482 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 06 10:49:29.044485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 263/524] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:29.049025 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803204b-e51d-4385-8992-91836d0e8482 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:29.075767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba027b50-12fb-4247-934b-40a4a8b691d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:29.076426 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba027b50-12fb-4247-934b-40a4a8b691d0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:29.076710 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba027b50-12fb-4247-934b-40a4a8b691d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:29.076983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba027b50-12fb-4247-934b-40a4a8b691d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:29.077835 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba027b50-12fb-4247-934b-40a4a8b691d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:29.078143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba027b50-12fb-4247-934b-40a4a8b691d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:29.079545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba027b50-12fb-4247-934b-40a4a8b691d0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:29.095325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 262/525] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:29.095325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba027b50-12fb-4247-934b-40a4a8b691d0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:29.153987 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803204b-e51d-4385-8992-91836d0e8482 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:29.188005 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6613de-ff33-4c62-a5ec-34f80f6afe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:29.188745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba027b50-12fb-4247-934b-40a4a8b691d0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:29.188850 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6613de-ff33-4c62-a5ec-34f80f6afe10 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:29.189101 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6613de-ff33-4c62-a5ec-34f80f6afe10 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:29.189384 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6613de-ff33-4c62-a5ec-34f80f6afe10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:29.195990 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6613de-ff33-4c62-a5ec-34f80f6afe10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:29.197475 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6613de-ff33-4c62-a5ec-34f80f6afe10 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:29.210924 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-5a6613de-ff33-4c62-a5ec-34f80f6afe10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:29.216777 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 264/526] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:29.217641 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6613de-ff33-4c62-a5ec-34f80f6afe10 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:29.220675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f7d64-47ff-447e-a5b4-52558d9ef548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:29.221494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f7d64-47ff-447e-a5b4-52558d9ef548 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:29.221826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f7d64-47ff-447e-a5b4-52558d9ef548 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:29.222101 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f7d64-47ff-447e-a5b4-52558d9ef548 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:29.229136 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f7d64-47ff-447e-a5b4-52558d9ef548 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:29.230611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f7d64-47ff-447e-a5b4-52558d9ef548 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:29.244578 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-016f7d64-47ff-447e-a5b4-52558d9ef548 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:29.245904 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 263/527] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:29.246508 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f7d64-47ff-447e-a5b4-52558d9ef548 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:29.317918 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6613de-ff33-4c62-a5ec-34f80f6afe10 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:29.344328 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f7d64-47ff-447e-a5b4-52558d9ef548 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:29.350323 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9b645-8966-45eb-8d53-9f19ec55d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:29.351539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9b645-8966-45eb-8d53-9f19ec55d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:29.351831 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9b645-8966-45eb-8d53-9f19ec55d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:29.352105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9b645-8966-45eb-8d53-9f19ec55d0e7 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:29.352934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9b645-8966-45eb-8d53-9f19ec55d0e7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:29.353282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9b645-8966-45eb-8d53-9f19ec55d0e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:29.354737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9b645-8966-45eb-8d53-9f19ec55d0e7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:29.371540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 265/528] 10.222.0.62 () {56 vars in 1139 bytes} [Wed Apr 6 10:49:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:29.372413 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9b645-8966-45eb-8d53-9f19ec55d0e7 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:29.381426 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18cd96-267a-410e-9bc8-652254e124b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:29.382265 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18cd96-267a-410e-9bc8-652254e124b4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:29.382546 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18cd96-267a-410e-9bc8-652254e124b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:29.382819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18cd96-267a-410e-9bc8-652254e124b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:29.389409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18cd96-267a-410e-9bc8-652254e124b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:29.390875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18cd96-267a-410e-9bc8-652254e124b4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:29.403990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-ec18cd96-267a-410e-9bc8-652254e124b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:29.405210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 264/529] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:29.405960 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18cd96-267a-410e-9bc8-652254e124b4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:29.476432 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9b645-8966-45eb-8d53-9f19ec55d0e7 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:29.503507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18cd96-267a-410e-9bc8-652254e124b4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:29.508580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb208b-de23-489d-be4d-3e640efc419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:29.509272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb208b-de23-489d-be4d-3e640efc419c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:29.509558 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb208b-de23-489d-be4d-3e640efc419c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:29.509832 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb208b-de23-489d-be4d-3e640efc419c None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:29.510615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb208b-de23-489d-be4d-3e640efc419c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:29.510923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb208b-de23-489d-be4d-3e640efc419c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:29.512369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb208b-de23-489d-be4d-3e640efc419c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:29.534694 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 266/530] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:29.534694 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb208b-de23-489d-be4d-3e640efc419c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:29.537954 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8ac7c-0eb9-456d-812f-820d3080c573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:29.539214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8ac7c-0eb9-456d-812f-820d3080c573 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:29.539457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8ac7c-0eb9-456d-812f-820d3080c573 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:29.539736 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8ac7c-0eb9-456d-812f-820d3080c573 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:29.540516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8ac7c-0eb9-456d-812f-820d3080c573 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:29.540828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8ac7c-0eb9-456d-812f-820d3080c573 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:29.542343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8ac7c-0eb9-456d-812f-820d3080c573 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:29.565734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 265/531] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:29.565734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8ac7c-0eb9-456d-812f-820d3080c573 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:29.643865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb208b-de23-489d-be4d-3e640efc419c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:29.661423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8ac7c-0eb9-456d-812f-820d3080c573 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:29.677031 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398ef5c-d0ed-44b9-be75-1db388b4091b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:29.677747 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398ef5c-d0ed-44b9-be75-1db388b4091b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:29.677996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398ef5c-d0ed-44b9-be75-1db388b4091b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:29.678271 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398ef5c-d0ed-44b9-be75-1db388b4091b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:29.696297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf392ad-04d5-4740-b9f0-244b8aa11c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:29.696950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf392ad-04d5-4740-b9f0-244b8aa11c20 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:29.697287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf392ad-04d5-4740-b9f0-244b8aa11c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:29.697560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf392ad-04d5-4740-b9f0-244b8aa11c20 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:29.698329 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf392ad-04d5-4740-b9f0-244b8aa11c20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:29.698686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf392ad-04d5-4740-b9f0-244b8aa11c20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:29.700213 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf392ad-04d5-4740-b9f0-244b8aa11c20 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:29.711474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 266/532] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:29.712264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf392ad-04d5-4740-b9f0-244b8aa11c20 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:29.747378 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398ef5c-d0ed-44b9-be75-1db388b4091b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:29.748821 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398ef5c-d0ed-44b9-be75-1db388b4091b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:29.811264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf392ad-04d5-4740-b9f0-244b8aa11c20 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:29.846366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 267/533] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:29.846366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398ef5c-d0ed-44b9-be75-1db388b4091b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:29.848150 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e13a1-72bf-49c9-8caa-fe01c6350445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:29.848823 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e13a1-72bf-49c9-8caa-fe01c6350445 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:29.849128 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e13a1-72bf-49c9-8caa-fe01c6350445 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:29.849407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e13a1-72bf-49c9-8caa-fe01c6350445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:29.850242 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e13a1-72bf-49c9-8caa-fe01c6350445 None admin] RBAC: Adding query filter params (role.id=07e6d0f9bf5345c99ce158cd3e62c1c5, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=650c5809116e4bcd808044236c06dcc2) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:29.851078 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e13a1-72bf-49c9-8caa-fe01c6350445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:29.853002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e13a1-72bf-49c9-8caa-fe01c6350445 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:29.869105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 267/534] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:49:29 2022] GET /identity/v3/role_assignments?user.id=650c5809116e4bcd808044236c06dcc2&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:29.869105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e13a1-72bf-49c9-8caa-fe01c6350445 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:29.977111 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398ef5c-d0ed-44b9-be75-1db388b4091b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:29.978353 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e13a1-72bf-49c9-8caa-fe01c6350445 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:30.017262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03801d-b476-4343-b5e9-bd1a115bf227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:30.017481 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40a9de-adf8-468f-abfa-11b3ea5e2095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:30.018091 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03801d-b476-4343-b5e9-bd1a115bf227 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:30.018195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a9de-adf8-468f-abfa-11b3ea5e2095 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:30.018493 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a9de-adf8-468f-abfa-11b3ea5e2095 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:30.018589 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03801d-b476-4343-b5e9-bd1a115bf227 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:30.018884 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a9de-adf8-468f-abfa-11b3ea5e2095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:30.018980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03801d-b476-4343-b5e9-bd1a115bf227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:30.019856 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03801d-b476-4343-b5e9-bd1a115bf227 None admin] RBAC: Adding query filter params (role.id=07e6d0f9bf5345c99ce158cd3e62c1c5, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=5d07bf80c4f741e68d14665b092edcff) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:30.019957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40a9de-adf8-468f-abfa-11b3ea5e2095 None admin] RBAC: Adding query filter params (role.id=07e6d0f9bf5345c99ce158cd3e62c1c5, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=42cd381cf5c745de9dac8f77a8cea554) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:30.020281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40a9de-adf8-468f-abfa-11b3ea5e2095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:30.020377 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03801d-b476-4343-b5e9-bd1a115bf227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:30.021906 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40a9de-adf8-468f-abfa-11b3ea5e2095 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:30.022056 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03801d-b476-4343-b5e9-bd1a115bf227 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:30.029317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 268/535] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:49:29 2022] GET /identity/v3/role_assignments?user.id=5d07bf80c4f741e68d14665b092edcff&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:30.030342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03801d-b476-4343-b5e9-bd1a115bf227 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:30.039822 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 268/536] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:49:29 2022] GET /identity/v3/role_assignments?user.id=42cd381cf5c745de9dac8f77a8cea554&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:30.165907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03801d-b476-4343-b5e9-bd1a115bf227 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:30.214119 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ff412-5b09-4195-b21e-4db7d06d909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:30.214942 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ff412-5b09-4195-b21e-4db7d06d909f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:30.215219 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ff412-5b09-4195-b21e-4db7d06d909f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:30.215489 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ff412-5b09-4195-b21e-4db7d06d909f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:30.231334 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ff412-5b09-4195-b21e-4db7d06d909f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:30.232844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ff412-5b09-4195-b21e-4db7d06d909f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:30.256685 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-e70ff412-5b09-4195-b21e-4db7d06d909f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:30.258540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 269/537] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:30.264455 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40a9de-adf8-468f-abfa-11b3ea5e2095 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:30.379591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40a9de-adf8-468f-abfa-11b3ea5e2095 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:30.414167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccbb85-4674-455a-80ad-9992b7c09985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:30.414897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccbb85-4674-455a-80ad-9992b7c09985 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:30.415178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccbb85-4674-455a-80ad-9992b7c09985 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:30.415453 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccbb85-4674-455a-80ad-9992b7c09985 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:30.416174 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccbb85-4674-455a-80ad-9992b7c09985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:30.416482 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccbb85-4674-455a-80ad-9992b7c09985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:30.417964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccbb85-4674-455a-80ad-9992b7c09985 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:30.430165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 269/538] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:30.435266 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ff412-5b09-4195-b21e-4db7d06d909f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:30.544412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ff412-5b09-4195-b21e-4db7d06d909f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:30.589809 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f743b-86f5-4a14-915b-54af8390bdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:30.590598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f743b-86f5-4a14-915b-54af8390bdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:30.590878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f743b-86f5-4a14-915b-54af8390bdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:30.591151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f743b-86f5-4a14-915b-54af8390bdd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:30.598286 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f743b-86f5-4a14-915b-54af8390bdd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:30.599862 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f743b-86f5-4a14-915b-54af8390bdd6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:30.615453 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-634f743b-86f5-4a14-915b-54af8390bdd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:30.617574 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 270/539] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:30.625045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccbb85-4674-455a-80ad-9992b7c09985 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:30.764861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccbb85-4674-455a-80ad-9992b7c09985 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:30.806874 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bb87f-36bf-47de-b6cb-936247cdcedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:30.807472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bb87f-36bf-47de-b6cb-936247cdcedf None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:30.807754 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bb87f-36bf-47de-b6cb-936247cdcedf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:30.808033 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bb87f-36bf-47de-b6cb-936247cdcedf None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:30.808908 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bb87f-36bf-47de-b6cb-936247cdcedf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:30.809166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bb87f-36bf-47de-b6cb-936247cdcedf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:30.810768 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bb87f-36bf-47de-b6cb-936247cdcedf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:30.835399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 270/540] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:30.842140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f743b-86f5-4a14-915b-54af8390bdd6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:30.956660 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f743b-86f5-4a14-915b-54af8390bdd6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:30.994049 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565afc8-6aea-47f3-aead-6c6b3719b8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:30.994707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565afc8-6aea-47f3-aead-6c6b3719b8bc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:30.994982 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565afc8-6aea-47f3-aead-6c6b3719b8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:30.995249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565afc8-6aea-47f3-aead-6c6b3719b8bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:30.996068 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565afc8-6aea-47f3-aead-6c6b3719b8bc None admin] RBAC: Adding query filter params (role.id=07e6d0f9bf5345c99ce158cd3e62c1c5, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=e078c6efaf054f7489f7164fdafce714) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:30.996374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565afc8-6aea-47f3-aead-6c6b3719b8bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:30.997878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565afc8-6aea-47f3-aead-6c6b3719b8bc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:31.003847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 271/541] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:49:30 2022] GET /identity/v3/role_assignments?user.id=e078c6efaf054f7489f7164fdafce714&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:31.246146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d92e6-0f4e-4fdf-b12e-8c4fc0f21243 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:31.246662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d92e6-0f4e-4fdf-b12e-8c4fc0f21243 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:31.246662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d92e6-0f4e-4fdf-b12e-8c4fc0f21243 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:31.248270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 271/542] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:31.253687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562c2ac-1baa-45e9-9f57-a01dc03144c7 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:31.253972 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562c2ac-1baa-45e9-9f57-a01dc03144c7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:31.254248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562c2ac-1baa-45e9-9f57-a01dc03144c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:31.270933 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5562c2ac-1baa-45e9-9f57-a01dc03144c7 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:31.272102 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5562c2ac-1baa-45e9-9f57-a01dc03144c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:31.340751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 272/543] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:31.365170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d92e6-0f4e-4fdf-b12e-8c4fc0f21243 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:31.468980 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d92e6-0f4e-4fdf-b12e-8c4fc0f21243 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:31.507675 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8698bf-b3bf-481e-adba-89c6a113b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:31.508444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8698bf-b3bf-481e-adba-89c6a113b86d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:31.508722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8698bf-b3bf-481e-adba-89c6a113b86d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:31.508994 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8698bf-b3bf-481e-adba-89c6a113b86d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:31.519722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8698bf-b3bf-481e-adba-89c6a113b86d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:31.527651 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-6a8698bf-b3bf-481e-adba-89c6a113b86d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:31.529277 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 272/544] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:31.535339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562c2ac-1baa-45e9-9f57-a01dc03144c7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:31.652839 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562c2ac-1baa-45e9-9f57-a01dc03144c7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:31.684247 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152e79e-ed70-4b5a-92ab-d1aaf9bd6d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:31.685069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e79e-ed70-4b5a-92ab-d1aaf9bd6d04 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:31.685506 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e79e-ed70-4b5a-92ab-d1aaf9bd6d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:31.685869 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e79e-ed70-4b5a-92ab-d1aaf9bd6d04 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:31.686778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152e79e-ed70-4b5a-92ab-d1aaf9bd6d04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:31.687434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152e79e-ed70-4b5a-92ab-d1aaf9bd6d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:31.688952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152e79e-ed70-4b5a-92ab-d1aaf9bd6d04 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:31.698922 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 273/545] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:31.704961 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8698bf-b3bf-481e-adba-89c6a113b86d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:31.804421 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8698bf-b3bf-481e-adba-89c6a113b86d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:31.838197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fff988-9f43-4f56-9b18-798ed4aec768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:31.838995 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fff988-9f43-4f56-9b18-798ed4aec768 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:31.839272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fff988-9f43-4f56-9b18-798ed4aec768 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:31.839599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fff988-9f43-4f56-9b18-798ed4aec768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:31.850208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fff988-9f43-4f56-9b18-798ed4aec768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:31.852291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fff988-9f43-4f56-9b18-798ed4aec768 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:31.868386 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-41fff988-9f43-4f56-9b18-798ed4aec768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:31.869880 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 273/546] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:31.875439 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152e79e-ed70-4b5a-92ab-d1aaf9bd6d04 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:31.996897 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152e79e-ed70-4b5a-92ab-d1aaf9bd6d04 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:32.040182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414036a-aeb8-4b7e-92c7-4a25735ca1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:32.040837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414036a-aeb8-4b7e-92c7-4a25735ca1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:32.041133 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414036a-aeb8-4b7e-92c7-4a25735ca1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:32.041406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414036a-aeb8-4b7e-92c7-4a25735ca1e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:32.042115 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414036a-aeb8-4b7e-92c7-4a25735ca1e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:32.042415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414036a-aeb8-4b7e-92c7-4a25735ca1e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:32.043816 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414036a-aeb8-4b7e-92c7-4a25735ca1e5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:32.060004 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 274/547] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:32.065622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fff988-9f43-4f56-9b18-798ed4aec768 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:32.168460 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fff988-9f43-4f56-9b18-798ed4aec768 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:32.202444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfcbf3-1346-431d-abb6-1359d4db42dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:32.203243 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfcbf3-1346-431d-abb6-1359d4db42dc None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:32.203522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfcbf3-1346-431d-abb6-1359d4db42dc None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:32.203791 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfcbf3-1346-431d-abb6-1359d4db42dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:32.211793 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfcbf3-1346-431d-abb6-1359d4db42dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:32.213258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfcbf3-1346-431d-abb6-1359d4db42dc None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:32.227446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-03cfcbf3-1346-431d-abb6-1359d4db42dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 10:49:32.228975 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 274/548] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:49:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:32.234521 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414036a-aeb8-4b7e-92c7-4a25735ca1e5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:32.340147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414036a-aeb8-4b7e-92c7-4a25735ca1e5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:32.374157 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832ccdb-3e60-4f25-9271-f5cb83f67abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:32.374823 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832ccdb-3e60-4f25-9271-f5cb83f67abf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:32.375099 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832ccdb-3e60-4f25-9271-f5cb83f67abf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:32.375416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832ccdb-3e60-4f25-9271-f5cb83f67abf None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:32.376301 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832ccdb-3e60-4f25-9271-f5cb83f67abf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:32.376607 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832ccdb-3e60-4f25-9271-f5cb83f67abf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:32.378092 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832ccdb-3e60-4f25-9271-f5cb83f67abf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:32.403456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 275/549] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Apr 6 10:49:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:32.409087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfcbf3-1346-431d-abb6-1359d4db42dc None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:32.519097 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfcbf3-1346-431d-abb6-1359d4db42dc None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:32.554423 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a8a12-7e56-421a-8dac-b95222b4db42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:32.555074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a8a12-7e56-421a-8dac-b95222b4db42 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:32.555348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a8a12-7e56-421a-8dac-b95222b4db42 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:32.555616 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a8a12-7e56-421a-8dac-b95222b4db42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:32.626190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a8a12-7e56-421a-8dac-b95222b4db42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:32.627638 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a8a12-7e56-421a-8dac-b95222b4db42 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:32.727515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 275/550] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:32.733116 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832ccdb-3e60-4f25-9271-f5cb83f67abf None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:32.906772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832ccdb-3e60-4f25-9271-f5cb83f67abf None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:32.946265 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a03c0-14c9-4a7b-b262-ab3d8b9776b3 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:32.946898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a03c0-14c9-4a7b-b262-ab3d8b9776b3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:32.947374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a03c0-14c9-4a7b-b262-ab3d8b9776b3 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:32.949248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 276/551] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:32.954456 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95c23d-bb87-4de8-8b81-0a45a164bcad None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:32.954965 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95c23d-bb87-4de8-8b81-0a45a164bcad None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:32.955442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95c23d-bb87-4de8-8b81-0a45a164bcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:32.958294 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44378243-2068-4555-9aa3-ad7430d46188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:32.959085 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44378243-2068-4555-9aa3-ad7430d46188 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:32.959412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44378243-2068-4555-9aa3-ad7430d46188 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:32.959687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44378243-2068-4555-9aa3-ad7430d46188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:32.969975 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44378243-2068-4555-9aa3-ad7430d46188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:32.972303 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44378243-2068-4555-9aa3-ad7430d46188 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:32.990565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-44378243-2068-4555-9aa3-ad7430d46188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:32.992772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 276/552] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:32.997233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-8b95c23d-bb87-4de8-8b81-0a45a164bcad None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:32.997233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8b95c23d-bb87-4de8-8b81-0a45a164bcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:32.998912 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44378243-2068-4555-9aa3-ad7430d46188 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:33.120251 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 277/553] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:33.157008 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44378243-2068-4555-9aa3-ad7430d46188 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:33.173154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95c23d-bb87-4de8-8b81-0a45a164bcad None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:33.213507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcb122-6ddd-4079-8d66-bbbe2e8547b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:33.214178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb122-6ddd-4079-8d66-bbbe2e8547b4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:33.214458 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb122-6ddd-4079-8d66-bbbe2e8547b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:33.214734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb122-6ddd-4079-8d66-bbbe2e8547b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:33.215462 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcb122-6ddd-4079-8d66-bbbe2e8547b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:33.215775 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcb122-6ddd-4079-8d66-bbbe2e8547b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:33.221259 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcb122-6ddd-4079-8d66-bbbe2e8547b4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:33.242519 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 277/554] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:33.247876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcb122-6ddd-4079-8d66-bbbe2e8547b4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:33.274323 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95c23d-bb87-4de8-8b81-0a45a164bcad None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:33.308526 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24167205-c7ad-4cd7-9a3d-cda05fa3f3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:33.309460 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24167205-c7ad-4cd7-9a3d-cda05fa3f3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:33.309792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24167205-c7ad-4cd7-9a3d-cda05fa3f3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:33.310065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24167205-c7ad-4cd7-9a3d-cda05fa3f3c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:33.320809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24167205-c7ad-4cd7-9a3d-cda05fa3f3c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:33.327762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-24167205-c7ad-4cd7-9a3d-cda05fa3f3c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:33.329149 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 278/555] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:33.330256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53d2f0-a8c5-4dd2-b8ba-8679ddcfc116 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:33.330535 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53d2f0-a8c5-4dd2-b8ba-8679ddcfc116 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:33.330804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53d2f0-a8c5-4dd2-b8ba-8679ddcfc116 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:33.332158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 279/556] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:33.336599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81aca5-1ae6-4dfe-9e6b-42f34a69d017 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:33.336599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81aca5-1ae6-4dfe-9e6b-42f34a69d017 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:33.336599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81aca5-1ae6-4dfe-9e6b-42f34a69d017 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:33.336599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 280/557] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:33.336599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81aca5-1ae6-4dfe-9e6b-42f34a69d017 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:33.358303 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcb122-6ddd-4079-8d66-bbbe2e8547b4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:33.390963 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f24b74-506b-40bc-9102-85f0746ccea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:33.391804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f24b74-506b-40bc-9102-85f0746ccea8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:33.392088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f24b74-506b-40bc-9102-85f0746ccea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:33.392360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f24b74-506b-40bc-9102-85f0746ccea8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:33.398959 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f24b74-506b-40bc-9102-85f0746ccea8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:33.400448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f24b74-506b-40bc-9102-85f0746ccea8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:33.414560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-d6f24b74-506b-40bc-9102-85f0746ccea8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:33.420227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 278/558] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:33.420227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fe3c8-6449-4872-a121-70352eccf195 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:33.420227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fe3c8-6449-4872-a121-70352eccf195 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:33.420227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fe3c8-6449-4872-a121-70352eccf195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:33.434313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b18fe3c8-6449-4872-a121-70352eccf195 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:33.435516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b18fe3c8-6449-4872-a121-70352eccf195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:33.444967 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81aca5-1ae6-4dfe-9e6b-42f34a69d017 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:33.479200 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47974abe-1cb6-4303-8007-b9bf932442c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:33.479873 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47974abe-1cb6-4303-8007-b9bf932442c7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:33.480160 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47974abe-1cb6-4303-8007-b9bf932442c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:33.481016 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47974abe-1cb6-4303-8007-b9bf932442c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:33.481899 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47974abe-1cb6-4303-8007-b9bf932442c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:33.482214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47974abe-1cb6-4303-8007-b9bf932442c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:33.483588 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47974abe-1cb6-4303-8007-b9bf932442c7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:33.491861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 281/559] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:33.493118 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a4039-6dee-4654-9270-4f8639b156c1 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:33.493412 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a4039-6dee-4654-9270-4f8639b156c1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:33.493690 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a4039-6dee-4654-9270-4f8639b156c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:33.510156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-2f9a4039-6dee-4654-9270-4f8639b156c1 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:33.511341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2f9a4039-6dee-4654-9270-4f8639b156c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:33.512524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 279/560] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:33.513652 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fe3c8-6449-4872-a121-70352eccf195 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:33.597215 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 282/561] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:33.597215 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a4039-6dee-4654-9270-4f8639b156c1 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:33.618845 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fe3c8-6449-4872-a121-70352eccf195 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:33.653786 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b6c42-034a-4fdb-a614-400059de0380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:33.654452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b6c42-034a-4fdb-a614-400059de0380 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:33.654729 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b6c42-034a-4fdb-a614-400059de0380 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:33.655000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b6c42-034a-4fdb-a614-400059de0380 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:33.655785 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b6c42-034a-4fdb-a614-400059de0380 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:33.656097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b6c42-034a-4fdb-a614-400059de0380 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:33.657636 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b6c42-034a-4fdb-a614-400059de0380 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:33.671613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 280/562] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:33.671759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b6c42-034a-4fdb-a614-400059de0380 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:33.712360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a4039-6dee-4654-9270-4f8639b156c1 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:33.745463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e1121-58e7-45f8-905c-e1b2ae522429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:33.746261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1121-58e7-45f8-905c-e1b2ae522429 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:33.746543 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1121-58e7-45f8-905c-e1b2ae522429 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:33.746818 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1121-58e7-45f8-905c-e1b2ae522429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:33.756817 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e1121-58e7-45f8-905c-e1b2ae522429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:33.758318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e1121-58e7-45f8-905c-e1b2ae522429 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:33.775210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b6c42-034a-4fdb-a614-400059de0380 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:33.775556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-f19e1121-58e7-45f8-905c-e1b2ae522429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:33.781496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 283/563] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:33.781496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e1121-58e7-45f8-905c-e1b2ae522429 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:33.815992 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e60f03-f351-4294-8efe-a229436f9262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:33.816793 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e60f03-f351-4294-8efe-a229436f9262 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:33.817144 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e60f03-f351-4294-8efe-a229436f9262 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:33.817422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e60f03-f351-4294-8efe-a229436f9262 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:33.828406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e60f03-f351-4294-8efe-a229436f9262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:33.835610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-40e60f03-f351-4294-8efe-a229436f9262 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:33.836834 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 281/564] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:33.837868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e60f03-f351-4294-8efe-a229436f9262 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:33.888791 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e1121-58e7-45f8-905c-e1b2ae522429 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:33.922291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997205bb-5b79-4502-bcda-a1c8f1e66ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:33.923127 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997205bb-5b79-4502-bcda-a1c8f1e66ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:33.923411 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997205bb-5b79-4502-bcda-a1c8f1e66ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:33.923686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997205bb-5b79-4502-bcda-a1c8f1e66ff1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:33.934388 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997205bb-5b79-4502-bcda-a1c8f1e66ff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:33.937397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e60f03-f351-4294-8efe-a229436f9262 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:33.941704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-997205bb-5b79-4502-bcda-a1c8f1e66ff1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:33.942901 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 284/565] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:33.943664 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997205bb-5b79-4502-bcda-a1c8f1e66ff1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:33.972705 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7a333-eeaa-41b0-ac62-ac60081bbc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:33.973376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7a333-eeaa-41b0-ac62-ac60081bbc4d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:33.973657 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7a333-eeaa-41b0-ac62-ac60081bbc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:33.973929 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7a333-eeaa-41b0-ac62-ac60081bbc4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:33.974732 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7a333-eeaa-41b0-ac62-ac60081bbc4d None admin] RBAC: Adding query filter params (role.id=07e6d0f9bf5345c99ce158cd3e62c1c5, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=89101c5ca3b048939a46b0bb246d2cbd) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:33.975036 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7a333-eeaa-41b0-ac62-ac60081bbc4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:33.976528 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7a333-eeaa-41b0-ac62-ac60081bbc4d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:33.981656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 282/566] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:49:33 2022] GET /identity/v3/role_assignments?user.id=89101c5ca3b048939a46b0bb246d2cbd&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:33.982412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7a333-eeaa-41b0-ac62-ac60081bbc4d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:34.043904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997205bb-5b79-4502-bcda-a1c8f1e66ff1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:34.079141 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bccd8-679d-48cd-932f-2e3c98574977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:34.079829 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bccd8-679d-48cd-932f-2e3c98574977 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:34.080122 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bccd8-679d-48cd-932f-2e3c98574977 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:34.080403 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bccd8-679d-48cd-932f-2e3c98574977 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:34.081198 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bccd8-679d-48cd-932f-2e3c98574977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:34.081515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bccd8-679d-48cd-932f-2e3c98574977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:34.082926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bccd8-679d-48cd-932f-2e3c98574977 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:34.096114 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 285/567] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:34.097793 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1ccc8-e947-4bbf-b617-d53412080d38 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:34.098252 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1ccc8-e947-4bbf-b617-d53412080d38 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:34.098711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1ccc8-e947-4bbf-b617-d53412080d38 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:34.100540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 286/568] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:34.102040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1ccc8-e947-4bbf-b617-d53412080d38 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:34.103587 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7a333-eeaa-41b0-ac62-ac60081bbc4d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:34.139391 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab3fc7-93fd-4781-8dff-869c72360ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:34.140087 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab3fc7-93fd-4781-8dff-869c72360ebb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:34.140367 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab3fc7-93fd-4781-8dff-869c72360ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:34.140639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab3fc7-93fd-4781-8dff-869c72360ebb None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:34.141451 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab3fc7-93fd-4781-8dff-869c72360ebb None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:34.141762 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab3fc7-93fd-4781-8dff-869c72360ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:34.143255 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab3fc7-93fd-4781-8dff-869c72360ebb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:34.158690 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 283/569] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:34.158690 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab3fc7-93fd-4781-8dff-869c72360ebb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:34.217444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1ccc8-e947-4bbf-b617-d53412080d38 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:34.250790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83708cd-46d5-457d-8a33-248c0cb484ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:34.251484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83708cd-46d5-457d-8a33-248c0cb484ba None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:34.251760 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83708cd-46d5-457d-8a33-248c0cb484ba None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:34.252040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83708cd-46d5-457d-8a33-248c0cb484ba None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:34.252766 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83708cd-46d5-457d-8a33-248c0cb484ba None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:34.253094 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83708cd-46d5-457d-8a33-248c0cb484ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:34.254463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83708cd-46d5-457d-8a33-248c0cb484ba None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:34.257298 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab3fc7-93fd-4781-8dff-869c72360ebb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:34.268600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 287/570] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:34.268600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adbf6b-928d-4388-b6d4-f56945d4f7ff None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:34.268600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adbf6b-928d-4388-b6d4-f56945d4f7ff None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:34.268600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adbf6b-928d-4388-b6d4-f56945d4f7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:34.283773 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-98adbf6b-928d-4388-b6d4-f56945d4f7ff None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:34.284953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-98adbf6b-928d-4388-b6d4-f56945d4f7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:34.295616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c0e0b-eaff-4566-b2a3-b4dada923d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:34.296439 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c0e0b-eaff-4566-b2a3-b4dada923d89 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:34.296722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c0e0b-eaff-4566-b2a3-b4dada923d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:34.297028 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c0e0b-eaff-4566-b2a3-b4dada923d89 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:34.305440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c0e0b-eaff-4566-b2a3-b4dada923d89 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:34.306930 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c0e0b-eaff-4566-b2a3-b4dada923d89 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:34.321681 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-0f2c0e0b-eaff-4566-b2a3-b4dada923d89 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 10:49:34.323061 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 284/571] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Apr 6 10:49:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:34.325997 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c0e0b-eaff-4566-b2a3-b4dada923d89 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:34.355975 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 288/572] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:34.357119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adbf6b-928d-4388-b6d4-f56945d4f7ff None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:34.432487 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c0e0b-eaff-4566-b2a3-b4dada923d89 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:34.458733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adbf6b-928d-4388-b6d4-f56945d4f7ff None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:34.468210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c396b9-ef5e-4862-945f-172a6ecb22f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:34.471304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c396b9-ef5e-4862-945f-172a6ecb22f6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:34.473754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c396b9-ef5e-4862-945f-172a6ecb22f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:34.474042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c396b9-ef5e-4862-945f-172a6ecb22f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:34.487111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c396b9-ef5e-4862-945f-172a6ecb22f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:34.488751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c396b9-ef5e-4862-945f-172a6ecb22f6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:34.494471 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ca781-4122-41a4-bfbb-386030678aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:34.495266 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca781-4122-41a4-bfbb-386030678aba None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:34.495556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca781-4122-41a4-bfbb-386030678aba None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:34.495833 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca781-4122-41a4-bfbb-386030678aba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:34.505688 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ca781-4122-41a4-bfbb-386030678aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:34.506545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-f3c396b9-ef5e-4862-945f-172a6ecb22f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:34.507154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ca781-4122-41a4-bfbb-386030678aba None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:34.507771 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 285/573] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:34.510256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c396b9-ef5e-4862-945f-172a6ecb22f6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:34.524865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-5b5ca781-4122-41a4-bfbb-386030678aba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:34.530509 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 289/574] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:34.530509 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ca781-4122-41a4-bfbb-386030678aba None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:34.618381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c396b9-ef5e-4862-945f-172a6ecb22f6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:34.623452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ca781-4122-41a4-bfbb-386030678aba None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:34.653859 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f32e40-fe99-422f-a087-8e1979a3eeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:34.654532 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f32e40-fe99-422f-a087-8e1979a3eeda None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:34.654814 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f32e40-fe99-422f-a087-8e1979a3eeda None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:34.655088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f32e40-fe99-422f-a087-8e1979a3eeda None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:34.655923 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f32e40-fe99-422f-a087-8e1979a3eeda None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:34.656234 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f32e40-fe99-422f-a087-8e1979a3eeda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:34.657751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f32e40-fe99-422f-a087-8e1979a3eeda None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:34.661748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de2af3-e1df-4d4a-ba49-bc6fc4f7fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:34.662555 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de2af3-e1df-4d4a-ba49-bc6fc4f7fcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:34.662836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de2af3-e1df-4d4a-ba49-bc6fc4f7fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:34.663665 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de2af3-e1df-4d4a-ba49-bc6fc4f7fcb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:34.676934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de2af3-e1df-4d4a-ba49-bc6fc4f7fcb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:34.680809 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 286/575] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Apr 6 10:49:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:34.681725 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f32e40-fe99-422f-a087-8e1979a3eeda None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:34.684564 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-92de2af3-e1df-4d4a-ba49-bc6fc4f7fcb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:34.686033 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 290/576] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:34.686736 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de2af3-e1df-4d4a-ba49-bc6fc4f7fcb6 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:34.792835 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f32e40-fe99-422f-a087-8e1979a3eeda None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:34.797703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de2af3-e1df-4d4a-ba49-bc6fc4f7fcb6 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:34.832952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21acf9-97d4-41d5-a8bb-2a6ceaa530c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:34.833401 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f3d92-0557-45fc-b630-e5b96fa8272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:34.833646 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21acf9-97d4-41d5-a8bb-2a6ceaa530c0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:34.833930 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21acf9-97d4-41d5-a8bb-2a6ceaa530c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:34.834091 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f3d92-0557-45fc-b630-e5b96fa8272d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:34.834182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21acf9-97d4-41d5-a8bb-2a6ceaa530c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:34.834359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f3d92-0557-45fc-b630-e5b96fa8272d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:34.834635 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f3d92-0557-45fc-b630-e5b96fa8272d None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:34.835424 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21acf9-97d4-41d5-a8bb-2a6ceaa530c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:34.835728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21acf9-97d4-41d5-a8bb-2a6ceaa530c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:34.835877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f3d92-0557-45fc-b630-e5b96fa8272d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:34.836179 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f3d92-0557-45fc-b630-e5b96fa8272d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:34.837151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21acf9-97d4-41d5-a8bb-2a6ceaa530c0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:34.837556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f3d92-0557-45fc-b630-e5b96fa8272d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:34.853453 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 287/577] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:34.853622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 291/578] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:34.853622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f3d92-0557-45fc-b630-e5b96fa8272d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:34.853754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21acf9-97d4-41d5-a8bb-2a6ceaa530c0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:34.949987 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f3d92-0557-45fc-b630-e5b96fa8272d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:34.956089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21acf9-97d4-41d5-a8bb-2a6ceaa530c0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:34.983222 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84892e80-8a5f-44db-8af9-763b5ded4b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:34.983888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84892e80-8a5f-44db-8af9-763b5ded4b99 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:34.984168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84892e80-8a5f-44db-8af9-763b5ded4b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:34.984455 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84892e80-8a5f-44db-8af9-763b5ded4b99 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:34.985206 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84892e80-8a5f-44db-8af9-763b5ded4b99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:34.985566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84892e80-8a5f-44db-8af9-763b5ded4b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:34.986875 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84892e80-8a5f-44db-8af9-763b5ded4b99 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:34.988510 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a7dfe-8222-4294-91e9-43e95e78406c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:34.989320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a7dfe-8222-4294-91e9-43e95e78406c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:34.989606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a7dfe-8222-4294-91e9-43e95e78406c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:34.989883 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a7dfe-8222-4294-91e9-43e95e78406c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:35.000876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 292/579] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:35.000876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84892e80-8a5f-44db-8af9-763b5ded4b99 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:35.001144 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a7dfe-8222-4294-91e9-43e95e78406c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:35.002660 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a7dfe-8222-4294-91e9-43e95e78406c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:35.019523 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-502a7dfe-8222-4294-91e9-43e95e78406c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:35.020899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 288/580] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:35.026110 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a7dfe-8222-4294-91e9-43e95e78406c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:35.105678 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84892e80-8a5f-44db-8af9-763b5ded4b99 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:35.133684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a7dfe-8222-4294-91e9-43e95e78406c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:35.141451 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6259ba-76f3-4baa-bbf2-e2f73c739b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:35.142263 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6259ba-76f3-4baa-bbf2-e2f73c739b24 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:35.142545 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6259ba-76f3-4baa-bbf2-e2f73c739b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:35.142819 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6259ba-76f3-4baa-bbf2-e2f73c739b24 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:35.151721 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6259ba-76f3-4baa-bbf2-e2f73c739b24 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:35.153211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6259ba-76f3-4baa-bbf2-e2f73c739b24 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:35.166865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-ec6259ba-76f3-4baa-bbf2-e2f73c739b24 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 06 10:49:35.168041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 293/581] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:35.168803 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6259ba-76f3-4baa-bbf2-e2f73c739b24 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:35.174350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57deb47-c0d7-414d-bca8-6e14e19250c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:35.175151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57deb47-c0d7-414d-bca8-6e14e19250c2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:35.175436 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57deb47-c0d7-414d-bca8-6e14e19250c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:35.175711 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57deb47-c0d7-414d-bca8-6e14e19250c2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:35.183981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57deb47-c0d7-414d-bca8-6e14e19250c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:35.185523 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57deb47-c0d7-414d-bca8-6e14e19250c2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:35.199243 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-c57deb47-c0d7-414d-bca8-6e14e19250c2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 06 10:49:35.204752 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 289/582] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:35.204752 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57deb47-c0d7-414d-bca8-6e14e19250c2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:35.263690 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6259ba-76f3-4baa-bbf2-e2f73c739b24 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:35.296552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c90dcb-bec6-40cd-8a97-1dd6ceb4cdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:35.297377 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c90dcb-bec6-40cd-8a97-1dd6ceb4cdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:35.297660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c90dcb-bec6-40cd-8a97-1dd6ceb4cdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:35.297933 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c90dcb-bec6-40cd-8a97-1dd6ceb4cdb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:35.301581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57deb47-c0d7-414d-bca8-6e14e19250c2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:35.308137 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c90dcb-bec6-40cd-8a97-1dd6ceb4cdb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:35.309997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c90dcb-bec6-40cd-8a97-1dd6ceb4cdb4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:35.326347 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-e9c90dcb-bec6-40cd-8a97-1dd6ceb4cdb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:35.331899 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 294/583] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:35.331899 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c90dcb-bec6-40cd-8a97-1dd6ceb4cdb4 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:35.339756 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89da851-01dd-402d-b077-8245e43bac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:35.340382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89da851-01dd-402d-b077-8245e43bac01 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:35.340663 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89da851-01dd-402d-b077-8245e43bac01 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:35.340945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89da851-01dd-402d-b077-8245e43bac01 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:35.341682 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89da851-01dd-402d-b077-8245e43bac01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:35.341985 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89da851-01dd-402d-b077-8245e43bac01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:35.343498 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89da851-01dd-402d-b077-8245e43bac01 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:35.360591 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 290/584] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:35.360591 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89da851-01dd-402d-b077-8245e43bac01 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:35.428662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c90dcb-bec6-40cd-8a97-1dd6ceb4cdb4 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:35.463069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89da851-01dd-402d-b077-8245e43bac01 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:35.473748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220015a-af47-43a7-8263-e9755ab2316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:35.475023 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220015a-af47-43a7-8263-e9755ab2316d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:35.476047 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220015a-af47-43a7-8263-e9755ab2316d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:35.476532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220015a-af47-43a7-8263-e9755ab2316d None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:35.477575 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220015a-af47-43a7-8263-e9755ab2316d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:35.478059 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220015a-af47-43a7-8263-e9755ab2316d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:35.479729 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220015a-af47-43a7-8263-e9755ab2316d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:35.498836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 295/585] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Apr 6 10:49:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:35.503577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611972f-b5a1-47bd-952f-48cc133891a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:35.504251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611972f-b5a1-47bd-952f-48cc133891a3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:35.504528 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611972f-b5a1-47bd-952f-48cc133891a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:35.504748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220015a-af47-43a7-8263-e9755ab2316d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:35.504844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611972f-b5a1-47bd-952f-48cc133891a3 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:35.505927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611972f-b5a1-47bd-952f-48cc133891a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:35.506324 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611972f-b5a1-47bd-952f-48cc133891a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:35.508002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611972f-b5a1-47bd-952f-48cc133891a3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:35.531680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 291/586] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Apr 6 10:49:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:35.531680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611972f-b5a1-47bd-952f-48cc133891a3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:35.624041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220015a-af47-43a7-8263-e9755ab2316d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:35.630185 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611972f-b5a1-47bd-952f-48cc133891a3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:35.659866 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531105c8-f090-43fe-8f58-495ad1e39e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:35.660539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531105c8-f090-43fe-8f58-495ad1e39e72 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:35.660824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531105c8-f090-43fe-8f58-495ad1e39e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:35.661124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531105c8-f090-43fe-8f58-495ad1e39e72 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:35.661852 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531105c8-f090-43fe-8f58-495ad1e39e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:35.662162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531105c8-f090-43fe-8f58-495ad1e39e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:35.663847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d18f49-6d69-4f82-823e-c3bcf0e6d699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:35.664210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531105c8-f090-43fe-8f58-495ad1e39e72 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:35.664641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d18f49-6d69-4f82-823e-c3bcf0e6d699 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:35.664924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d18f49-6d69-4f82-823e-c3bcf0e6d699 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:35.665230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d18f49-6d69-4f82-823e-c3bcf0e6d699 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:35.672128 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d18f49-6d69-4f82-823e-c3bcf0e6d699 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:35.673672 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d18f49-6d69-4f82-823e-c3bcf0e6d699 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:35.676909 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 296/587] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:35.677607 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531105c8-f090-43fe-8f58-495ad1e39e72 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:35.691647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-76d18f49-6d69-4f82-823e-c3bcf0e6d699 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:35.697360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 292/588] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:35.698391 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d18f49-6d69-4f82-823e-c3bcf0e6d699 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:35.775442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531105c8-f090-43fe-8f58-495ad1e39e72 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:35.802004 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d18f49-6d69-4f82-823e-c3bcf0e6d699 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:35.835354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae9b8a-f067-40c6-b7cf-d0b88586fb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:35.835977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1acfb3-35ac-4604-8bc0-8fdee5f3a129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:35.836155 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae9b8a-f067-40c6-b7cf-d0b88586fb03 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:35.836438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae9b8a-f067-40c6-b7cf-d0b88586fb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:35.836710 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae9b8a-f067-40c6-b7cf-d0b88586fb03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:35.837407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1acfb3-35ac-4604-8bc0-8fdee5f3a129 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:35.837836 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1acfb3-35ac-4604-8bc0-8fdee5f3a129 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:35.838262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1acfb3-35ac-4604-8bc0-8fdee5f3a129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:35.847963 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae9b8a-f067-40c6-b7cf-d0b88586fb03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:35.848811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1acfb3-35ac-4604-8bc0-8fdee5f3a129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:35.849452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae9b8a-f067-40c6-b7cf-d0b88586fb03 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:35.851178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1acfb3-35ac-4604-8bc0-8fdee5f3a129 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:35.866620 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-65ae9b8a-f067-40c6-b7cf-d0b88586fb03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:35.867820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 297/589] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:35.868137 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-fd1acfb3-35ac-4604-8bc0-8fdee5f3a129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:35.868601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae9b8a-f067-40c6-b7cf-d0b88586fb03 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:35.869647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 293/590] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:35.870539 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1acfb3-35ac-4604-8bc0-8fdee5f3a129 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:35.971100 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1acfb3-35ac-4604-8bc0-8fdee5f3a129 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:35.972932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae9b8a-f067-40c6-b7cf-d0b88586fb03 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:36.004868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29d1b5-5e24-4d02-a945-6310106549aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:36.005561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d1b5-5e24-4d02-a945-6310106549aa None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.005846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d1b5-5e24-4d02-a945-6310106549aa None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.006123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d1b5-5e24-4d02-a945-6310106549aa None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.006733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f880b-fcfd-4915-ba23-183b138f9b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:36.006935 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29d1b5-5e24-4d02-a945-6310106549aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:36.007243 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29d1b5-5e24-4d02-a945-6310106549aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:36.007523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f880b-fcfd-4915-ba23-183b138f9b30 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.007804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f880b-fcfd-4915-ba23-183b138f9b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.008074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f880b-fcfd-4915-ba23-183b138f9b30 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.008699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29d1b5-5e24-4d02-a945-6310106549aa None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:36.016077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f880b-fcfd-4915-ba23-183b138f9b30 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:36.017535 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f880b-fcfd-4915-ba23-183b138f9b30 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:36.025166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 294/591] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:36.025166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29d1b5-5e24-4d02-a945-6310106549aa None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:36.031529 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-f71f880b-fcfd-4915-ba23-183b138f9b30 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 06 10:49:36.037124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 298/592] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:36.037124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f880b-fcfd-4915-ba23-183b138f9b30 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:36.126435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29d1b5-5e24-4d02-a945-6310106549aa None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:36.133831 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f880b-fcfd-4915-ba23-183b138f9b30 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:36.160527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77745317-8a5f-4a5d-8855-ca4bd357e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:36.161210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77745317-8a5f-4a5d-8855-ca4bd357e6df None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.161487 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77745317-8a5f-4a5d-8855-ca4bd357e6df None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.161756 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77745317-8a5f-4a5d-8855-ca4bd357e6df None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.162461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77745317-8a5f-4a5d-8855-ca4bd357e6df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:36.162759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77745317-8a5f-4a5d-8855-ca4bd357e6df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:36.164182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77745317-8a5f-4a5d-8855-ca4bd357e6df None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:36.171885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207d081-0f24-400d-8cc7-36d0450fe7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:36.172558 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207d081-0f24-400d-8cc7-36d0450fe7db None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.172841 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207d081-0f24-400d-8cc7-36d0450fe7db None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.173145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207d081-0f24-400d-8cc7-36d0450fe7db None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.173872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207d081-0f24-400d-8cc7-36d0450fe7db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:36.174181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207d081-0f24-400d-8cc7-36d0450fe7db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:36.180336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 295/593] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:36.180467 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207d081-0f24-400d-8cc7-36d0450fe7db None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:36.180542 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77745317-8a5f-4a5d-8855-ca4bd357e6df None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:36.188145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 299/594] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:36.188840 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207d081-0f24-400d-8cc7-36d0450fe7db None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:36.276508 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77745317-8a5f-4a5d-8855-ca4bd357e6df None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:36.287336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207d081-0f24-400d-8cc7-36d0450fe7db None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:36.308581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef8293-f9d8-4475-b4c0-e574a469ca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:36.309497 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef8293-f9d8-4475-b4c0-e574a469ca65 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.309776 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef8293-f9d8-4475-b4c0-e574a469ca65 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.310048 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef8293-f9d8-4475-b4c0-e574a469ca65 None admin] PATH_INFO: `/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/650c5809116e4bcd808044236c06dcc2/roles/07e6d0f9bf5345c99ce158cd3e62c1c5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.320493 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60713f70-efa8-46eb-a063-a1a5efd28121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:36.321251 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60713f70-efa8-46eb-a063-a1a5efd28121 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.321538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60713f70-efa8-46eb-a063-a1a5efd28121 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.321815 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60713f70-efa8-46eb-a063-a1a5efd28121 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.322652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60713f70-efa8-46eb-a063-a1a5efd28121 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:36.322960 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60713f70-efa8-46eb-a063-a1a5efd28121 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:36.324391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60713f70-efa8-46eb-a063-a1a5efd28121 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:36.326873 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef8293-f9d8-4475-b4c0-e574a469ca65 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4306a6b12434cc495650e4f3b9afbde, user_id=650c5809116e4bcd808044236c06dcc2, role_id=07e6d0f9bf5345c99ce158cd3e62c1c5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:36.328534 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef8293-f9d8-4475-b4c0-e574a469ca65 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:36.341318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 300/595] 10.222.0.62 () {56 vars in 1139 bytes} [Wed Apr 6 10:49:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:36.342128 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60713f70-efa8-46eb-a063-a1a5efd28121 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:36.395038 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 296/596] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:49:36 2022] PUT /identity/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/650c5809116e4bcd808044236c06dcc2/roles/07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:49:36.395868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef8293-f9d8-4475-b4c0-e574a469ca65 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:36.443020 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60713f70-efa8-46eb-a063-a1a5efd28121 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:36.478651 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e12ad6-151e-4f11-a5b1-d08958f16bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:36.479458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e12ad6-151e-4f11-a5b1-d08958f16bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.479748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e12ad6-151e-4f11-a5b1-d08958f16bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.480025 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e12ad6-151e-4f11-a5b1-d08958f16bb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.487372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e12ad6-151e-4f11-a5b1-d08958f16bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:36.488855 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e12ad6-151e-4f11-a5b1-d08958f16bb4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:36.503213 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-e5e12ad6-151e-4f11-a5b1-d08958f16bb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:36.504484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 301/597] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:36.504610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef8293-f9d8-4475-b4c0-e574a469ca65 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:36.505758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66d762-2f0a-422a-af03-3d59f2c006cf None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.506040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66d762-2f0a-422a-af03-3d59f2c006cf None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.506311 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66d762-2f0a-422a-af03-3d59f2c006cf None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.508641 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 302/598] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:36.508940 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66d762-2f0a-422a-af03-3d59f2c006cf None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:36.542545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd506d-eba7-47a7-a4bf-705ff0bbf9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:36.543268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd506d-eba7-47a7-a4bf-705ff0bbf9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.543553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd506d-eba7-47a7-a4bf-705ff0bbf9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.543823 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd506d-eba7-47a7-a4bf-705ff0bbf9a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.551289 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd506d-eba7-47a7-a4bf-705ff0bbf9a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:36.552842 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd506d-eba7-47a7-a4bf-705ff0bbf9a6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:36.567338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-f3cd506d-eba7-47a7-a4bf-705ff0bbf9a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:36.568615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 297/599] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:36.570378 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d4083-9152-4d18-b6a1-6b1eb24c85c7 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.570658 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d4083-9152-4d18-b6a1-6b1eb24c85c7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.570931 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d4083-9152-4d18-b6a1-6b1eb24c85c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.594093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7e5d4083-9152-4d18-b6a1-6b1eb24c85c7 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:36.595609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7e5d4083-9152-4d18-b6a1-6b1eb24c85c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:36.628469 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66d762-2f0a-422a-af03-3d59f2c006cf None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:36.663614 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2f04f-f8c9-4bff-bc03-f6255040c5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:36.664421 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2f04f-f8c9-4bff-bc03-f6255040c5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.664705 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2f04f-f8c9-4bff-bc03-f6255040c5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.664982 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2f04f-f8c9-4bff-bc03-f6255040c5f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.675778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 298/600] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:36.675778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d4083-9152-4d18-b6a1-6b1eb24c85c7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:36.680352 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2f04f-f8c9-4bff-bc03-f6255040c5f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:36.682614 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2f04f-f8c9-4bff-bc03-f6255040c5f3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:36.702944 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-a9a2f04f-f8c9-4bff-bc03-f6255040c5f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:36.704332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 303/601] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:36.704945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2f04f-f8c9-4bff-bc03-f6255040c5f3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:36.765325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d4083-9152-4d18-b6a1-6b1eb24c85c7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:36.800081 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052446e0-cd58-460f-b662-0d61894b6203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:36.801075 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052446e0-cd58-460f-b662-0d61894b6203 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.801368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2f04f-f8c9-4bff-bc03-f6255040c5f3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:36.801780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052446e0-cd58-460f-b662-0d61894b6203 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.802250 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052446e0-cd58-460f-b662-0d61894b6203 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.803223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052446e0-cd58-460f-b662-0d61894b6203 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:36.804335 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052446e0-cd58-460f-b662-0d61894b6203 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:36.805876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052446e0-cd58-460f-b662-0d61894b6203 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:36.819000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 299/602] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:36.820578 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052446e0-cd58-460f-b662-0d61894b6203 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:36.837096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd722da9-6c44-4838-bfc9-ee6273d8b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:36.837784 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd722da9-6c44-4838-bfc9-ee6273d8b01e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.838075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd722da9-6c44-4838-bfc9-ee6273d8b01e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.838352 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd722da9-6c44-4838-bfc9-ee6273d8b01e None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.839142 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd722da9-6c44-4838-bfc9-ee6273d8b01e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:36.839452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd722da9-6c44-4838-bfc9-ee6273d8b01e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:36.840873 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd722da9-6c44-4838-bfc9-ee6273d8b01e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:36.852671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 304/603] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:36.853346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd722da9-6c44-4838-bfc9-ee6273d8b01e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:36.916686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052446e0-cd58-460f-b662-0d61894b6203 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:36.949481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6134333-e63c-4746-af96-90902654c5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:36.950484 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134333-e63c-4746-af96-90902654c5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.950602 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134333-e63c-4746-af96-90902654c5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.950821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134333-e63c-4746-af96-90902654c5f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.953556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd722da9-6c44-4838-bfc9-ee6273d8b01e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:36.960432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6134333-e63c-4746-af96-90902654c5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:36.967449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-a6134333-e63c-4746-af96-90902654c5f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:36.968627 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 300/604] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:36.969374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6134333-e63c-4746-af96-90902654c5f5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:36.987165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa5b5-814b-4cc2-b3cd-12296554cca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:36.987837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa5b5-814b-4cc2-b3cd-12296554cca0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:36.988122 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa5b5-814b-4cc2-b3cd-12296554cca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:36.988427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa5b5-814b-4cc2-b3cd-12296554cca0 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:36.989150 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fa5b5-814b-4cc2-b3cd-12296554cca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:36.989463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fa5b5-814b-4cc2-b3cd-12296554cca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:36.990823 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fa5b5-814b-4cc2-b3cd-12296554cca0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:37.002328 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 305/605] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:37.002947 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa5b5-814b-4cc2-b3cd-12296554cca0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:37.077762 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6134333-e63c-4746-af96-90902654c5f5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:37.099041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa5b5-814b-4cc2-b3cd-12296554cca0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:37.111393 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97f8f9-4e17-44b6-bb0e-2f34866cbc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:37.112281 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97f8f9-4e17-44b6-bb0e-2f34866cbc39 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:37.112563 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97f8f9-4e17-44b6-bb0e-2f34866cbc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:37.112837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97f8f9-4e17-44b6-bb0e-2f34866cbc39 None admin] PATH_INFO: `/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/5d07bf80c4f741e68d14665b092edcff/roles/07e6d0f9bf5345c99ce158cd3e62c1c5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:37.126882 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97f8f9-4e17-44b6-bb0e-2f34866cbc39 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4306a6b12434cc495650e4f3b9afbde, user_id=5d07bf80c4f741e68d14665b092edcff, role_id=07e6d0f9bf5345c99ce158cd3e62c1c5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:37.128546 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97f8f9-4e17-44b6-bb0e-2f34866cbc39 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:37.134616 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1230e-3a9b-4d38-b589-0e8e9b0ebc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:37.135512 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1230e-3a9b-4d38-b589-0e8e9b0ebc97 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:37.135790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1230e-3a9b-4d38-b589-0e8e9b0ebc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:37.136055 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1230e-3a9b-4d38-b589-0e8e9b0ebc97 None admin] PATH_INFO: `/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/42cd381cf5c745de9dac8f77a8cea554/roles/07e6d0f9bf5345c99ce158cd3e62c1c5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:37.150830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1230e-3a9b-4d38-b589-0e8e9b0ebc97 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4306a6b12434cc495650e4f3b9afbde, user_id=42cd381cf5c745de9dac8f77a8cea554, role_id=07e6d0f9bf5345c99ce158cd3e62c1c5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:37.152272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1230e-3a9b-4d38-b589-0e8e9b0ebc97 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:37.201146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 301/606] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:49:36 2022] PUT /identity/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/5d07bf80c4f741e68d14665b092edcff/roles/07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:49:37.201146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97f8f9-4e17-44b6-bb0e-2f34866cbc39 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:37.226321 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 306/607] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:49:37 2022] PUT /identity/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/42cd381cf5c745de9dac8f77a8cea554/roles/07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:49:37.227515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1230e-3a9b-4d38-b589-0e8e9b0ebc97 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:37.310584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97f8f9-4e17-44b6-bb0e-2f34866cbc39 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:37.342655 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1230e-3a9b-4d38-b589-0e8e9b0ebc97 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:37.348458 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828205e6-4bb6-4cad-9b74-d7bf99c8c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:37.349169 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828205e6-4bb6-4cad-9b74-d7bf99c8c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:37.349455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828205e6-4bb6-4cad-9b74-d7bf99c8c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:37.349737 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828205e6-4bb6-4cad-9b74-d7bf99c8c2b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:37.350535 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828205e6-4bb6-4cad-9b74-d7bf99c8c2b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:37.350847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828205e6-4bb6-4cad-9b74-d7bf99c8c2b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:37.352310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828205e6-4bb6-4cad-9b74-d7bf99c8c2b2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:37.361614 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 302/608] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:37.374166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828205e6-4bb6-4cad-9b74-d7bf99c8c2b2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:37.381291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27021814-aa3d-46c5-882c-455aa43a9a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:37.382639 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27021814-aa3d-46c5-882c-455aa43a9a1f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:37.382923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27021814-aa3d-46c5-882c-455aa43a9a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:37.383195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27021814-aa3d-46c5-882c-455aa43a9a1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:37.391451 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27021814-aa3d-46c5-882c-455aa43a9a1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:37.392929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27021814-aa3d-46c5-882c-455aa43a9a1f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:37.408312 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-27021814-aa3d-46c5-882c-455aa43a9a1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:37.409920 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 307/609] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:37.415569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27021814-aa3d-46c5-882c-455aa43a9a1f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:37.536449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27021814-aa3d-46c5-882c-455aa43a9a1f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:37.554793 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828205e6-4bb6-4cad-9b74-d7bf99c8c2b2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:37.575231 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7d2e7-be90-41fe-ad1e-b4b235b376a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:37.575905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7d2e7-be90-41fe-ad1e-b4b235b376a9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:37.576188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7d2e7-be90-41fe-ad1e-b4b235b376a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:37.576463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7d2e7-be90-41fe-ad1e-b4b235b376a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:37.577351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7d2e7-be90-41fe-ad1e-b4b235b376a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:37.578016 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7d2e7-be90-41fe-ad1e-b4b235b376a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:37.579169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7d2e7-be90-41fe-ad1e-b4b235b376a9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:37.591981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4a46f-82a6-4157-a02c-73936e643ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:37.593161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 308/610] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:37.597665 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4a46f-82a6-4157-a02c-73936e643ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:37.598550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7d2e7-be90-41fe-ad1e-b4b235b376a9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:37.599251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4a46f-82a6-4157-a02c-73936e643ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:37.599594 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4a46f-82a6-4157-a02c-73936e643ec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:37.618983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4a46f-82a6-4157-a02c-73936e643ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:37.620985 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4a46f-82a6-4157-a02c-73936e643ec4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:37.642610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-5ea4a46f-82a6-4157-a02c-73936e643ec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:37.651962 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 303/611] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:37.654651 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4a46f-82a6-4157-a02c-73936e643ec4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:37.727117 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7d2e7-be90-41fe-ad1e-b4b235b376a9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:37.772534 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4a46f-82a6-4157-a02c-73936e643ec4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:37.774196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20642a-e36a-44dc-bfad-f149a58aacbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:37.776046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20642a-e36a-44dc-bfad-f149a58aacbd None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:37.776509 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20642a-e36a-44dc-bfad-f149a58aacbd None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:37.776926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20642a-e36a-44dc-bfad-f149a58aacbd None admin] PATH_INFO: `/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/e078c6efaf054f7489f7164fdafce714/roles/07e6d0f9bf5345c99ce158cd3e62c1c5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:37.795269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20642a-e36a-44dc-bfad-f149a58aacbd None admin] RBAC: Authorizing `identity:create_grant(project_id=a4306a6b12434cc495650e4f3b9afbde, user_id=e078c6efaf054f7489f7164fdafce714, role_id=07e6d0f9bf5345c99ce158cd3e62c1c5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:37.797715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20642a-e36a-44dc-bfad-f149a58aacbd None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:37.812211 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a14b21-65e3-40dc-820b-68730f331b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:37.813157 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a14b21-65e3-40dc-820b-68730f331b6d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:37.813548 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a14b21-65e3-40dc-820b-68730f331b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:37.813956 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a14b21-65e3-40dc-820b-68730f331b6d None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:37.814870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a14b21-65e3-40dc-820b-68730f331b6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:37.815464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a14b21-65e3-40dc-820b-68730f331b6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:37.817227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a14b21-65e3-40dc-820b-68730f331b6d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:37.831407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 304/612] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:37.838010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a14b21-65e3-40dc-820b-68730f331b6d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:37.889339 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 309/613] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:49:37 2022] PUT /identity/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/e078c6efaf054f7489f7164fdafce714/roles/07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:49:37.970072 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a14b21-65e3-40dc-820b-68730f331b6d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:38.006506 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0d338-cdd3-4563-a7a7-6e7fe8f6f635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:38.007610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0d338-cdd3-4563-a7a7-6e7fe8f6f635 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:38.008098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0d338-cdd3-4563-a7a7-6e7fe8f6f635 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:38.008572 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0d338-cdd3-4563-a7a7-6e7fe8f6f635 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:38.016856 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0d338-cdd3-4563-a7a7-6e7fe8f6f635 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:38.018637 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0d338-cdd3-4563-a7a7-6e7fe8f6f635 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:38.033149 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-7be0d338-cdd3-4563-a7a7-6e7fe8f6f635 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 10:49:38.039984 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 305/614] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:49:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:38.041683 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20642a-e36a-44dc-bfad-f149a58aacbd None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:38.156914 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20642a-e36a-44dc-bfad-f149a58aacbd None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:38.193295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f7d0d-7895-4b36-991f-aca95593aa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:38.194281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f7d0d-7895-4b36-991f-aca95593aa03 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:38.194763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f7d0d-7895-4b36-991f-aca95593aa03 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:38.195171 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f7d0d-7895-4b36-991f-aca95593aa03 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:38.196145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f7d0d-7895-4b36-991f-aca95593aa03 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:38.196606 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f7d0d-7895-4b36-991f-aca95593aa03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:38.198196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f7d0d-7895-4b36-991f-aca95593aa03 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:38.217276 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 310/615] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Apr 6 10:49:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:38.222788 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0d338-cdd3-4563-a7a7-6e7fe8f6f635 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:38.325384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0d338-cdd3-4563-a7a7-6e7fe8f6f635 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:38.362669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a8d5b-cf39-4514-8c25-56ac78aa149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:38.363702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a8d5b-cf39-4514-8c25-56ac78aa149e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:38.364121 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a8d5b-cf39-4514-8c25-56ac78aa149e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:38.364548 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a8d5b-cf39-4514-8c25-56ac78aa149e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:38.375277 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a8d5b-cf39-4514-8c25-56ac78aa149e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:38.376968 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a8d5b-cf39-4514-8c25-56ac78aa149e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:38.394125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-0e5a8d5b-cf39-4514-8c25-56ac78aa149e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:38.395922 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 306/616] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:38.401849 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f7d0d-7895-4b36-991f-aca95593aa03 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:38.524207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f7d0d-7895-4b36-991f-aca95593aa03 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:38.574683 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0969dd6-523b-4cdb-adc9-9b857182a00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:38.576049 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0969dd6-523b-4cdb-adc9-9b857182a00c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:38.576472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0969dd6-523b-4cdb-adc9-9b857182a00c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:38.576897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0969dd6-523b-4cdb-adc9-9b857182a00c None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:38.577784 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0969dd6-523b-4cdb-adc9-9b857182a00c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:38.578243 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0969dd6-523b-4cdb-adc9-9b857182a00c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:38.579815 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0969dd6-523b-4cdb-adc9-9b857182a00c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:38.595464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 311/617] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:38.601553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a8d5b-cf39-4514-8c25-56ac78aa149e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:38.702081 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a8d5b-cf39-4514-8c25-56ac78aa149e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:38.735958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b95bdb-6ed3-41a4-8756-522b609bea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:38.736745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b95bdb-6ed3-41a4-8756-522b609bea07 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:38.737022 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b95bdb-6ed3-41a4-8756-522b609bea07 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:38.737321 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b95bdb-6ed3-41a4-8756-522b609bea07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:38.744888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b95bdb-6ed3-41a4-8756-522b609bea07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:38.746418 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b95bdb-6ed3-41a4-8756-522b609bea07 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:38.760348 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-79b95bdb-6ed3-41a4-8756-522b609bea07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:38.765646 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 307/618] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:38.770367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0969dd6-523b-4cdb-adc9-9b857182a00c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:38.886931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0969dd6-523b-4cdb-adc9-9b857182a00c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:38.919565 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fc8ac-3e1f-485c-9efb-af8b6c101010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:38.920253 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fc8ac-3e1f-485c-9efb-af8b6c101010 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:38.920531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fc8ac-3e1f-485c-9efb-af8b6c101010 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:38.920887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fc8ac-3e1f-485c-9efb-af8b6c101010 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:38.921662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fc8ac-3e1f-485c-9efb-af8b6c101010 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:38.921970 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fc8ac-3e1f-485c-9efb-af8b6c101010 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:38.923499 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fc8ac-3e1f-485c-9efb-af8b6c101010 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:38.938097 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 312/619] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:38.946118 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b95bdb-6ed3-41a4-8756-522b609bea07 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:39.043404 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954478eb-c6dd-47c8-a40d-3bec093f49c3 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:39.043737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954478eb-c6dd-47c8-a40d-3bec093f49c3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:39.046080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954478eb-c6dd-47c8-a40d-3bec093f49c3 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:39.049848 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 313/620] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:39.051539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c5d42-de1a-4fc9-82c5-cfc60cd07973 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:39.051961 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c5d42-de1a-4fc9-82c5-cfc60cd07973 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:39.052258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c5d42-de1a-4fc9-82c5-cfc60cd07973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:39.070664 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b95bdb-6ed3-41a4-8756-522b609bea07 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:39.085403 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c92c5d42-de1a-4fc9-82c5-cfc60cd07973 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:39.086847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c92c5d42-de1a-4fc9-82c5-cfc60cd07973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:39.131366 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5b34a-1b56-41b8-a80d-7795e952c646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:39.133527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5b34a-1b56-41b8-a80d-7795e952c646 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:39.134036 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5b34a-1b56-41b8-a80d-7795e952c646 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:39.134514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5b34a-1b56-41b8-a80d-7795e952c646 None admin] PATH_INFO: `/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/89101c5ca3b048939a46b0bb246d2cbd/roles/07e6d0f9bf5345c99ce158cd3e62c1c5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:39.159419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5b34a-1b56-41b8-a80d-7795e952c646 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4306a6b12434cc495650e4f3b9afbde, user_id=89101c5ca3b048939a46b0bb246d2cbd, role_id=07e6d0f9bf5345c99ce158cd3e62c1c5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:39.162733 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5b34a-1b56-41b8-a80d-7795e952c646 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:39.205757 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 314/621] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:49:39.231243 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c5d42-de1a-4fc9-82c5-cfc60cd07973 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:39.297256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 308/622] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:49:38 2022] PUT /identity/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/89101c5ca3b048939a46b0bb246d2cbd/roles/07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:49:39.333822 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c5d42-de1a-4fc9-82c5-cfc60cd07973 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:39.376879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78ef6b-3e7a-4789-9476-93f17e65444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:39.377749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78ef6b-3e7a-4789-9476-93f17e65444a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:39.378030 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78ef6b-3e7a-4789-9476-93f17e65444a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:39.378303 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78ef6b-3e7a-4789-9476-93f17e65444a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:39.395180 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78ef6b-3e7a-4789-9476-93f17e65444a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:39.403030 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-fa78ef6b-3e7a-4789-9476-93f17e65444a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:39.404659 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 315/623] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:39.410799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5b34a-1b56-41b8-a80d-7795e952c646 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:39.580985 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5b34a-1b56-41b8-a80d-7795e952c646 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:39.619063 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb56e41-3f2f-4775-82ef-7d7b6a55a6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:39.619748 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb56e41-3f2f-4775-82ef-7d7b6a55a6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:39.620025 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb56e41-3f2f-4775-82ef-7d7b6a55a6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:39.620297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb56e41-3f2f-4775-82ef-7d7b6a55a6f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:39.621358 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb56e41-3f2f-4775-82ef-7d7b6a55a6f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:39.621669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb56e41-3f2f-4775-82ef-7d7b6a55a6f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:39.623133 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb56e41-3f2f-4775-82ef-7d7b6a55a6f6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:39.632935 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 309/624] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:39.638720 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78ef6b-3e7a-4789-9476-93f17e65444a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:39.754344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78ef6b-3e7a-4789-9476-93f17e65444a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:39.790117 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c047d7b-195f-4179-9344-fa345dc2958f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:39.791218 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c047d7b-195f-4179-9344-fa345dc2958f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:39.797168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c047d7b-195f-4179-9344-fa345dc2958f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:39.797168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c047d7b-195f-4179-9344-fa345dc2958f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:39.809999 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c047d7b-195f-4179-9344-fa345dc2958f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:39.811445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c047d7b-195f-4179-9344-fa345dc2958f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:39.831198 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-3c047d7b-195f-4179-9344-fa345dc2958f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:39.833720 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 316/625] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:39.838951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb56e41-3f2f-4775-82ef-7d7b6a55a6f6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:39.996952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb56e41-3f2f-4775-82ef-7d7b6a55a6f6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:40.043635 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad01734-6d2d-4471-beab-1c96bb0ebb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:40.044301 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad01734-6d2d-4471-beab-1c96bb0ebb59 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:40.044581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad01734-6d2d-4471-beab-1c96bb0ebb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:40.044854 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad01734-6d2d-4471-beab-1c96bb0ebb59 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:40.045609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad01734-6d2d-4471-beab-1c96bb0ebb59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:40.045916 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad01734-6d2d-4471-beab-1c96bb0ebb59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:40.047324 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad01734-6d2d-4471-beab-1c96bb0ebb59 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:40.067197 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 310/626] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:40.073259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c047d7b-195f-4179-9344-fa345dc2958f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:40.122832 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512f9fb-14f9-4b7b-99f1-02c442c17e3a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:40.123502 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512f9fb-14f9-4b7b-99f1-02c442c17e3a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:40.123989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512f9fb-14f9-4b7b-99f1-02c442c17e3a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:40.125560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 311/627] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:49:40.133088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98d6fc-166a-4cb3-9598-8c7eb7f0c8b7 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:40.133088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98d6fc-166a-4cb3-9598-8c7eb7f0c8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:40.133088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98d6fc-166a-4cb3-9598-8c7eb7f0c8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:40.161562 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-da98d6fc-166a-4cb3-9598-8c7eb7f0c8b7 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:40.163592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-da98d6fc-166a-4cb3-9598-8c7eb7f0c8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:40.189386 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c047d7b-195f-4179-9344-fa345dc2958f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:40.229686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d31c5c-816c-413d-9225-e3fd268ed224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:40.231859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d31c5c-816c-413d-9225-e3fd268ed224 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:40.233317 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d31c5c-816c-413d-9225-e3fd268ed224 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:40.233808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d31c5c-816c-413d-9225-e3fd268ed224 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:40.253466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d31c5c-816c-413d-9225-e3fd268ed224 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:40.255316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d31c5c-816c-413d-9225-e3fd268ed224 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:40.280744 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-35d31c5c-816c-413d-9225-e3fd268ed224 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 10:49:40.281989 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 317/628] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Apr 6 10:49:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:40.285004 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 312/629] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:40.287383 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d31c5c-816c-413d-9225-e3fd268ed224 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:40.307792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a17166-339e-4ad8-a1d1-7ea5770ddda5 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:40.308759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a17166-339e-4ad8-a1d1-7ea5770ddda5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:40.309273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a17166-339e-4ad8-a1d1-7ea5770ddda5 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:40.310814 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 313/630] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:49:40.315875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be402746-a8e0-48e5-a962-0205d894e654 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:40.316396 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be402746-a8e0-48e5-a962-0205d894e654 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:40.316879 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be402746-a8e0-48e5-a962-0205d894e654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:40.334180 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-be402746-a8e0-48e5-a962-0205d894e654 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:40.336283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-be402746-a8e0-48e5-a962-0205d894e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:40.395244 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d31c5c-816c-413d-9225-e3fd268ed224 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:40.407357 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 314/631] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:49:40.408659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be402746-a8e0-48e5-a962-0205d894e654 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:40.442408 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e9a07-e4b9-43d3-b509-8d673f3944da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:40.443100 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9a07-e4b9-43d3-b509-8d673f3944da None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:40.443388 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9a07-e4b9-43d3-b509-8d673f3944da None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:40.443884 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9a07-e4b9-43d3-b509-8d673f3944da None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:40.444534 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e9a07-e4b9-43d3-b509-8d673f3944da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:40.444841 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e9a07-e4b9-43d3-b509-8d673f3944da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:40.446302 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e9a07-e4b9-43d3-b509-8d673f3944da None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:40.471101 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 318/632] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Apr 6 10:49:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:40.471991 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e9a07-e4b9-43d3-b509-8d673f3944da None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:40.514202 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be402746-a8e0-48e5-a962-0205d894e654 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:40.550404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ebfa7-1bba-4694-bfcd-f02c6c63ec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:40.551544 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ebfa7-1bba-4694-bfcd-f02c6c63ec27 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:40.552020 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ebfa7-1bba-4694-bfcd-f02c6c63ec27 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:40.552526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ebfa7-1bba-4694-bfcd-f02c6c63ec27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:40.565746 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ebfa7-1bba-4694-bfcd-f02c6c63ec27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:40.573517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-3d5ebfa7-1bba-4694-bfcd-f02c6c63ec27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:40.573671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e9a07-e4b9-43d3-b509-8d673f3944da None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:40.575476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 315/633] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:40.576525 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ebfa7-1bba-4694-bfcd-f02c6c63ec27 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:40.615392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ad149-460d-4a76-9ea5-e3bcfb46e0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:40.616263 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ad149-460d-4a76-9ea5-e3bcfb46e0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:40.616545 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ad149-460d-4a76-9ea5-e3bcfb46e0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:40.617776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ad149-460d-4a76-9ea5-e3bcfb46e0c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:40.628851 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ad149-460d-4a76-9ea5-e3bcfb46e0c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:40.636114 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-087ad149-460d-4a76-9ea5-e3bcfb46e0c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:40.642255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 319/634] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:40.643154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ad149-460d-4a76-9ea5-e3bcfb46e0c0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:40.686714 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ebfa7-1bba-4694-bfcd-f02c6c63ec27 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:40.720828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0f326-f85b-4231-9adc-0ec96905d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:40.721830 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0f326-f85b-4231-9adc-0ec96905d55c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:40.722295 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0f326-f85b-4231-9adc-0ec96905d55c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:40.722788 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0f326-f85b-4231-9adc-0ec96905d55c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:40.743422 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ad149-460d-4a76-9ea5-e3bcfb46e0c0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:40.777885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbe61e-1aa7-4a85-af6d-8bac741ef24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:40.778567 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe61e-1aa7-4a85-af6d-8bac741ef24f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:40.778924 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe61e-1aa7-4a85-af6d-8bac741ef24f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:40.779254 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe61e-1aa7-4a85-af6d-8bac741ef24f None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:40.780073 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbe61e-1aa7-4a85-af6d-8bac741ef24f None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:40.780447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbe61e-1aa7-4a85-af6d-8bac741ef24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:40.781920 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbe61e-1aa7-4a85-af6d-8bac741ef24f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:40.795030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0f326-f85b-4231-9adc-0ec96905d55c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:40.795248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 320/635] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:40.796119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbe61e-1aa7-4a85-af6d-8bac741ef24f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:40.797143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0f326-f85b-4231-9adc-0ec96905d55c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:40.896136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbe61e-1aa7-4a85-af6d-8bac741ef24f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:40.898368 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 316/636] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:40.899602 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0f326-f85b-4231-9adc-0ec96905d55c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:40.936125 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581529ab-a517-4a07-8bfe-2e0070df0f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:40.936809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581529ab-a517-4a07-8bfe-2e0070df0f63 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:40.937370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581529ab-a517-4a07-8bfe-2e0070df0f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:40.937646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581529ab-a517-4a07-8bfe-2e0070df0f63 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:40.938394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581529ab-a517-4a07-8bfe-2e0070df0f63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:40.938710 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581529ab-a517-4a07-8bfe-2e0070df0f63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:40.940059 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581529ab-a517-4a07-8bfe-2e0070df0f63 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:40.953374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 321/637] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:40.954249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581529ab-a517-4a07-8bfe-2e0070df0f63 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:41.001699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0f326-f85b-4231-9adc-0ec96905d55c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:41.038954 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443d203-420f-4d72-906b-d3ba30b548f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:41.039668 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443d203-420f-4d72-906b-d3ba30b548f1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:41.039948 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443d203-420f-4d72-906b-d3ba30b548f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:41.040218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443d203-420f-4d72-906b-d3ba30b548f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:41.051262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443d203-420f-4d72-906b-d3ba30b548f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:41.052755 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443d203-420f-4d72-906b-d3ba30b548f1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:41.054444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581529ab-a517-4a07-8bfe-2e0070df0f63 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:41.069533 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-7443d203-420f-4d72-906b-d3ba30b548f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:41.075222 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 317/638] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:41.075222 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443d203-420f-4d72-906b-d3ba30b548f1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:41.092738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce57b2-28bf-451d-9ced-e8efdf69c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:41.093560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce57b2-28bf-451d-9ced-e8efdf69c1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:41.093834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce57b2-28bf-451d-9ced-e8efdf69c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:41.094121 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce57b2-28bf-451d-9ced-e8efdf69c1d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:41.104162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce57b2-28bf-451d-9ced-e8efdf69c1d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:41.105690 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce57b2-28bf-451d-9ced-e8efdf69c1d3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:41.121581 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-93ce57b2-28bf-451d-9ced-e8efdf69c1d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:41.122758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 322/639] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:41.124097 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e8542-7b68-4eab-a9c8-911c02176030 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:41.124430 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e8542-7b68-4eab-a9c8-911c02176030 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:41.124703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e8542-7b68-4eab-a9c8-911c02176030 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:41.126104 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 323/640] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:41.126686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e8542-7b68-4eab-a9c8-911c02176030 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:41.182503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443d203-420f-4d72-906b-d3ba30b548f1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:41.215319 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d3d08-5e3e-4d9c-81f7-43341f857edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:41.216098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d3d08-5e3e-4d9c-81f7-43341f857edf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:41.216373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d3d08-5e3e-4d9c-81f7-43341f857edf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:41.216647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d3d08-5e3e-4d9c-81f7-43341f857edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:41.225785 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e8542-7b68-4eab-a9c8-911c02176030 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:41.226400 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d3d08-5e3e-4d9c-81f7-43341f857edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:41.228045 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d3d08-5e3e-4d9c-81f7-43341f857edf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:41.244249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-062d3d08-5e3e-4d9c-81f7-43341f857edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:41.245971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 318/641] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:41.246555 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d3d08-5e3e-4d9c-81f7-43341f857edf None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:41.263373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b8a74-63de-47a2-97c7-0f519d25e9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:41.264041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b8a74-63de-47a2-97c7-0f519d25e9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:41.264334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b8a74-63de-47a2-97c7-0f519d25e9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:41.264591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b8a74-63de-47a2-97c7-0f519d25e9a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:41.265338 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b8a74-63de-47a2-97c7-0f519d25e9a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:41.265644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b8a74-63de-47a2-97c7-0f519d25e9a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:41.266998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b8a74-63de-47a2-97c7-0f519d25e9a8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:41.278968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 324/642] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:41.280247 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0806460-576a-4164-bec6-4a49006c6103 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:41.280534 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0806460-576a-4164-bec6-4a49006c6103 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:41.280807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0806460-576a-4164-bec6-4a49006c6103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:41.297175 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-f0806460-576a-4164-bec6-4a49006c6103 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:41.298274 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f0806460-576a-4164-bec6-4a49006c6103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:41.346498 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d3d08-5e3e-4d9c-81f7-43341f857edf None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:41.369082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 325/643] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:41.369082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0806460-576a-4164-bec6-4a49006c6103 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:41.384104 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332f169-e2f3-4fda-9a2d-ec01dbd5794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:41.384816 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332f169-e2f3-4fda-9a2d-ec01dbd5794a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:41.385124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332f169-e2f3-4fda-9a2d-ec01dbd5794a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:41.385398 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332f169-e2f3-4fda-9a2d-ec01dbd5794a None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:41.386113 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332f169-e2f3-4fda-9a2d-ec01dbd5794a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:41.386413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332f169-e2f3-4fda-9a2d-ec01dbd5794a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:41.387859 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332f169-e2f3-4fda-9a2d-ec01dbd5794a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:41.399122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 319/644] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:41.399938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332f169-e2f3-4fda-9a2d-ec01dbd5794a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:41.484489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0806460-576a-4164-bec6-4a49006c6103 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:41.499533 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332f169-e2f3-4fda-9a2d-ec01dbd5794a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:41.518891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed1279-0fe9-46f9-859b-59de52ef3716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:41.519579 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed1279-0fe9-46f9-859b-59de52ef3716 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:41.519869 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed1279-0fe9-46f9-859b-59de52ef3716 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:41.520133 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed1279-0fe9-46f9-859b-59de52ef3716 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:41.520847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed1279-0fe9-46f9-859b-59de52ef3716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:41.521189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed1279-0fe9-46f9-859b-59de52ef3716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:41.522576 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed1279-0fe9-46f9-859b-59de52ef3716 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:41.537741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 326/645] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:41.537741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed1279-0fe9-46f9-859b-59de52ef3716 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:41.540010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4ef99-9b4d-40ab-bdc6-1136589b53bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:41.540814 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4ef99-9b4d-40ab-bdc6-1136589b53bf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:41.541126 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4ef99-9b4d-40ab-bdc6-1136589b53bf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:41.541405 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4ef99-9b4d-40ab-bdc6-1136589b53bf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:41.549146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4ef99-9b4d-40ab-bdc6-1136589b53bf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:41.550568 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4ef99-9b4d-40ab-bdc6-1136589b53bf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:41.564494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-68c4ef99-9b4d-40ab-bdc6-1136589b53bf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 06 10:49:41.570711 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 320/646] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:41.570711 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4ef99-9b4d-40ab-bdc6-1136589b53bf None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:41.641576 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed1279-0fe9-46f9-859b-59de52ef3716 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:41.663712 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4ef99-9b4d-40ab-bdc6-1136589b53bf None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:41.680724 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581692d-df9c-4f61-819f-ff9ffb99d77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:41.681568 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581692d-df9c-4f61-819f-ff9ffb99d77a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:41.681844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581692d-df9c-4f61-819f-ff9ffb99d77a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:41.682117 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581692d-df9c-4f61-819f-ff9ffb99d77a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:41.692287 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581692d-df9c-4f61-819f-ff9ffb99d77a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:41.699308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cc37d-dda9-41d7-8fc7-d008149bd612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:41.700085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-a581692d-df9c-4f61-819f-ff9ffb99d77a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:41.700656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cc37d-dda9-41d7-8fc7-d008149bd612 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:41.701145 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cc37d-dda9-41d7-8fc7-d008149bd612 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:41.701598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cc37d-dda9-41d7-8fc7-d008149bd612 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:41.701703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 327/647] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:41.702532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581692d-df9c-4f61-819f-ff9ffb99d77a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:41.714227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cc37d-dda9-41d7-8fc7-d008149bd612 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:41.716890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cc37d-dda9-41d7-8fc7-d008149bd612 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:41.736310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-b36cc37d-dda9-41d7-8fc7-d008149bd612 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:41.738046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 321/648] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:41.739886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cc37d-dda9-41d7-8fc7-d008149bd612 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:41.807729 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581692d-df9c-4f61-819f-ff9ffb99d77a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:41.846095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cc37d-dda9-41d7-8fc7-d008149bd612 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:41.847814 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5eeff-0ea4-470c-b1bc-a243f08ee83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:41.848891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5eeff-0ea4-470c-b1bc-a243f08ee83a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:41.848891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5eeff-0ea4-470c-b1bc-a243f08ee83a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:41.849193 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5eeff-0ea4-470c-b1bc-a243f08ee83a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:41.856740 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5eeff-0ea4-470c-b1bc-a243f08ee83a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:41.858216 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5eeff-0ea4-470c-b1bc-a243f08ee83a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:41.871391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-bcd5eeff-0ea4-470c-b1bc-a243f08ee83a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 06 10:49:41.877141 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 328/649] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:41.877141 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5eeff-0ea4-470c-b1bc-a243f08ee83a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:41.884209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e5e79-ce07-44d2-80f7-b6638744ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:41.884882 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e5e79-ce07-44d2-80f7-b6638744ccc6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:41.885209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e5e79-ce07-44d2-80f7-b6638744ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:41.885489 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e5e79-ce07-44d2-80f7-b6638744ccc6 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:41.886740 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e5e79-ce07-44d2-80f7-b6638744ccc6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:41.887054 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e5e79-ce07-44d2-80f7-b6638744ccc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:41.889249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e5e79-ce07-44d2-80f7-b6638744ccc6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:41.916826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 322/650] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Apr 6 10:49:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:41.916826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e5e79-ce07-44d2-80f7-b6638744ccc6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:41.974601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5eeff-0ea4-470c-b1bc-a243f08ee83a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:42.007322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e6f60-dc29-4eda-be94-5c726b293ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:42.007985 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e6f60-dc29-4eda-be94-5c726b293ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:42.008270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e6f60-dc29-4eda-be94-5c726b293ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:42.008540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e6f60-dc29-4eda-be94-5c726b293ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:42.009308 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e6f60-dc29-4eda-be94-5c726b293ef8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:42.009610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e6f60-dc29-4eda-be94-5c726b293ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:42.010963 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e6f60-dc29-4eda-be94-5c726b293ef8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:42.015283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e5e79-ce07-44d2-80f7-b6638744ccc6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:42.018756 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 329/651] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:42.019560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e6f60-dc29-4eda-be94-5c726b293ef8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:42.049909 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cce42-6bd3-47e5-885a-74d86b8961c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:42.050796 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cce42-6bd3-47e5-885a-74d86b8961c1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:42.051337 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cce42-6bd3-47e5-885a-74d86b8961c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:42.051754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cce42-6bd3-47e5-885a-74d86b8961c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:42.052684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cce42-6bd3-47e5-885a-74d86b8961c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:42.053162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cce42-6bd3-47e5-885a-74d86b8961c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:42.055229 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cce42-6bd3-47e5-885a-74d86b8961c1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:42.066791 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 323/652] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:42.067769 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cce42-6bd3-47e5-885a-74d86b8961c1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:42.125682 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e6f60-dc29-4eda-be94-5c726b293ef8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:42.156886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324df3ab-d592-4964-9433-e42affdcd0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:42.157577 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324df3ab-d592-4964-9433-e42affdcd0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:42.157855 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324df3ab-d592-4964-9433-e42affdcd0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:42.158124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324df3ab-d592-4964-9433-e42affdcd0b3 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:42.158943 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324df3ab-d592-4964-9433-e42affdcd0b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:42.159249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324df3ab-d592-4964-9433-e42affdcd0b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:42.160655 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324df3ab-d592-4964-9433-e42affdcd0b3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:42.161662 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cce42-6bd3-47e5-885a-74d86b8961c1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:42.176919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 330/653] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Apr 6 10:49:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:42.177734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324df3ab-d592-4964-9433-e42affdcd0b3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:42.195375 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172abbb1-61d9-4fc9-b1fd-6a013d34e913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:42.196023 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172abbb1-61d9-4fc9-b1fd-6a013d34e913 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:42.196305 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172abbb1-61d9-4fc9-b1fd-6a013d34e913 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:42.196580 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172abbb1-61d9-4fc9-b1fd-6a013d34e913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:42.260093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172abbb1-61d9-4fc9-b1fd-6a013d34e913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:42.261620 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172abbb1-61d9-4fc9-b1fd-6a013d34e913 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:42.272555 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324df3ab-d592-4964-9433-e42affdcd0b3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:42.303313 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c2e40-0e6e-47a5-ac04-ab2e1d21c76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:42.304607 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c2e40-0e6e-47a5-ac04-ab2e1d21c76c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:42.304884 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c2e40-0e6e-47a5-ac04-ab2e1d21c76c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:42.305187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c2e40-0e6e-47a5-ac04-ab2e1d21c76c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:42.314792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c2e40-0e6e-47a5-ac04-ab2e1d21c76c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:42.316234 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c2e40-0e6e-47a5-ac04-ab2e1d21c76c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:42.332703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-230c2e40-0e6e-47a5-ac04-ab2e1d21c76c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:42.333836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 331/654] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:42.334685 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c2e40-0e6e-47a5-ac04-ab2e1d21c76c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:42.355470 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 324/655] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:42.356620 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147b04a-3878-4886-a0fe-ee2a90dd6c70 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:42.356905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147b04a-3878-4886-a0fe-ee2a90dd6c70 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:42.357201 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147b04a-3878-4886-a0fe-ee2a90dd6c70 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:42.358617 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 325/656] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:42.359127 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147b04a-3878-4886-a0fe-ee2a90dd6c70 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:42.434608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c2e40-0e6e-47a5-ac04-ab2e1d21c76c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:42.460900 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147b04a-3878-4886-a0fe-ee2a90dd6c70 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:42.466720 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9245ed4-f9fd-4ecf-9d79-f820c7ba4027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:42.467370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9245ed4-f9fd-4ecf-9d79-f820c7ba4027 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:42.467652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9245ed4-f9fd-4ecf-9d79-f820c7ba4027 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:42.467925 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9245ed4-f9fd-4ecf-9d79-f820c7ba4027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:42.468745 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9245ed4-f9fd-4ecf-9d79-f820c7ba4027 None admin] RBAC: Adding query filter params (role.id=07e6d0f9bf5345c99ce158cd3e62c1c5, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=650c5809116e4bcd808044236c06dcc2) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:42.469069 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9245ed4-f9fd-4ecf-9d79-f820c7ba4027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:42.470492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9245ed4-f9fd-4ecf-9d79-f820c7ba4027 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:42.476280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 332/657] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:49:42 2022] GET /identity/v3/role_assignments?user.id=650c5809116e4bcd808044236c06dcc2&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:42.477261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9245ed4-f9fd-4ecf-9d79-f820c7ba4027 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:42.493995 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cece5-dcc8-42e9-9c93-d08ae48c3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:42.494660 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cece5-dcc8-42e9-9c93-d08ae48c3f0b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:42.494951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cece5-dcc8-42e9-9c93-d08ae48c3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:42.495217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cece5-dcc8-42e9-9c93-d08ae48c3f0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:42.574917 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834cece5-dcc8-42e9-9c93-d08ae48c3f0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:42.576846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834cece5-dcc8-42e9-9c93-d08ae48c3f0b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:42.582299 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9245ed4-f9fd-4ecf-9d79-f820c7ba4027 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:42.616812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4a29-01e1-4f7a-9cfc-a7e793d9b91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:42.617452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4a29-01e1-4f7a-9cfc-a7e793d9b91c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:42.617735 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4a29-01e1-4f7a-9cfc-a7e793d9b91c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:42.618013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4a29-01e1-4f7a-9cfc-a7e793d9b91c None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:42.618743 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada4a29-01e1-4f7a-9cfc-a7e793d9b91c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:42.619050 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada4a29-01e1-4f7a-9cfc-a7e793d9b91c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:42.620449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada4a29-01e1-4f7a-9cfc-a7e793d9b91c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:42.637853 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 333/658] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:42.637853 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4a29-01e1-4f7a-9cfc-a7e793d9b91c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:42.692051 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 326/659] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:42.694612 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97084152-fe70-421c-9d45-6c363eae95c8 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:42.694905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97084152-fe70-421c-9d45-6c363eae95c8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:42.695180 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97084152-fe70-421c-9d45-6c363eae95c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:42.713133 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-97084152-fe70-421c-9d45-6c363eae95c8 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:42.715933 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-97084152-fe70-421c-9d45-6c363eae95c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:42.753362 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4a29-01e1-4f7a-9cfc-a7e793d9b91c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:42.786613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 327/660] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:42.787529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97084152-fe70-421c-9d45-6c363eae95c8 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:42.799204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b123cfe-2a89-4510-9a3a-14683b980184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:42.800617 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b123cfe-2a89-4510-9a3a-14683b980184 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:42.804211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b123cfe-2a89-4510-9a3a-14683b980184 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:42.804211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b123cfe-2a89-4510-9a3a-14683b980184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:42.816259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b123cfe-2a89-4510-9a3a-14683b980184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:42.818124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b123cfe-2a89-4510-9a3a-14683b980184 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:42.836336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-1b123cfe-2a89-4510-9a3a-14683b980184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:42.842146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 334/661] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:42.842146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b123cfe-2a89-4510-9a3a-14683b980184 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:42.885363 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97084152-fe70-421c-9d45-6c363eae95c8 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:42.919246 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917742c-3787-4686-aaaf-21c1f336e28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:42.920049 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917742c-3787-4686-aaaf-21c1f336e28b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:42.920567 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917742c-3787-4686-aaaf-21c1f336e28b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:42.920567 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917742c-3787-4686-aaaf-21c1f336e28b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:42.927726 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917742c-3787-4686-aaaf-21c1f336e28b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:42.929286 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917742c-3787-4686-aaaf-21c1f336e28b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:42.937621 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b123cfe-2a89-4510-9a3a-14683b980184 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:42.943703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-0917742c-3787-4686-aaaf-21c1f336e28b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 06 10:49:42.949358 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 328/662] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:42.949358 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917742c-3787-4686-aaaf-21c1f336e28b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:42.974194 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24415951-ac7b-41d3-a394-9c42bdc3ae2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:42.974995 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24415951-ac7b-41d3-a394-9c42bdc3ae2d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:42.975904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24415951-ac7b-41d3-a394-9c42bdc3ae2d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:42.976182 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24415951-ac7b-41d3-a394-9c42bdc3ae2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:42.986411 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24415951-ac7b-41d3-a394-9c42bdc3ae2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:42.987842 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24415951-ac7b-41d3-a394-9c42bdc3ae2d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:43.003726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-24415951-ac7b-41d3-a394-9c42bdc3ae2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:43.009655 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 335/663] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:43.009655 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24415951-ac7b-41d3-a394-9c42bdc3ae2d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:43.041910 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917742c-3787-4686-aaaf-21c1f336e28b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:43.077159 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4855d44-5b45-4dba-bb7c-192e15c35329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:43.078032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855d44-5b45-4dba-bb7c-192e15c35329 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:43.078312 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855d44-5b45-4dba-bb7c-192e15c35329 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:43.078581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855d44-5b45-4dba-bb7c-192e15c35329 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:43.089363 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4855d44-5b45-4dba-bb7c-192e15c35329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:43.096348 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-d4855d44-5b45-4dba-bb7c-192e15c35329 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:43.102687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 329/664] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:43.102687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4855d44-5b45-4dba-bb7c-192e15c35329 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:43.106364 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24415951-ac7b-41d3-a394-9c42bdc3ae2d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:43.140156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae10704-a7dc-4805-97c1-393428b70db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:43.140771 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae10704-a7dc-4805-97c1-393428b70db7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:43.141029 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae10704-a7dc-4805-97c1-393428b70db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:43.141330 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae10704-a7dc-4805-97c1-393428b70db7 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:43.142053 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae10704-a7dc-4805-97c1-393428b70db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:43.142357 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae10704-a7dc-4805-97c1-393428b70db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:43.143731 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae10704-a7dc-4805-97c1-393428b70db7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:43.155595 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 336/665] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:43.156763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae10704-a7dc-4805-97c1-393428b70db7 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:43.209525 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4855d44-5b45-4dba-bb7c-192e15c35329 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:43.242616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880c729-3df4-4465-9310-0351b7c1339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:43.243284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880c729-3df4-4465-9310-0351b7c1339a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:43.243566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880c729-3df4-4465-9310-0351b7c1339a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:43.243852 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880c729-3df4-4465-9310-0351b7c1339a None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:43.244666 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880c729-3df4-4465-9310-0351b7c1339a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:43.244974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880c729-3df4-4465-9310-0351b7c1339a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:43.246487 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880c729-3df4-4465-9310-0351b7c1339a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:43.255482 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae10704-a7dc-4805-97c1-393428b70db7 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:43.263294 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 330/666] 10.222.0.62 () {56 vars in 1139 bytes} [Wed Apr 6 10:49:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:43.264384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880c729-3df4-4465-9310-0351b7c1339a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:43.287610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae7c00-2aee-4e3a-8218-eec601e1c26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:43.288797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae7c00-2aee-4e3a-8218-eec601e1c26c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:43.289096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae7c00-2aee-4e3a-8218-eec601e1c26c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:43.289376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae7c00-2aee-4e3a-8218-eec601e1c26c None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:43.290087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae7c00-2aee-4e3a-8218-eec601e1c26c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:43.290394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae7c00-2aee-4e3a-8218-eec601e1c26c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:43.291758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae7c00-2aee-4e3a-8218-eec601e1c26c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:43.302719 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 337/667] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:43.304208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae7c00-2aee-4e3a-8218-eec601e1c26c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:43.368468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880c729-3df4-4465-9310-0351b7c1339a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:43.401452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8d0cc-a25f-4c60-90ba-d86d0020faa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:43.402096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8d0cc-a25f-4c60-90ba-d86d0020faa0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:43.402376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8d0cc-a25f-4c60-90ba-d86d0020faa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:43.402655 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8d0cc-a25f-4c60-90ba-d86d0020faa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:43.403422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8d0cc-a25f-4c60-90ba-d86d0020faa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:43.403722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8d0cc-a25f-4c60-90ba-d86d0020faa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:43.404099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae7c00-2aee-4e3a-8218-eec601e1c26c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:43.405142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8d0cc-a25f-4c60-90ba-d86d0020faa0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:43.418332 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 331/668] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:43.418332 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8d0cc-a25f-4c60-90ba-d86d0020faa0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:43.443613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5358a-4c7c-4c66-80d6-b3af25599463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:43.444926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5358a-4c7c-4c66-80d6-b3af25599463 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:43.445286 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5358a-4c7c-4c66-80d6-b3af25599463 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:43.445581 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5358a-4c7c-4c66-80d6-b3af25599463 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:43.452378 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5358a-4c7c-4c66-80d6-b3af25599463 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:43.453882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5358a-4c7c-4c66-80d6-b3af25599463 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:43.467980 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-65d5358a-4c7c-4c66-80d6-b3af25599463 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:43.469327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 338/669] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:43.469931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5358a-4c7c-4c66-80d6-b3af25599463 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:43.516182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8d0cc-a25f-4c60-90ba-d86d0020faa0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:43.549440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549511f-441e-4f6d-8f47-c448412ef041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:43.550088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549511f-441e-4f6d-8f47-c448412ef041 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:43.550362 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549511f-441e-4f6d-8f47-c448412ef041 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:43.550631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549511f-441e-4f6d-8f47-c448412ef041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:43.567377 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5358a-4c7c-4c66-80d6-b3af25599463 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:43.601339 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60064747-086c-459e-b40c-658fc3fdd621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:43.602130 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60064747-086c-459e-b40c-658fc3fdd621 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:43.602411 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60064747-086c-459e-b40c-658fc3fdd621 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:43.602679 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60064747-086c-459e-b40c-658fc3fdd621 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:43.609237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60064747-086c-459e-b40c-658fc3fdd621 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:43.610659 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60064747-086c-459e-b40c-658fc3fdd621 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:43.618342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549511f-441e-4f6d-8f47-c448412ef041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:43.619817 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549511f-441e-4f6d-8f47-c448412ef041 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:43.623923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-60064747-086c-459e-b40c-658fc3fdd621 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:43.629609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 339/670] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:43.629609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60064747-086c-459e-b40c-658fc3fdd621 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:43.724005 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 332/671] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:43.724005 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549511f-441e-4f6d-8f47-c448412ef041 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:43.736155 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60064747-086c-459e-b40c-658fc3fdd621 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:43.769683 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd254691-3656-4550-a2d7-895f24998dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:43.770480 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd254691-3656-4550-a2d7-895f24998dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:43.770760 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd254691-3656-4550-a2d7-895f24998dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:43.771033 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd254691-3656-4550-a2d7-895f24998dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:43.781541 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd254691-3656-4550-a2d7-895f24998dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:43.783060 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd254691-3656-4550-a2d7-895f24998dc3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:43.799248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-fd254691-3656-4550-a2d7-895f24998dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:43.805817 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 340/672] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:43.805817 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd254691-3656-4550-a2d7-895f24998dc3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:43.818494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549511f-441e-4f6d-8f47-c448412ef041 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:43.851430 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980767c0-1a12-41eb-bda3-27df53c2dd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:43.852086 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980767c0-1a12-41eb-bda3-27df53c2dd53 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:43.852367 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980767c0-1a12-41eb-bda3-27df53c2dd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:43.852639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980767c0-1a12-41eb-bda3-27df53c2dd53 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:43.853449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980767c0-1a12-41eb-bda3-27df53c2dd53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:43.853751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980767c0-1a12-41eb-bda3-27df53c2dd53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:43.855233 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980767c0-1a12-41eb-bda3-27df53c2dd53 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:43.866699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 333/673] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:43.867479 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980767c0-1a12-41eb-bda3-27df53c2dd53 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:43.910502 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd254691-3656-4550-a2d7-895f24998dc3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:43.949228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954750f-6d4d-42f5-a32f-199063c167e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:43.949797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954750f-6d4d-42f5-a32f-199063c167e9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:43.950075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954750f-6d4d-42f5-a32f-199063c167e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:43.950348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954750f-6d4d-42f5-a32f-199063c167e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:43.951125 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954750f-6d4d-42f5-a32f-199063c167e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:43.951430 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954750f-6d4d-42f5-a32f-199063c167e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:43.952845 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954750f-6d4d-42f5-a32f-199063c167e9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:43.970065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 341/674] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:43.970237 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980767c0-1a12-41eb-bda3-27df53c2dd53 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:43.970316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954750f-6d4d-42f5-a32f-199063c167e9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:44.000715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d2a33-a1f2-4a0e-b768-855ce6135656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:44.001540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d2a33-a1f2-4a0e-b768-855ce6135656 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:44.001824 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d2a33-a1f2-4a0e-b768-855ce6135656 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:44.002097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d2a33-a1f2-4a0e-b768-855ce6135656 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:44.012521 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d2a33-a1f2-4a0e-b768-855ce6135656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:44.014028 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d2a33-a1f2-4a0e-b768-855ce6135656 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:44.030194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-564d2a33-a1f2-4a0e-b768-855ce6135656 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:44.035615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 334/675] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:44.035615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d2a33-a1f2-4a0e-b768-855ce6135656 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:44.075569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954750f-6d4d-42f5-a32f-199063c167e9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:44.112832 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337372a1-248b-4e92-a1ba-faae744e08e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:44.113530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337372a1-248b-4e92-a1ba-faae744e08e2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:44.113811 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337372a1-248b-4e92-a1ba-faae744e08e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:44.114229 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337372a1-248b-4e92-a1ba-faae744e08e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:44.114966 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337372a1-248b-4e92-a1ba-faae744e08e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:44.115438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337372a1-248b-4e92-a1ba-faae744e08e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:44.117781 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337372a1-248b-4e92-a1ba-faae744e08e2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:44.135165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 342/676] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:44.135165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337372a1-248b-4e92-a1ba-faae744e08e2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:44.159272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d2a33-a1f2-4a0e-b768-855ce6135656 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:44.203203 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3dac8-98a2-494e-bacb-b7a203876c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:44.204201 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3dac8-98a2-494e-bacb-b7a203876c41 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:44.204692 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3dac8-98a2-494e-bacb-b7a203876c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:44.205319 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3dac8-98a2-494e-bacb-b7a203876c41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:44.206944 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3dac8-98a2-494e-bacb-b7a203876c41 None admin] RBAC: Adding query filter params (role.id=07e6d0f9bf5345c99ce158cd3e62c1c5, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=5d07bf80c4f741e68d14665b092edcff) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:44.207739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3dac8-98a2-494e-bacb-b7a203876c41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:44.210464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3dac8-98a2-494e-bacb-b7a203876c41 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:44.217988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 335/677] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:49:44 2022] GET /identity/v3/role_assignments?user.id=5d07bf80c4f741e68d14665b092edcff&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:44.219093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3dac8-98a2-494e-bacb-b7a203876c41 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:44.308540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337372a1-248b-4e92-a1ba-faae744e08e2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:44.349746 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3dac8-98a2-494e-bacb-b7a203876c41 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:44.375911 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbac5dd-086d-48f8-b536-2bdca43b01b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:44.376982 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac5dd-086d-48f8-b536-2bdca43b01b6 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:44.379178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac5dd-086d-48f8-b536-2bdca43b01b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:44.379676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac5dd-086d-48f8-b536-2bdca43b01b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:44.380751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbac5dd-086d-48f8-b536-2bdca43b01b6 None admin] RBAC: Adding query filter params (role.id=07e6d0f9bf5345c99ce158cd3e62c1c5, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=42cd381cf5c745de9dac8f77a8cea554) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:44.382717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbac5dd-086d-48f8-b536-2bdca43b01b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:44.385469 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbac5dd-086d-48f8-b536-2bdca43b01b6 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:44.402360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 343/678] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:49:44 2022] GET /identity/v3/role_assignments?user.id=42cd381cf5c745de9dac8f77a8cea554&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:44.403605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbac5dd-086d-48f8-b536-2bdca43b01b6 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:44.436585 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7836ca-b52e-4e80-b992-59f0af788cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:44.437620 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7836ca-b52e-4e80-b992-59f0af788cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:44.437908 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7836ca-b52e-4e80-b992-59f0af788cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:44.438187 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7836ca-b52e-4e80-b992-59f0af788cc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:44.439254 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7836ca-b52e-4e80-b992-59f0af788cc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:44.439380 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7836ca-b52e-4e80-b992-59f0af788cc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:44.441006 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7836ca-b52e-4e80-b992-59f0af788cc5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:44.470709 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 336/679] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:44.472293 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7836ca-b52e-4e80-b992-59f0af788cc5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:44.563581 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbac5dd-086d-48f8-b536-2bdca43b01b6 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:44.615856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252d92-3730-4975-8661-e4ca1742b9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:44.617644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252d92-3730-4975-8661-e4ca1742b9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:44.618399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252d92-3730-4975-8661-e4ca1742b9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:44.618893 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252d92-3730-4975-8661-e4ca1742b9f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:44.623159 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7836ca-b52e-4e80-b992-59f0af788cc5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:44.629968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5252d92-3730-4975-8661-e4ca1742b9f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:44.631875 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5252d92-3730-4975-8661-e4ca1742b9f3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:44.657155 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-e5252d92-3730-4975-8661-e4ca1742b9f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 10:49:44.659473 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 344/680] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:49:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:44.669679 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252d92-3730-4975-8661-e4ca1742b9f3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:44.676403 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83919dc9-3012-4f86-a8e6-2091bd9d386b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:44.677428 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919dc9-3012-4f86-a8e6-2091bd9d386b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:44.677848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919dc9-3012-4f86-a8e6-2091bd9d386b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:44.678258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919dc9-3012-4f86-a8e6-2091bd9d386b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:44.686568 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83919dc9-3012-4f86-a8e6-2091bd9d386b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:44.688994 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83919dc9-3012-4f86-a8e6-2091bd9d386b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:44.702780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-83919dc9-3012-4f86-a8e6-2091bd9d386b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:44.704484 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 337/681] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:44.711387 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83919dc9-3012-4f86-a8e6-2091bd9d386b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:44.791774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252d92-3730-4975-8661-e4ca1742b9f3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:44.828591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2053a-7b63-413d-a193-8527bfe074a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:44.829351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2053a-7b63-413d-a193-8527bfe074a6 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:44.829636 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2053a-7b63-413d-a193-8527bfe074a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:44.829915 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2053a-7b63-413d-a193-8527bfe074a6 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:44.830756 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2053a-7b63-413d-a193-8527bfe074a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:44.831069 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2053a-7b63-413d-a193-8527bfe074a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:44.832516 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2053a-7b63-413d-a193-8527bfe074a6 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:44.834852 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83919dc9-3012-4f86-a8e6-2091bd9d386b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:44.852759 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 345/682] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Apr 6 10:49:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:44.862251 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2053a-7b63-413d-a193-8527bfe074a6 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:44.872647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9516a7-3107-453a-a1df-8555a3de0757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:44.873348 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9516a7-3107-453a-a1df-8555a3de0757 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:44.873678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9516a7-3107-453a-a1df-8555a3de0757 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:44.874777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9516a7-3107-453a-a1df-8555a3de0757 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:44.875576 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9516a7-3107-453a-a1df-8555a3de0757 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:44.875891 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9516a7-3107-453a-a1df-8555a3de0757 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:44.877408 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9516a7-3107-453a-a1df-8555a3de0757 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:44.893315 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 338/683] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:44.901574 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9516a7-3107-453a-a1df-8555a3de0757 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:44.981657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2053a-7b63-413d-a193-8527bfe074a6 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:45.020149 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56601d07-36e3-4bd2-8eb4-c6d65fe26d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:45.021163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56601d07-36e3-4bd2-8eb4-c6d65fe26d78 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:45.021638 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56601d07-36e3-4bd2-8eb4-c6d65fe26d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:45.022666 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56601d07-36e3-4bd2-8eb4-c6d65fe26d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:45.027504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9516a7-3107-453a-a1df-8555a3de0757 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:45.070458 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12909a81-e127-467f-9e5e-944bdda7613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:45.071038 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12909a81-e127-467f-9e5e-944bdda7613f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:45.071317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12909a81-e127-467f-9e5e-944bdda7613f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:45.071585 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12909a81-e127-467f-9e5e-944bdda7613f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:45.072582 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12909a81-e127-467f-9e5e-944bdda7613f None admin] RBAC: Adding query filter params (role.id=07e6d0f9bf5345c99ce158cd3e62c1c5, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=e078c6efaf054f7489f7164fdafce714) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:45.073196 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12909a81-e127-467f-9e5e-944bdda7613f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:45.074677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12909a81-e127-467f-9e5e-944bdda7613f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:45.082626 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 339/684] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:49:44 2022] GET /identity/v3/role_assignments?user.id=e078c6efaf054f7489f7164fdafce714&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:45.084800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12d750-4c93-41a2-b383-525d9435cea0 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:45.085318 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12d750-4c93-41a2-b383-525d9435cea0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:45.085825 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12d750-4c93-41a2-b383-525d9435cea0 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:45.087584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 340/685] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:45.099302 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5bef7-24c6-416c-9975-3215a99ba102 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:45.099634 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5bef7-24c6-416c-9975-3215a99ba102 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:45.101335 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5bef7-24c6-416c-9975-3215a99ba102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:45.114300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56601d07-36e3-4bd2-8eb4-c6d65fe26d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:45.116342 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56601d07-36e3-4bd2-8eb4-c6d65fe26d78 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:45.123001 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-70a5bef7-24c6-416c-9975-3215a99ba102 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:45.124362 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-70a5bef7-24c6-416c-9975-3215a99ba102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:45.242111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 341/686] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:45.277275 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5bef7-24c6-416c-9975-3215a99ba102 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:45.308177 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 346/687] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:45.314980 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56601d07-36e3-4bd2-8eb4-c6d65fe26d78 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:45.398383 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5bef7-24c6-416c-9975-3215a99ba102 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:45.430535 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56601d07-36e3-4bd2-8eb4-c6d65fe26d78 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:45.444033 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d3419-f35a-416a-8851-e56eb71f7226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:45.445502 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d3419-f35a-416a-8851-e56eb71f7226 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:45.446449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d3419-f35a-416a-8851-e56eb71f7226 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:45.446741 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d3419-f35a-416a-8851-e56eb71f7226 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:45.462635 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d3419-f35a-416a-8851-e56eb71f7226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:45.471744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-df2d3419-f35a-416a-8851-e56eb71f7226 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:49:45.471744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 342/688] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:49:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:45.477730 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d3419-f35a-416a-8851-e56eb71f7226 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:45.487122 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cd847-d5f3-40ac-9717-34e3b21a7772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:45.488017 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cd847-d5f3-40ac-9717-34e3b21a7772 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:45.488367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cd847-d5f3-40ac-9717-34e3b21a7772 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:45.488709 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cd847-d5f3-40ac-9717-34e3b21a7772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:45.503702 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cd847-d5f3-40ac-9717-34e3b21a7772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:45.505597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cd847-d5f3-40ac-9717-34e3b21a7772 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:45.525467 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-fa3cd847-d5f3-40ac-9717-34e3b21a7772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:45.527119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 347/689] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:45.532353 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cd847-d5f3-40ac-9717-34e3b21a7772 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:45.587111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d3419-f35a-416a-8851-e56eb71f7226 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:45.623368 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0955a-abfa-4144-a5d9-573d5fb02c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:45.624362 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0955a-abfa-4144-a5d9-573d5fb02c2d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:45.624825 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0955a-abfa-4144-a5d9-573d5fb02c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:45.625331 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0955a-abfa-4144-a5d9-573d5fb02c2d None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:45.626255 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0955a-abfa-4144-a5d9-573d5fb02c2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:45.626754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0955a-abfa-4144-a5d9-573d5fb02c2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:45.628329 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0955a-abfa-4144-a5d9-573d5fb02c2d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:45.637388 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 343/690] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:45.642459 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0955a-abfa-4144-a5d9-573d5fb02c2d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:45.752779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0955a-abfa-4144-a5d9-573d5fb02c2d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:45.769048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cd847-d5f3-40ac-9717-34e3b21a7772 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:45.787468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d69f-39a8-4a8e-8592-770b0d04d5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:45.789103 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d69f-39a8-4a8e-8592-770b0d04d5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:45.789598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d69f-39a8-4a8e-8592-770b0d04d5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:45.790094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d69f-39a8-4a8e-8592-770b0d04d5c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:45.800947 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012d69f-39a8-4a8e-8592-770b0d04d5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:45.802710 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012d69f-39a8-4a8e-8592-770b0d04d5c6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:45.819803 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-4012d69f-39a8-4a8e-8592-770b0d04d5c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:45.821775 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 344/691] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:45.822698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a5af0-98d8-4a72-b21b-bb7b859a4456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:45.823376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a5af0-98d8-4a72-b21b-bb7b859a4456 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:45.823657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a5af0-98d8-4a72-b21b-bb7b859a4456 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:45.823927 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a5af0-98d8-4a72-b21b-bb7b859a4456 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:45.824653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a5af0-98d8-4a72-b21b-bb7b859a4456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:45.824958 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a5af0-98d8-4a72-b21b-bb7b859a4456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:45.826352 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a5af0-98d8-4a72-b21b-bb7b859a4456 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:45.826861 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d69f-39a8-4a8e-8592-770b0d04d5c6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:45.848395 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 348/692] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:45.854163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a5af0-98d8-4a72-b21b-bb7b859a4456 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:45.961230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d69f-39a8-4a8e-8592-770b0d04d5c6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:45.983104 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a5af0-98d8-4a72-b21b-bb7b859a4456 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:45.999143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459b1fb-36f9-4255-b1a8-db84cbb4a7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:45.999808 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b1fb-36f9-4255-b1a8-db84cbb4a7be None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:46.000084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b1fb-36f9-4255-b1a8-db84cbb4a7be None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:46.000354 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b1fb-36f9-4255-b1a8-db84cbb4a7be None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:46.001086 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459b1fb-36f9-4255-b1a8-db84cbb4a7be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:46.001416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459b1fb-36f9-4255-b1a8-db84cbb4a7be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:46.002821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459b1fb-36f9-4255-b1a8-db84cbb4a7be None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:46.014915 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 345/693] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:46.019330 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a4c05-5cba-46f9-b572-d9e5109bd312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:46.020193 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459b1fb-36f9-4255-b1a8-db84cbb4a7be None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:46.020756 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4c05-5cba-46f9-b572-d9e5109bd312 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:46.021362 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4c05-5cba-46f9-b572-d9e5109bd312 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:46.021835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4c05-5cba-46f9-b572-d9e5109bd312 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:46.029716 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a4c05-5cba-46f9-b572-d9e5109bd312 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:46.031434 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a4c05-5cba-46f9-b572-d9e5109bd312 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:46.045953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-145a4c05-5cba-46f9-b572-d9e5109bd312 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:46.047681 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 349/694] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:46.054435 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a4c05-5cba-46f9-b572-d9e5109bd312 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:46.180503 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a4c05-5cba-46f9-b572-d9e5109bd312 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:46.200808 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459b1fb-36f9-4255-b1a8-db84cbb4a7be None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:46.218370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915723-34f2-4ba5-a21a-2d3a0981e8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:46.225075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915723-34f2-4ba5-a21a-2d3a0981e8bb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:46.225075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915723-34f2-4ba5-a21a-2d3a0981e8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:46.225075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915723-34f2-4ba5-a21a-2d3a0981e8bb None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:46.225075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12915723-34f2-4ba5-a21a-2d3a0981e8bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:46.225075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12915723-34f2-4ba5-a21a-2d3a0981e8bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:46.225075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12915723-34f2-4ba5-a21a-2d3a0981e8bb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:46.239226 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 350/695] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:46.247796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915723-34f2-4ba5-a21a-2d3a0981e8bb None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:46.282686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eb6ae-9735-4c10-8a16-540bd07e3168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:46.283493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eb6ae-9735-4c10-8a16-540bd07e3168 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:46.283780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eb6ae-9735-4c10-8a16-540bd07e3168 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:46.284052 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eb6ae-9735-4c10-8a16-540bd07e3168 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:46.296312 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24eb6ae-9735-4c10-8a16-540bd07e3168 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:46.297831 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24eb6ae-9735-4c10-8a16-540bd07e3168 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:46.324767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-b24eb6ae-9735-4c10-8a16-540bd07e3168 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 10:49:46.331630 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 346/696] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Apr 6 10:49:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:46.336670 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eb6ae-9735-4c10-8a16-540bd07e3168 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:46.353239 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915723-34f2-4ba5-a21a-2d3a0981e8bb None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:46.391948 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cc9b8-abcd-46a0-991c-a25e46480a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:46.392614 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cc9b8-abcd-46a0-991c-a25e46480a62 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:46.392895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cc9b8-abcd-46a0-991c-a25e46480a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:46.393201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cc9b8-abcd-46a0-991c-a25e46480a62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:46.394030 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cc9b8-abcd-46a0-991c-a25e46480a62 None admin] RBAC: Adding query filter params (role.id=07e6d0f9bf5345c99ce158cd3e62c1c5, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=89101c5ca3b048939a46b0bb246d2cbd) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:46.394344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cc9b8-abcd-46a0-991c-a25e46480a62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:46.395763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cc9b8-abcd-46a0-991c-a25e46480a62 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:46.408544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 351/697] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:49:46 2022] GET /identity/v3/role_assignments?user.id=89101c5ca3b048939a46b0bb246d2cbd&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:46.500157 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eb6ae-9735-4c10-8a16-540bd07e3168 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:46.555967 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca87632-2fcd-47ff-bece-78325ff86f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:46.556675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca87632-2fcd-47ff-bece-78325ff86f07 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:46.556956 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca87632-2fcd-47ff-bece-78325ff86f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:46.557259 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca87632-2fcd-47ff-bece-78325ff86f07 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:46.558124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca87632-2fcd-47ff-bece-78325ff86f07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:46.558433 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca87632-2fcd-47ff-bece-78325ff86f07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:46.559985 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca87632-2fcd-47ff-bece-78325ff86f07 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:46.586108 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 347/698] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Apr 6 10:49:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:46.592201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cc9b8-abcd-46a0-991c-a25e46480a62 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:46.728533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cc9b8-abcd-46a0-991c-a25e46480a62 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:46.767013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4187636-c70c-4da3-995c-3865e9222d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:46.767993 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187636-c70c-4da3-995c-3865e9222d52 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:46.768413 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187636-c70c-4da3-995c-3865e9222d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:46.768862 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187636-c70c-4da3-995c-3865e9222d52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:46.837252 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4187636-c70c-4da3-995c-3865e9222d52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:46.839346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4187636-c70c-4da3-995c-3865e9222d52 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:46.941130 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 352/699] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:46.942820 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca87632-2fcd-47ff-bece-78325ff86f07 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:47.047580 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca87632-2fcd-47ff-bece-78325ff86f07 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:47.085948 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14a830-e486-428a-92c3-deb17e1fe665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:47.087034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a830-e486-428a-92c3-deb17e1fe665 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:47.087473 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a830-e486-428a-92c3-deb17e1fe665 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:47.087886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a830-e486-428a-92c3-deb17e1fe665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:47.098745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14a830-e486-428a-92c3-deb17e1fe665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:47.101045 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14a830-e486-428a-92c3-deb17e1fe665 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:47.118721 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-1a14a830-e486-428a-92c3-deb17e1fe665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:47.120507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 348/700] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:47.126081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4187636-c70c-4da3-995c-3865e9222d52 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:47.152417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d163-6abd-42be-bcbb-7099d4234545 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:47.152821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d163-6abd-42be-bcbb-7099d4234545 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:47.153269 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d163-6abd-42be-bcbb-7099d4234545 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:47.154995 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 349/701] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:49:47.159852 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b409a-8c7d-4d07-9bc8-13db1ddcd651 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:47.160240 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b409a-8c7d-4d07-9bc8-13db1ddcd651 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:47.160623 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b409a-8c7d-4d07-9bc8-13db1ddcd651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:47.177730 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4a7b409a-8c7d-4d07-9bc8-13db1ddcd651 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:47.179623 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4a7b409a-8c7d-4d07-9bc8-13db1ddcd651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:47.240323 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4187636-c70c-4da3-995c-3865e9222d52 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:47.248731 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 350/702] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:49:47.271150 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b409a-8c7d-4d07-9bc8-13db1ddcd651 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:47.280508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f065e1d-ac82-4e74-a41c-fd5866331613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:47.281213 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065e1d-ac82-4e74-a41c-fd5866331613 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:47.281494 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065e1d-ac82-4e74-a41c-fd5866331613 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:47.281766 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065e1d-ac82-4e74-a41c-fd5866331613 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:47.282489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f065e1d-ac82-4e74-a41c-fd5866331613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:47.282847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f065e1d-ac82-4e74-a41c-fd5866331613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:47.284308 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f065e1d-ac82-4e74-a41c-fd5866331613 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:47.297024 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 353/703] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:47.302550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f065e1d-ac82-4e74-a41c-fd5866331613 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:47.378695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b409a-8c7d-4d07-9bc8-13db1ddcd651 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:47.403180 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f065e1d-ac82-4e74-a41c-fd5866331613 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:47.413487 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8443481-8aaa-4143-9ccc-9f42cf4d6e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:47.414596 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8443481-8aaa-4143-9ccc-9f42cf4d6e17 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:47.415079 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8443481-8aaa-4143-9ccc-9f42cf4d6e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:47.415633 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8443481-8aaa-4143-9ccc-9f42cf4d6e17 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:47.416518 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8443481-8aaa-4143-9ccc-9f42cf4d6e17 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:47.418162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8443481-8aaa-4143-9ccc-9f42cf4d6e17 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:47.432395 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-a8443481-8aaa-4143-9ccc-9f42cf4d6e17 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 06 10:49:47.434599 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 351/704] 10.222.0.62 () {56 vars in 1129 bytes} [Wed Apr 6 10:49:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:47.442244 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8443481-8aaa-4143-9ccc-9f42cf4d6e17 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:47.442681 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bc8df-5b21-41ef-b5c0-f041dccf4ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:47.443654 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bc8df-5b21-41ef-b5c0-f041dccf4ebb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:47.444697 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bc8df-5b21-41ef-b5c0-f041dccf4ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:47.445154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bc8df-5b21-41ef-b5c0-f041dccf4ebb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:47.452744 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bc8df-5b21-41ef-b5c0-f041dccf4ebb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:47.454441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bc8df-5b21-41ef-b5c0-f041dccf4ebb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:47.468597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-d07bc8df-5b21-41ef-b5c0-f041dccf4ebb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:47.470266 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 354/705] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:47.475847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bc8df-5b21-41ef-b5c0-f041dccf4ebb None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:47.543340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8443481-8aaa-4143-9ccc-9f42cf4d6e17 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:47.575361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bc8df-5b21-41ef-b5c0-f041dccf4ebb None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:47.577910 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9d545-f6c4-424c-b57c-d47ab8a7a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:47.578883 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9d545-f6c4-424c-b57c-d47ab8a7a732 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:47.579045 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9d545-f6c4-424c-b57c-d47ab8a7a732 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:47.579441 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9d545-f6c4-424c-b57c-d47ab8a7a732 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:47.580246 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9d545-f6c4-424c-b57c-d47ab8a7a732 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:47.580657 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9d545-f6c4-424c-b57c-d47ab8a7a732 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:47.582236 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9d545-f6c4-424c-b57c-d47ab8a7a732 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:47.587688 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 352/706] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Apr 6 10:49:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:47.589026 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee79b32-2d17-4d3f-aaf7-dd66872d2fbd None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:47.593550 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee79b32-2d17-4d3f-aaf7-dd66872d2fbd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:47.593941 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee79b32-2d17-4d3f-aaf7-dd66872d2fbd None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:47.595673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 353/707] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:47.596924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee79b32-2d17-4d3f-aaf7-dd66872d2fbd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:47.614862 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696db51-2910-4bb0-b8a4-d1c8240dd413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:47.615800 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696db51-2910-4bb0-b8a4-d1c8240dd413 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:47.616213 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696db51-2910-4bb0-b8a4-d1c8240dd413 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:47.616689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696db51-2910-4bb0-b8a4-d1c8240dd413 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:47.617636 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696db51-2910-4bb0-b8a4-d1c8240dd413 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:47.618126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696db51-2910-4bb0-b8a4-d1c8240dd413 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:47.619676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696db51-2910-4bb0-b8a4-d1c8240dd413 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:47.631751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 355/708] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:47.638140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13a07a-f41d-40c4-aac6-a4a661f212d2 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:47.638592 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13a07a-f41d-40c4-aac6-a4a661f212d2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:47.639022 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13a07a-f41d-40c4-aac6-a4a661f212d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:47.661884 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-ac13a07a-f41d-40c4-aac6-a4a661f212d2 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:47.663851 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ac13a07a-f41d-40c4-aac6-a4a661f212d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:47.701120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee79b32-2d17-4d3f-aaf7-dd66872d2fbd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:47.735603 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d5c2c-fc1e-4ee3-8cd8-9d8e0e831533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:47.736461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d5c2c-fc1e-4ee3-8cd8-9d8e0e831533 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:47.736849 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d5c2c-fc1e-4ee3-8cd8-9d8e0e831533 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:47.737305 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d5c2c-fc1e-4ee3-8cd8-9d8e0e831533 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:47.737667 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 356/709] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:47.738252 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d5c2c-fc1e-4ee3-8cd8-9d8e0e831533 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:47.738598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d5c2c-fc1e-4ee3-8cd8-9d8e0e831533 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:47.739057 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13a07a-f41d-40c4-aac6-a4a661f212d2 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:47.740232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d5c2c-fc1e-4ee3-8cd8-9d8e0e831533 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:47.746745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 354/710] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Apr 6 10:49:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:47.775230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d5c2c-fc1e-4ee3-8cd8-9d8e0e831533 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:47.850982 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13a07a-f41d-40c4-aac6-a4a661f212d2 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:47.922426 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d5c2c-fc1e-4ee3-8cd8-9d8e0e831533 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:47.933883 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea236844-9cdf-4906-84e5-6c82629403da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:47.934572 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea236844-9cdf-4906-84e5-6c82629403da None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:47.934854 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea236844-9cdf-4906-84e5-6c82629403da None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:47.935125 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea236844-9cdf-4906-84e5-6c82629403da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:47.935977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea236844-9cdf-4906-84e5-6c82629403da None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=650c5809116e4bcd808044236c06dcc2) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:47.936288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea236844-9cdf-4906-84e5-6c82629403da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:47.938055 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea236844-9cdf-4906-84e5-6c82629403da None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:47.955503 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 357/711] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:49:47 2022] GET /identity/v3/role_assignments?user.id=650c5809116e4bcd808044236c06dcc2&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=090ba4d1ae32495289276665920d4a2c => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:47.960406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fabfed-3e2f-41d5-b92a-00345ba0c770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:47.961327 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fabfed-3e2f-41d5-b92a-00345ba0c770 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:47.961610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fabfed-3e2f-41d5-b92a-00345ba0c770 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:47.961884 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fabfed-3e2f-41d5-b92a-00345ba0c770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:47.974855 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fabfed-3e2f-41d5-b92a-00345ba0c770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:47.976463 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fabfed-3e2f-41d5-b92a-00345ba0c770 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:47.994907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-88fabfed-3e2f-41d5-b92a-00345ba0c770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:47.996541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 355/712] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:48.002558 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea236844-9cdf-4906-84e5-6c82629403da None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:48.131322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea236844-9cdf-4906-84e5-6c82629403da None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:48.182452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64da66-0820-4b9b-91bc-80a460f704a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:48.183217 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64da66-0820-4b9b-91bc-80a460f704a7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:48.183510 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64da66-0820-4b9b-91bc-80a460f704a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:48.183789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64da66-0820-4b9b-91bc-80a460f704a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:48.184583 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64da66-0820-4b9b-91bc-80a460f704a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:48.184895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64da66-0820-4b9b-91bc-80a460f704a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:48.186386 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64da66-0820-4b9b-91bc-80a460f704a7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:48.202903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 358/713] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:48.208555 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fabfed-3e2f-41d5-b92a-00345ba0c770 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:48.239018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcc4e5-aa4d-4d8d-abe5-5b69566eea3d None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:48.239367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcc4e5-aa4d-4d8d-abe5-5b69566eea3d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:48.239652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcc4e5-aa4d-4d8d-abe5-5b69566eea3d None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:48.242899 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 359/714] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:48.247321 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b23330-e654-45ea-8780-c651dcffa2e1 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:48.247613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b23330-e654-45ea-8780-c651dcffa2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:48.247898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b23330-e654-45ea-8780-c651dcffa2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:48.272995 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-59b23330-e654-45ea-8780-c651dcffa2e1 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:48.274213 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-59b23330-e654-45ea-8780-c651dcffa2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:48.399080 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fabfed-3e2f-41d5-b92a-00345ba0c770 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:48.430727 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 360/715] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 10:49:48.440450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68591288-4606-441c-a616-9d15f6edd2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:48.441167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68591288-4606-441c-a616-9d15f6edd2e6 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:48.441452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68591288-4606-441c-a616-9d15f6edd2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:48.441726 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68591288-4606-441c-a616-9d15f6edd2e6 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:48.442429 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68591288-4606-441c-a616-9d15f6edd2e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:48.444523 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68591288-4606-441c-a616-9d15f6edd2e6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:48.470538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b23330-e654-45ea-8780-c651dcffa2e1 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:48.568095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 356/716] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:49:48 2022] POST /identity/v3/users => generated 254 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:49:48.573489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b23330-e654-45ea-8780-c651dcffa2e1 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:48.616945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9a725-3204-40c5-8cb3-db2c2301ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:48.617801 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9a725-3204-40c5-8cb3-db2c2301ddf4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:48.618083 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9a725-3204-40c5-8cb3-db2c2301ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:48.618359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9a725-3204-40c5-8cb3-db2c2301ddf4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:48.619021 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9a725-3204-40c5-8cb3-db2c2301ddf4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:48.620418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9a725-3204-40c5-8cb3-db2c2301ddf4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:48.638725 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-50d9a725-3204-40c5-8cb3-db2c2301ddf4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 06 10:49:48.640342 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 361/717] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:48 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:48.651092 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68591288-4606-441c-a616-9d15f6edd2e6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:48.800690 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68591288-4606-441c-a616-9d15f6edd2e6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:48.842731 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0a372-3c4d-48c0-b076-46ac47bb94b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:48.843411 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0a372-3c4d-48c0-b076-46ac47bb94b5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:48.843691 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0a372-3c4d-48c0-b076-46ac47bb94b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:48.843968 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0a372-3c4d-48c0-b076-46ac47bb94b5 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:48.844674 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0a372-3c4d-48c0-b076-46ac47bb94b5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:48.844978 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0a372-3c4d-48c0-b076-46ac47bb94b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:48.846456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0a372-3c4d-48c0-b076-46ac47bb94b5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:48.851272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 357/718] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Apr 6 10:49:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:48.862162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9a725-3204-40c5-8cb3-db2c2301ddf4 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:48.989843 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9a725-3204-40c5-8cb3-db2c2301ddf4 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:49.037398 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72e16c-7761-4c62-adaf-c439e8bc080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:49.038114 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72e16c-7761-4c62-adaf-c439e8bc080f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:49.038453 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72e16c-7761-4c62-adaf-c439e8bc080f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:49.038729 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72e16c-7761-4c62-adaf-c439e8bc080f None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:49.039501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72e16c-7761-4c62-adaf-c439e8bc080f None admin] RBAC: Adding query filter params (type=network) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:49.039810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72e16c-7761-4c62-adaf-c439e8bc080f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:49.041259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72e16c-7761-4c62-adaf-c439e8bc080f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:49.047612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 362/719] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Apr 6 10:49:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:49.602250 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3962b-eb91-4997-b57c-6fc9b9a095f5 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:49.602794 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3962b-eb91-4997-b57c-6fc9b9a095f5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:49.602794 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3962b-eb91-4997-b57c-6fc9b9a095f5 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:49.604434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 358/720] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:49.609453 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b07668-d109-4279-9eee-619638dcb7f0 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:49.609750 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b07668-d109-4279-9eee-619638dcb7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:49.610082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b07668-d109-4279-9eee-619638dcb7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:49.630044 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e2b07668-d109-4279-9eee-619638dcb7f0 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:49.631250 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e2b07668-d109-4279-9eee-619638dcb7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:49.722199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 363/721] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:49.762287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3962b-eb91-4997-b57c-6fc9b9a095f5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:49.899170 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3962b-eb91-4997-b57c-6fc9b9a095f5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:49.945774 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98324d4d-bd1e-42e6-ac1b-01a51555c46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:49.946583 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98324d4d-bd1e-42e6-ac1b-01a51555c46f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:49.946868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98324d4d-bd1e-42e6-ac1b-01a51555c46f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:49.947150 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98324d4d-bd1e-42e6-ac1b-01a51555c46f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:49.958167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98324d4d-bd1e-42e6-ac1b-01a51555c46f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:49.965825 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-98324d4d-bd1e-42e6-ac1b-01a51555c46f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:49:49.967082 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 359/722] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:49:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:49.973262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b07668-d109-4279-9eee-619638dcb7f0 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:50.107468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b07668-d109-4279-9eee-619638dcb7f0 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:50.148744 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddf012-c83d-4853-9967-6e59e533d174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:50.149517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddf012-c83d-4853-9967-6e59e533d174 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:50.149748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddf012-c83d-4853-9967-6e59e533d174 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:50.150025 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddf012-c83d-4853-9967-6e59e533d174 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:50.150783 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddf012-c83d-4853-9967-6e59e533d174 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:50.151088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddf012-c83d-4853-9967-6e59e533d174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:50.152466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddf012-c83d-4853-9967-6e59e533d174 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:50.161756 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 364/723] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:50.167120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98324d4d-bd1e-42e6-ac1b-01a51555c46f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:50.337217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98324d4d-bd1e-42e6-ac1b-01a51555c46f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:50.386156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c7ce7-8704-4da8-ba41-bb401c0694e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:50.386953 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c7ce7-8704-4da8-ba41-bb401c0694e4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:50.387234 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c7ce7-8704-4da8-ba41-bb401c0694e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:50.387510 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c7ce7-8704-4da8-ba41-bb401c0694e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:50.403389 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c7ce7-8704-4da8-ba41-bb401c0694e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:50.405072 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c7ce7-8704-4da8-ba41-bb401c0694e4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:50.428159 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-db1c7ce7-8704-4da8-ba41-bb401c0694e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:50.433155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 360/724] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:50.435368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddf012-c83d-4853-9967-6e59e533d174 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:50.585727 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddf012-c83d-4853-9967-6e59e533d174 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:50.637019 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f3895-a9b1-4c6f-9827-1652b8d93288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:50.638277 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f3895-a9b1-4c6f-9827-1652b8d93288 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:50.638821 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f3895-a9b1-4c6f-9827-1652b8d93288 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:50.639491 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f3895-a9b1-4c6f-9827-1652b8d93288 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:50.640483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f3895-a9b1-4c6f-9827-1652b8d93288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:50.641025 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f3895-a9b1-4c6f-9827-1652b8d93288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:50.646767 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f3895-a9b1-4c6f-9827-1652b8d93288 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:50.674922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 365/725] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:50.680619 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c7ce7-8704-4da8-ba41-bb401c0694e4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:50.735209 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1665a9d-8dcf-4332-b5c2-c60b054cb795 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:50.735838 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1665a9d-8dcf-4332-b5c2-c60b054cb795 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:50.736310 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1665a9d-8dcf-4332-b5c2-c60b054cb795 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:50.738188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 366/726] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:50.743601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad5c1d-7c38-4ae6-884f-501b9d7ac87a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:50.744147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad5c1d-7c38-4ae6-884f-501b9d7ac87a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:50.744626 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad5c1d-7c38-4ae6-884f-501b9d7ac87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:50.773578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-86ad5c1d-7c38-4ae6-884f-501b9d7ac87a None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:50.775127 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-86ad5c1d-7c38-4ae6-884f-501b9d7ac87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:50.808091 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c7ce7-8704-4da8-ba41-bb401c0694e4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:50.846673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c94f8-4287-40e6-943a-969e5df9f0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:50.847476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c94f8-4287-40e6-943a-969e5df9f0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:50.847754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c94f8-4287-40e6-943a-969e5df9f0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:50.848023 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c94f8-4287-40e6-943a-969e5df9f0f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:50.863984 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c94f8-4287-40e6-943a-969e5df9f0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:50.865525 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c94f8-4287-40e6-943a-969e5df9f0f5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:50.884702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-927c94f8-4287-40e6-943a-969e5df9f0f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 10:49:50.893770 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 361/727] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:49:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:50.902089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c94f8-4287-40e6-943a-969e5df9f0f5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:50.915224 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 367/728] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:50.956631 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e037ec-ad85-437c-a8df-d3142c461c3a None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:50.956914 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e037ec-ad85-437c-a8df-d3142c461c3a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:50.957131 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e037ec-ad85-437c-a8df-d3142c461c3a None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:50.958795 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 368/729] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:49:50.960179 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e037ec-ad85-437c-a8df-d3142c461c3a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:51.027907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c94f8-4287-40e6-943a-969e5df9f0f5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:51.063842 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382d14d-2381-4694-911e-d2acdffb47fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:51.064928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382d14d-2381-4694-911e-d2acdffb47fa None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:51.065429 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382d14d-2381-4694-911e-d2acdffb47fa None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:51.065898 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382d14d-2381-4694-911e-d2acdffb47fa None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:51.066949 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382d14d-2381-4694-911e-d2acdffb47fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:51.067450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382d14d-2381-4694-911e-d2acdffb47fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:51.067888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e037ec-ad85-437c-a8df-d3142c461c3a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:51.069762 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382d14d-2381-4694-911e-d2acdffb47fa None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:51.090247 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 362/730] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Apr 6 10:49:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:51.092039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957c83f-e082-4e8a-81c2-9c3f62a3a4c3 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:51.092539 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957c83f-e082-4e8a-81c2-9c3f62a3a4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:51.093024 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957c83f-e082-4e8a-81c2-9c3f62a3a4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:51.111703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4038c-c5d1-4a4d-8904-ceeb6a08efc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:51.112348 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6957c83f-e082-4e8a-81c2-9c3f62a3a4c3 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:51.112479 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4038c-c5d1-4a4d-8904-ceeb6a08efc8 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:51.112693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4038c-c5d1-4a4d-8904-ceeb6a08efc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:51.112968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4038c-c5d1-4a4d-8904-ceeb6a08efc8 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:51.113723 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4038c-c5d1-4a4d-8904-ceeb6a08efc8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:51.114476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6957c83f-e082-4e8a-81c2-9c3f62a3a4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:51.115143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4038c-c5d1-4a4d-8904-ceeb6a08efc8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:51.180861 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 363/731] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:51.182085 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957c83f-e082-4e8a-81c2-9c3f62a3a4c3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:51.228273 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 369/732] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Apr 6 10:49:50 2022] POST /identity/v3/services => generated 251 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:49:51.229527 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4038c-c5d1-4a4d-8904-ceeb6a08efc8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:51.344010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957c83f-e082-4e8a-81c2-9c3f62a3a4c3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:51.434483 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cf81f-259b-44c0-9fab-4636846879d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:51.435560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf81f-259b-44c0-9fab-4636846879d7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:51.436067 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf81f-259b-44c0-9fab-4636846879d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:51.436643 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf81f-259b-44c0-9fab-4636846879d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:51.443796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4038c-c5d1-4a4d-8904-ceeb6a08efc8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:51.494897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b40f9-e4cd-449b-ae6c-9142806ace0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:51.495801 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b40f9-e4cd-449b-ae6c-9142806ace0a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:51.496080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b40f9-e4cd-449b-ae6c-9142806ace0a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:51.496350 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b40f9-e4cd-449b-ae6c-9142806ace0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:51.508579 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b40f9-e4cd-449b-ae6c-9142806ace0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:51.515857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-835b40f9-e4cd-449b-ae6c-9142806ace0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:49:51.517439 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 370/733] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:49:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:51.518716 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7588529-e8e2-41de-9523-e0ccd6e00ad6 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:51.518995 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7588529-e8e2-41de-9523-e0ccd6e00ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:51.519266 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7588529-e8e2-41de-9523-e0ccd6e00ad6 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:51.520804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 371/734] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:51.523578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7588529-e8e2-41de-9523-e0ccd6e00ad6 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:51.525530 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cf81f-259b-44c0-9fab-4636846879d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:51.527075 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cf81f-259b-44c0-9fab-4636846879d7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:51.643632 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 364/735] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:51 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 10:49:51.643937 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7588529-e8e2-41de-9523-e0ccd6e00ad6 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:51.645522 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673083c0-a24a-4d23-9de1-8c58a4d5240c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:51.646037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673083c0-a24a-4d23-9de1-8c58a4d5240c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:51.646564 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673083c0-a24a-4d23-9de1-8c58a4d5240c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:51.664663 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-673083c0-a24a-4d23-9de1-8c58a4d5240c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:51.666257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-673083c0-a24a-4d23-9de1-8c58a4d5240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:51.688407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c6421-133f-4c91-a9f2-0fc52b6975ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:51.689345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c6421-133f-4c91-a9f2-0fc52b6975ac None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:51.689811 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c6421-133f-4c91-a9f2-0fc52b6975ac None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:51.690232 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c6421-133f-4c91-a9f2-0fc52b6975ac None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:51.691124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c6421-133f-4c91-a9f2-0fc52b6975ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:51.691576 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c6421-133f-4c91-a9f2-0fc52b6975ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:51.693138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c6421-133f-4c91-a9f2-0fc52b6975ac None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:51.702672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 372/736] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:51.703687 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c6421-133f-4c91-a9f2-0fc52b6975ac None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:51.745263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 365/737] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:51.746330 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673083c0-a24a-4d23-9de1-8c58a4d5240c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:51.807076 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c6421-133f-4c91-a9f2-0fc52b6975ac None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:51.842214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d73444-f23e-40f8-8751-a559fbe478ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:51.843271 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d73444-f23e-40f8-8751-a559fbe478ef None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:51.843708 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d73444-f23e-40f8-8751-a559fbe478ef None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:51.844122 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d73444-f23e-40f8-8751-a559fbe478ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:51.855611 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d73444-f23e-40f8-8751-a559fbe478ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:51.857500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d73444-f23e-40f8-8751-a559fbe478ef None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:51.866551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673083c0-a24a-4d23-9de1-8c58a4d5240c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:51.874950 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-77d73444-f23e-40f8-8751-a559fbe478ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:51.876589 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 373/738] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:51.877717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d73444-f23e-40f8-8751-a559fbe478ef None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:51.906824 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b1ef3-eb0c-4736-a14d-8151a904cd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:51.908056 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b1ef3-eb0c-4736-a14d-8151a904cd58 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:51.908551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b1ef3-eb0c-4736-a14d-8151a904cd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:51.909029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b1ef3-eb0c-4736-a14d-8151a904cd58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:51.920683 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b1ef3-eb0c-4736-a14d-8151a904cd58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:51.922413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b1ef3-eb0c-4736-a14d-8151a904cd58 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:51.939803 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-1d9b1ef3-eb0c-4736-a14d-8151a904cd58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:51.941171 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 366/739] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:51.942122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b1ef3-eb0c-4736-a14d-8151a904cd58 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:51.980630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d73444-f23e-40f8-8751-a559fbe478ef None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:52.016666 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40428fc4-dd37-4c5c-883d-01b2178c5c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:52.017416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40428fc4-dd37-4c5c-883d-01b2178c5c3e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:52.018052 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40428fc4-dd37-4c5c-883d-01b2178c5c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:52.018331 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40428fc4-dd37-4c5c-883d-01b2178c5c3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:52.031189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40428fc4-dd37-4c5c-883d-01b2178c5c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:52.040084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b1ef3-eb0c-4736-a14d-8151a904cd58 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:52.040877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-40428fc4-dd37-4c5c-883d-01b2178c5c3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:52.050416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 374/740] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:52.050416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b4147-1535-444e-ba97-abcec52eed66 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:52.050416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b4147-1535-444e-ba97-abcec52eed66 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:52.050416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b4147-1535-444e-ba97-abcec52eed66 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:52.050416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 375/741] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:52.050416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b4147-1535-444e-ba97-abcec52eed66 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:52.074931 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b20dd-438b-4862-9d47-559c1da1b3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:52.075880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b20dd-438b-4862-9d47-559c1da1b3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:52.076159 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b20dd-438b-4862-9d47-559c1da1b3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:52.076435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b20dd-438b-4862-9d47-559c1da1b3f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:52.077188 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b20dd-438b-4862-9d47-559c1da1b3f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:52.077491 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b20dd-438b-4862-9d47-559c1da1b3f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:52.078898 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b20dd-438b-4862-9d47-559c1da1b3f5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:52.091027 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 367/742] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:52.096581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c75252-3dec-4ddf-b2ae-65823bee0ded None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:52.096874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c75252-3dec-4ddf-b2ae-65823bee0ded None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:52.097178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c75252-3dec-4ddf-b2ae-65823bee0ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:52.114222 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-50c75252-3dec-4ddf-b2ae-65823bee0ded None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:52.115407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-50c75252-3dec-4ddf-b2ae-65823bee0ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:52.154117 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b4147-1535-444e-ba97-abcec52eed66 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:52.180353 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 368/743] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 10:49:52.181220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c75252-3dec-4ddf-b2ae-65823bee0ded None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:52.192982 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1a44c-e939-4713-933c-85238b4b361f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:52.194441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a44c-e939-4713-933c-85238b4b361f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:52.194963 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a44c-e939-4713-933c-85238b4b361f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:52.195385 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a44c-e939-4713-933c-85238b4b361f None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:52.196249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1a44c-e939-4713-933c-85238b4b361f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:52.196711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1a44c-e939-4713-933c-85238b4b361f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:52.198110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1a44c-e939-4713-933c-85238b4b361f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:52.210345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 376/744] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:52.211253 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1a44c-e939-4713-933c-85238b4b361f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:52.297536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c75252-3dec-4ddf-b2ae-65823bee0ded None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:52.313577 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1a44c-e939-4713-933c-85238b4b361f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:52.331011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa087d-3b30-4a8a-8813-59a683ca4b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:52.331681 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa087d-3b30-4a8a-8813-59a683ca4b1b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:52.331962 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa087d-3b30-4a8a-8813-59a683ca4b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:52.332237 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa087d-3b30-4a8a-8813-59a683ca4b1b None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:52.332973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa087d-3b30-4a8a-8813-59a683ca4b1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:52.333305 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa087d-3b30-4a8a-8813-59a683ca4b1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:52.335309 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa087d-3b30-4a8a-8813-59a683ca4b1b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:52.342895 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 369/745] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:52.343661 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa087d-3b30-4a8a-8813-59a683ca4b1b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:52.354945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57743df4-64fe-43ef-854c-6574373f5954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:52.355756 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57743df4-64fe-43ef-854c-6574373f5954 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:52.356034 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57743df4-64fe-43ef-854c-6574373f5954 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:52.356326 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57743df4-64fe-43ef-854c-6574373f5954 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:52.365069 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57743df4-64fe-43ef-854c-6574373f5954 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:52.367212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57743df4-64fe-43ef-854c-6574373f5954 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:52.384518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-57743df4-64fe-43ef-854c-6574373f5954 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:52.391258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 377/746] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:52.391258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57743df4-64fe-43ef-854c-6574373f5954 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:52.442169 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa087d-3b30-4a8a-8813-59a683ca4b1b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:52.479394 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9391c5-3d0d-4cc9-b331-4de0a5016fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:52.480243 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9391c5-3d0d-4cc9-b331-4de0a5016fdd None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:52.480519 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9391c5-3d0d-4cc9-b331-4de0a5016fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:52.480791 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9391c5-3d0d-4cc9-b331-4de0a5016fdd None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:52.481550 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9391c5-3d0d-4cc9-b331-4de0a5016fdd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:52.483095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9391c5-3d0d-4cc9-b331-4de0a5016fdd None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:52.492242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57743df4-64fe-43ef-854c-6574373f5954 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:52.529469 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0c56c-be70-4158-b9c0-3cf86e5efd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:52.530263 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0c56c-be70-4158-b9c0-3cf86e5efd07 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:52.530540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0c56c-be70-4158-b9c0-3cf86e5efd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:52.530807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0c56c-be70-4158-b9c0-3cf86e5efd07 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:52.537917 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0c56c-be70-4158-b9c0-3cf86e5efd07 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:52.539357 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0c56c-be70-4158-b9c0-3cf86e5efd07 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:52.552645 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-36b0c56c-be70-4158-b9c0-3cf86e5efd07 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 10:49:52.554293 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 378/747] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Apr 6 10:49:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:52.555074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0c56c-be70-4158-b9c0-3cf86e5efd07 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:52.581084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 370/748] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Apr 6 10:49:52 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:49:52.581084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9391c5-3d0d-4cc9-b331-4de0a5016fdd None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:52.704108 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9391c5-3d0d-4cc9-b331-4de0a5016fdd None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:52.706366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0c56c-be70-4158-b9c0-3cf86e5efd07 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:52.741662 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05401ac9-791e-4cd1-97b5-75be66309198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:52.742745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05401ac9-791e-4cd1-97b5-75be66309198 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:52.743205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05401ac9-791e-4cd1-97b5-75be66309198 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:52.743653 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05401ac9-791e-4cd1-97b5-75be66309198 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:52.744657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c847f54-8bc7-431a-8436-e481e99cc7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:52.744826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05401ac9-791e-4cd1-97b5-75be66309198 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:52.745134 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05401ac9-791e-4cd1-97b5-75be66309198 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:52.745901 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c847f54-8bc7-431a-8436-e481e99cc7ac None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:52.746378 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c847f54-8bc7-431a-8436-e481e99cc7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:52.746824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c847f54-8bc7-431a-8436-e481e99cc7ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:52.747106 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05401ac9-791e-4cd1-97b5-75be66309198 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:52.759011 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c847f54-8bc7-431a-8436-e481e99cc7ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:52.760561 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c847f54-8bc7-431a-8436-e481e99cc7ac None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:52.765140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 371/749] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:52.766146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05401ac9-791e-4cd1-97b5-75be66309198 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:52.780281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-2c847f54-8bc7-431a-8436-e481e99cc7ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:52.782352 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 379/750] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:52.783411 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c847f54-8bc7-431a-8436-e481e99cc7ac None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:52.933917 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05401ac9-791e-4cd1-97b5-75be66309198 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:52.941786 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c847f54-8bc7-431a-8436-e481e99cc7ac None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:52.976010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9adb1-65d7-4c01-86a6-a88911fb914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:52.976508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b4bae-827e-40d4-87fe-5ba8811661de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:52.977270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9adb1-65d7-4c01-86a6-a88911fb914f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:52.977399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b4bae-827e-40d4-87fe-5ba8811661de None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:52.977689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b4bae-827e-40d4-87fe-5ba8811661de None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:52.977965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9adb1-65d7-4c01-86a6-a88911fb914f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:52.978072 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b4bae-827e-40d4-87fe-5ba8811661de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:52.978500 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9adb1-65d7-4c01-86a6-a88911fb914f None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:52.979040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b4bae-827e-40d4-87fe-5ba8811661de None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=89101c5ca3b048939a46b0bb246d2cbd) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:52.979424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b4bae-827e-40d4-87fe-5ba8811661de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:52.979780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9adb1-65d7-4c01-86a6-a88911fb914f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:52.980223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9adb1-65d7-4c01-86a6-a88911fb914f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:52.981087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b4bae-827e-40d4-87fe-5ba8811661de None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:52.981977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9adb1-65d7-4c01-86a6-a88911fb914f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:52.993620 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 380/751] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:49:52 2022] GET /identity/v3/role_assignments?user.id=89101c5ca3b048939a46b0bb246d2cbd&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=090ba4d1ae32495289276665920d4a2c => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:52.994847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b4bae-827e-40d4-87fe-5ba8811661de None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:53.011574 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 372/752] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Apr 6 10:49:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:53.016869 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9adb1-65d7-4c01-86a6-a88911fb914f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:53.103404 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b4bae-827e-40d4-87fe-5ba8811661de None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:53.140092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c624ba-e561-452d-b24a-f9ae5f05a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:53.140784 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c624ba-e561-452d-b24a-f9ae5f05a2cf None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:53.141080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c624ba-e561-452d-b24a-f9ae5f05a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:53.141366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c624ba-e561-452d-b24a-f9ae5f05a2cf None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:53.142098 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c624ba-e561-452d-b24a-f9ae5f05a2cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:53.142403 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c624ba-e561-452d-b24a-f9ae5f05a2cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:53.143780 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c624ba-e561-452d-b24a-f9ae5f05a2cf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:53.156639 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 381/753] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:53.165516 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c624ba-e561-452d-b24a-f9ae5f05a2cf None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:53.245119 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9adb1-65d7-4c01-86a6-a88911fb914f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:53.281168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c624ba-e561-452d-b24a-f9ae5f05a2cf None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:53.318470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fd8c2-57f8-4569-83f0-ca4d67a63e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:53.319663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fd8c2-57f8-4569-83f0-ca4d67a63e3e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:53.320160 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fd8c2-57f8-4569-83f0-ca4d67a63e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:53.320626 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fd8c2-57f8-4569-83f0-ca4d67a63e3e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:53.321958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257bcf7-dfb3-471d-9e78-da3403d4a4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:53.322760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257bcf7-dfb3-471d-9e78-da3403d4a4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:53.323037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257bcf7-dfb3-471d-9e78-da3403d4a4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:53.323482 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257bcf7-dfb3-471d-9e78-da3403d4a4b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:53.329268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fd8c2-57f8-4569-83f0-ca4d67a63e3e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:53.331189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fd8c2-57f8-4569-83f0-ca4d67a63e3e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:53.347229 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-525fd8c2-57f8-4569-83f0-ca4d67a63e3e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 10:49:53.349427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 382/754] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Apr 6 10:49:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:53.353952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257bcf7-dfb3-471d-9e78-da3403d4a4b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:53.354988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fd8c2-57f8-4569-83f0-ca4d67a63e3e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:53.355753 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257bcf7-dfb3-471d-9e78-da3403d4a4b0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:53.387752 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-c257bcf7-dfb3-471d-9e78-da3403d4a4b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:53.397924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 373/755] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:53.403022 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257bcf7-dfb3-471d-9e78-da3403d4a4b0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:53.466771 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fd8c2-57f8-4569-83f0-ca4d67a63e3e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:53.505604 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d73d4-46e2-4954-a1d4-6e0bc5772e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:53.507187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d73d4-46e2-4954-a1d4-6e0bc5772e80 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:53.507667 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d73d4-46e2-4954-a1d4-6e0bc5772e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:53.508135 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d73d4-46e2-4954-a1d4-6e0bc5772e80 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:53.509212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d73d4-46e2-4954-a1d4-6e0bc5772e80 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:53.509830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d73d4-46e2-4954-a1d4-6e0bc5772e80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:53.511663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d73d4-46e2-4954-a1d4-6e0bc5772e80 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:53.531613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 383/756] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Apr 6 10:49:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:53.542052 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d73d4-46e2-4954-a1d4-6e0bc5772e80 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:53.620711 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257bcf7-dfb3-471d-9e78-da3403d4a4b0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:53.693721 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb970d15-069f-41ef-bad6-491d5c5acc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:53.694414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb970d15-069f-41ef-bad6-491d5c5acc78 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:53.694689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb970d15-069f-41ef-bad6-491d5c5acc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:53.695024 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb970d15-069f-41ef-bad6-491d5c5acc78 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:53.695744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb970d15-069f-41ef-bad6-491d5c5acc78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:53.696044 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb970d15-069f-41ef-bad6-491d5c5acc78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:53.696446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d73d4-46e2-4954-a1d4-6e0bc5772e80 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:53.697477 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb970d15-069f-41ef-bad6-491d5c5acc78 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:53.718355 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 374/757] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:53.724056 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb970d15-069f-41ef-bad6-491d5c5acc78 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:53.730826 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f65b15-ee72-4762-8cd3-e24a879f7396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:53.731491 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f65b15-ee72-4762-8cd3-e24a879f7396 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:53.731773 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f65b15-ee72-4762-8cd3-e24a879f7396 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:53.732048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f65b15-ee72-4762-8cd3-e24a879f7396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:53.803106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f65b15-ee72-4762-8cd3-e24a879f7396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:53.805081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f65b15-ee72-4762-8cd3-e24a879f7396 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:53.900819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb970d15-069f-41ef-bad6-491d5c5acc78 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:53.906456 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 384/758] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:49:53.907983 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0889657-f73d-4550-a0ac-dd363eea349b None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:53.908428 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0889657-f73d-4550-a0ac-dd363eea349b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:53.908876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0889657-f73d-4550-a0ac-dd363eea349b None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:53.915081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 385/759] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:53.916035 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0889657-f73d-4550-a0ac-dd363eea349b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:53.935498 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8671d-4d26-4e63-aa0f-bd2d19a91628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:53.936534 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8671d-4d26-4e63-aa0f-bd2d19a91628 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:53.937264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8671d-4d26-4e63-aa0f-bd2d19a91628 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:53.937728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8671d-4d26-4e63-aa0f-bd2d19a91628 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:53.944963 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8671d-4d26-4e63-aa0f-bd2d19a91628 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:53.946797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8671d-4d26-4e63-aa0f-bd2d19a91628 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:53.961920 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-a9b8671d-4d26-4e63-aa0f-bd2d19a91628 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:53.963806 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 375/760] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:53.969652 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29499358-b0cf-4057-90cb-a402c3d4fab0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:53.970182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29499358-b0cf-4057-90cb-a402c3d4fab0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:53.970608 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29499358-b0cf-4057-90cb-a402c3d4fab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:53.987589 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-29499358-b0cf-4057-90cb-a402c3d4fab0 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:53.988988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-29499358-b0cf-4057-90cb-a402c3d4fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:54.020550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0889657-f73d-4550-a0ac-dd363eea349b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:54.055620 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef284ed5-d913-44fb-83f3-b26932db679f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:54.056341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284ed5-d913-44fb-83f3-b26932db679f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:54.056660 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 376/761] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:49:54.057683 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29499358-b0cf-4057-90cb-a402c3d4fab0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:54.065185 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284ed5-d913-44fb-83f3-b26932db679f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:54.065691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284ed5-d913-44fb-83f3-b26932db679f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:54.081117 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef284ed5-d913-44fb-83f3-b26932db679f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:54.082868 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef284ed5-d913-44fb-83f3-b26932db679f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:54.111893 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-ef284ed5-d913-44fb-83f3-b26932db679f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:54.113755 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 386/762] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:54.114875 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef284ed5-d913-44fb-83f3-b26932db679f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:54.156008 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29499358-b0cf-4057-90cb-a402c3d4fab0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:54.190514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ec754-8677-4c53-9acc-49f990e68236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:54.191431 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec754-8677-4c53-9acc-49f990e68236 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:54.191858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec754-8677-4c53-9acc-49f990e68236 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:54.192313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec754-8677-4c53-9acc-49f990e68236 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:54.193260 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ec754-8677-4c53-9acc-49f990e68236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:54.193712 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ec754-8677-4c53-9acc-49f990e68236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:54.195870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ec754-8677-4c53-9acc-49f990e68236 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:54.207866 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 377/763] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:54.213385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ec754-8677-4c53-9acc-49f990e68236 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:54.216551 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef284ed5-d913-44fb-83f3-b26932db679f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:54.253161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e35e-93e3-41ed-9519-f0b2017acc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:54.253983 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e35e-93e3-41ed-9519-f0b2017acc2c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:54.254268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e35e-93e3-41ed-9519-f0b2017acc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:54.254546 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e35e-93e3-41ed-9519-f0b2017acc2c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:54.255208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0e35e-93e3-41ed-9519-f0b2017acc2c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:54.257288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0e35e-93e3-41ed-9519-f0b2017acc2c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:54.268962 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-a9b0e35e-93e3-41ed-9519-f0b2017acc2c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 06 10:49:54.275082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 387/764] 10.222.0.62 () {56 vars in 1129 bytes} [Wed Apr 6 10:49:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:54.276053 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e35e-93e3-41ed-9519-f0b2017acc2c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:54.316581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ec754-8677-4c53-9acc-49f990e68236 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:54.349663 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295d1e1-dfc3-4170-a05b-92ea5d47dc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:54.350357 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295d1e1-dfc3-4170-a05b-92ea5d47dc3a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:54.350640 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295d1e1-dfc3-4170-a05b-92ea5d47dc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:54.350914 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295d1e1-dfc3-4170-a05b-92ea5d47dc3a None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:54.351640 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295d1e1-dfc3-4170-a05b-92ea5d47dc3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:54.351948 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295d1e1-dfc3-4170-a05b-92ea5d47dc3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:54.354279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295d1e1-dfc3-4170-a05b-92ea5d47dc3a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:54.366983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 378/765] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:54.368003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295d1e1-dfc3-4170-a05b-92ea5d47dc3a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:54.381192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e35e-93e3-41ed-9519-f0b2017acc2c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:54.417209 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328745b-a7f0-487f-ae20-f84b80959a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:54.418478 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328745b-a7f0-487f-ae20-f84b80959a1d None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:54.418942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328745b-a7f0-487f-ae20-f84b80959a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:54.419396 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328745b-a7f0-487f-ae20-f84b80959a1d None admin] PATH_INFO: `/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/650c5809116e4bcd808044236c06dcc2/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:54.421618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328745b-a7f0-487f-ae20-f84b80959a1d None admin] RBAC: Authorizing `identity:create_grant(project_id=a4306a6b12434cc495650e4f3b9afbde, user_id=650c5809116e4bcd808044236c06dcc2, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:54.423345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328745b-a7f0-487f-ae20-f84b80959a1d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:54.470180 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295d1e1-dfc3-4170-a05b-92ea5d47dc3a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:54.503464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 388/766] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:49:54 2022] PUT /identity/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/650c5809116e4bcd808044236c06dcc2/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:49:54.504822 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328745b-a7f0-487f-ae20-f84b80959a1d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:54.515209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84988b6-aa64-4108-8af0-069af7f4864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:54.516142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84988b6-aa64-4108-8af0-069af7f4864c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:54.516427 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84988b6-aa64-4108-8af0-069af7f4864c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:54.516701 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84988b6-aa64-4108-8af0-069af7f4864c None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:54.518596 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84988b6-aa64-4108-8af0-069af7f4864c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:54.518915 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84988b6-aa64-4108-8af0-069af7f4864c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:54.520471 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84988b6-aa64-4108-8af0-069af7f4864c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:54.537194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 379/767] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Apr 6 10:49:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:54.540319 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84988b6-aa64-4108-8af0-069af7f4864c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:54.717648 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328745b-a7f0-487f-ae20-f84b80959a1d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:54.728078 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84988b6-aa64-4108-8af0-069af7f4864c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:54.778662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca061a4-80d8-495f-9794-146202b228bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:54.779878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca061a4-80d8-495f-9794-146202b228bf None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:54.780271 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca061a4-80d8-495f-9794-146202b228bf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:54.780556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca061a4-80d8-495f-9794-146202b228bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:54.783397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5088d-8906-473e-945a-09ed27ec1abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:54.784734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5088d-8906-473e-945a-09ed27ec1abe None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:54.785229 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5088d-8906-473e-945a-09ed27ec1abe None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:54.785646 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5088d-8906-473e-945a-09ed27ec1abe None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:54.786503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5088d-8906-473e-945a-09ed27ec1abe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:54.786974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5088d-8906-473e-945a-09ed27ec1abe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:54.789042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5088d-8906-473e-945a-09ed27ec1abe None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:54.789272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca061a4-80d8-495f-9794-146202b228bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:54.791223 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca061a4-80d8-495f-9794-146202b228bf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:54.796212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 380/768] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Apr 6 10:49:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:54.801667 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5088d-8906-473e-945a-09ed27ec1abe None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:54.807914 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-5ca061a4-80d8-495f-9794-146202b228bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:54.809851 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 389/769] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:54.818115 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca061a4-80d8-495f-9794-146202b228bf None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:54.906593 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5088d-8906-473e-945a-09ed27ec1abe None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:54.919195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca061a4-80d8-495f-9794-146202b228bf None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:54.941151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbf6b6-375a-4206-91fa-10c36c2a7516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:54.941720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbf6b6-375a-4206-91fa-10c36c2a7516 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:54.941997 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbf6b6-375a-4206-91fa-10c36c2a7516 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:54.942267 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbf6b6-375a-4206-91fa-10c36c2a7516 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:54.943047 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbf6b6-375a-4206-91fa-10c36c2a7516 None admin] RBAC: Adding query filter params (interface=public, service_id=98ec82dcb1a34991b241e6bf3619931f, region_id=RegionOne) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:54.943351 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbf6b6-375a-4206-91fa-10c36c2a7516 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:54.945395 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbf6b6-375a-4206-91fa-10c36c2a7516 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:54.953318 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 381/770] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Apr 6 10:49:54 2022] GET /identity/v3/endpoints?service_id=98ec82dcb1a34991b241e6bf3619931f&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:54.958194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbf6b6-375a-4206-91fa-10c36c2a7516 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:54.966441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e8285-ef69-4241-99b7-271d1569d731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:54.967125 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e8285-ef69-4241-99b7-271d1569d731 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:54.967413 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e8285-ef69-4241-99b7-271d1569d731 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:54.967692 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e8285-ef69-4241-99b7-271d1569d731 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:54.968493 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e8285-ef69-4241-99b7-271d1569d731 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:54.968806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e8285-ef69-4241-99b7-271d1569d731 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:54.970277 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e8285-ef69-4241-99b7-271d1569d731 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:54.991548 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 390/771] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:54.997361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e8285-ef69-4241-99b7-271d1569d731 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:55.062746 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbf6b6-375a-4206-91fa-10c36c2a7516 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:55.096644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d98bf2-8fc1-49ef-bbf8-58e4b4f4ecdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:55.097350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d98bf2-8fc1-49ef-bbf8-58e4b4f4ecdf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:55.097629 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d98bf2-8fc1-49ef-bbf8-58e4b4f4ecdf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:55.097900 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d98bf2-8fc1-49ef-bbf8-58e4b4f4ecdf None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:55.101074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d98bf2-8fc1-49ef-bbf8-58e4b4f4ecdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:55.101074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d98bf2-8fc1-49ef-bbf8-58e4b4f4ecdf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:55.105864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 382/772] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Apr 6 10:49:54 2022] GET /identity/v3/services => generated 772 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:55.159789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e8285-ef69-4241-99b7-271d1569d731 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:55.197890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b528828-16c7-459e-8f95-91593566d1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:55.198479 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b528828-16c7-459e-8f95-91593566d1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:55.198758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b528828-16c7-459e-8f95-91593566d1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:55.199027 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b528828-16c7-459e-8f95-91593566d1f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:55.199862 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b528828-16c7-459e-8f95-91593566d1f5 None admin] RBAC: Adding query filter params (role.id=07e6d0f9bf5345c99ce158cd3e62c1c5, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=4daf4512881842a1bdf191e0d75139cd) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:55.200171 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b528828-16c7-459e-8f95-91593566d1f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:55.201747 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b528828-16c7-459e-8f95-91593566d1f5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:55.208509 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 391/773] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:49:54 2022] GET /identity/v3/role_assignments?user.id=4daf4512881842a1bdf191e0d75139cd&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:55.286848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf5962-2107-4eea-9559-f74eb1c7c0c6 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:55.287162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf5962-2107-4eea-9559-f74eb1c7c0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:55.287406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf5962-2107-4eea-9559-f74eb1c7c0c6 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:55.289305 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 383/774] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:55.295269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc58894-81c9-4747-b747-dbcc994dedd3 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:55.295810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc58894-81c9-4747-b747-dbcc994dedd3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:55.295810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc58894-81c9-4747-b747-dbcc994dedd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:55.320432 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4bc58894-81c9-4747-b747-dbcc994dedd3 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:55.321673 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4bc58894-81c9-4747-b747-dbcc994dedd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:55.396845 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 392/775] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:49:55.427388 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf5962-2107-4eea-9559-f74eb1c7c0c6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:55.563549 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf5962-2107-4eea-9559-f74eb1c7c0c6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:55.581643 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2088fc-186d-49aa-b625-40e168104f23 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:55.582087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2088fc-186d-49aa-b625-40e168104f23 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:55.582498 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2088fc-186d-49aa-b625-40e168104f23 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:55.586962 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 393/776] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:55.590204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37472d-4850-4869-b02a-e0ce6d3b2e33 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:55.590595 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37472d-4850-4869-b02a-e0ce6d3b2e33 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:55.590969 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37472d-4850-4869-b02a-e0ce6d3b2e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:55.608385 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-ef37472d-4850-4869-b02a-e0ce6d3b2e33 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:55.609729 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ef37472d-4850-4869-b02a-e0ce6d3b2e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:55.620215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a2dff-edf5-4c75-8f17-e799bcc7d8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:55.621091 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a2dff-edf5-4c75-8f17-e799bcc7d8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:55.621384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a2dff-edf5-4c75-8f17-e799bcc7d8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:55.621721 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a2dff-edf5-4c75-8f17-e799bcc7d8e8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:55.622384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a2dff-edf5-4c75-8f17-e799bcc7d8e8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:55.623864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a2dff-edf5-4c75-8f17-e799bcc7d8e8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:55.643023 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-ad1a2dff-edf5-4c75-8f17-e799bcc7d8e8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 06 10:49:55.644766 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 384/777] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:55 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:55.651439 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a2dff-edf5-4c75-8f17-e799bcc7d8e8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:55.717906 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 394/778] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:49:55.773889 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37472d-4850-4869-b02a-e0ce6d3b2e33 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:55.879219 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a2dff-edf5-4c75-8f17-e799bcc7d8e8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:55.884575 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37472d-4850-4869-b02a-e0ce6d3b2e33 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:55.922753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da18b59-798c-48e7-97b5-01a547a18da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:55.923886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da18b59-798c-48e7-97b5-01a547a18da5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:55.924368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da18b59-798c-48e7-97b5-01a547a18da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:55.924836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da18b59-798c-48e7-97b5-01a547a18da5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:55.936474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da18b59-798c-48e7-97b5-01a547a18da5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:55.945126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-3da18b59-798c-48e7-97b5-01a547a18da5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:49:55.951947 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 395/779] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:49:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:55.953413 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da18b59-798c-48e7-97b5-01a547a18da5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:55.989169 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2218485-85e6-4758-9a56-a51165947b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:55.989858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2218485-85e6-4758-9a56-a51165947b5b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:55.990119 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2218485-85e6-4758-9a56-a51165947b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:55.990392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2218485-85e6-4758-9a56-a51165947b5b None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:55.991135 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2218485-85e6-4758-9a56-a51165947b5b None admin] RBAC: Adding query filter params (name=network) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:55.991453 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2218485-85e6-4758-9a56-a51165947b5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:55.992864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2218485-85e6-4758-9a56-a51165947b5b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:56.011850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 385/780] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Apr 6 10:49:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:56.017268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2218485-85e6-4758-9a56-a51165947b5b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:56.067597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da18b59-798c-48e7-97b5-01a547a18da5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:56.143369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca3079-8fcc-429b-8bd7-ebc5e9f65ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:56.143974 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3079-8fcc-429b-8bd7-ebc5e9f65ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:56.144258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3079-8fcc-429b-8bd7-ebc5e9f65ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:56.144531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3079-8fcc-429b-8bd7-ebc5e9f65ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:56.145322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca3079-8fcc-429b-8bd7-ebc5e9f65ce4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:56.145630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca3079-8fcc-429b-8bd7-ebc5e9f65ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:56.147077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca3079-8fcc-429b-8bd7-ebc5e9f65ce4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:56.167763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 396/781] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:56.174792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca3079-8fcc-429b-8bd7-ebc5e9f65ce4 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:56.210614 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2218485-85e6-4758-9a56-a51165947b5b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:56.258372 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040f8b3-d871-4474-bbdb-8d50bb920944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:56.259054 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040f8b3-d871-4474-bbdb-8d50bb920944 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:56.259336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040f8b3-d871-4474-bbdb-8d50bb920944 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:56.259611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040f8b3-d871-4474-bbdb-8d50bb920944 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:56.260326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040f8b3-d871-4474-bbdb-8d50bb920944 None admin] RBAC: Adding query filter params (type=network) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:56.260636 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040f8b3-d871-4474-bbdb-8d50bb920944 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:56.262095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040f8b3-d871-4474-bbdb-8d50bb920944 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:56.267667 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 386/782] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Apr 6 10:49:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:56.274229 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040f8b3-d871-4474-bbdb-8d50bb920944 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:56.289238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca3079-8fcc-429b-8bd7-ebc5e9f65ce4 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:56.324475 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc22a5e-455f-4c4b-a72e-d8b87f750bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:56.326133 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc22a5e-455f-4c4b-a72e-d8b87f750bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:56.326614 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc22a5e-455f-4c4b-a72e-d8b87f750bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:56.327102 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc22a5e-455f-4c4b-a72e-d8b87f750bf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:56.338661 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc22a5e-455f-4c4b-a72e-d8b87f750bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:56.340430 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc22a5e-455f-4c4b-a72e-d8b87f750bf0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:56.377722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-3dc22a5e-455f-4c4b-a72e-d8b87f750bf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:56.383929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 397/783] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:56.387090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc22a5e-455f-4c4b-a72e-d8b87f750bf0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:56.404676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040f8b3-d871-4474-bbdb-8d50bb920944 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:56.447658 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966756d-ef91-41d5-a319-d4ccb53399e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:56.448335 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966756d-ef91-41d5-a319-d4ccb53399e5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:56.448593 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966756d-ef91-41d5-a319-d4ccb53399e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:56.448890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966756d-ef91-41d5-a319-d4ccb53399e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:56.449882 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966756d-ef91-41d5-a319-d4ccb53399e5 None admin] RBAC: Adding query filter params (interface=public, service_id=0e254a0d9db34af9bec09551e4bfd45b, region_id=RegionOne) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:56.450199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966756d-ef91-41d5-a319-d4ccb53399e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:56.451744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966756d-ef91-41d5-a319-d4ccb53399e5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:56.465515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 387/784] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Apr 6 10:49:56 2022] GET /identity/v3/endpoints?service_id=0e254a0d9db34af9bec09551e4bfd45b&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:56.470525 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966756d-ef91-41d5-a319-d4ccb53399e5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:56.492734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc22a5e-455f-4c4b-a72e-d8b87f750bf0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:56.528129 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f42a3-6ae1-498c-a453-05d03e69eee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:56.529372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f42a3-6ae1-498c-a453-05d03e69eee3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:56.531744 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f42a3-6ae1-498c-a453-05d03e69eee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:56.532291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f42a3-6ae1-498c-a453-05d03e69eee3 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:56.533944 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f42a3-6ae1-498c-a453-05d03e69eee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:56.534466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f42a3-6ae1-498c-a453-05d03e69eee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:56.536065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f42a3-6ae1-498c-a453-05d03e69eee3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:56.562506 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 398/785] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:56.569838 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f42a3-6ae1-498c-a453-05d03e69eee3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:56.658145 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966756d-ef91-41d5-a319-d4ccb53399e5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:56.700970 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a4fe7-2df6-4d43-8c55-bf578ce3cc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:56.701743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a4fe7-2df6-4d43-8c55-bf578ce3cc5f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:56.702026 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a4fe7-2df6-4d43-8c55-bf578ce3cc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:56.702302 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a4fe7-2df6-4d43-8c55-bf578ce3cc5f None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:56.703039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a4fe7-2df6-4d43-8c55-bf578ce3cc5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:56.704456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a4fe7-2df6-4d43-8c55-bf578ce3cc5f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:56.710707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 388/786] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Apr 6 10:49:56 2022] GET /identity/v3/services => generated 772 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:56.757035 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f42a3-6ae1-498c-a453-05d03e69eee3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:56.802476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e3e81-087b-406f-a9e3-f9971f14f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:56.805920 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e3e81-087b-406f-a9e3-f9971f14f779 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:56.806202 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e3e81-087b-406f-a9e3-f9971f14f779 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:56.806477 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e3e81-087b-406f-a9e3-f9971f14f779 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:56.818363 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e3e81-087b-406f-a9e3-f9971f14f779 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:56.820394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e3e81-087b-406f-a9e3-f9971f14f779 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:56.839789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-776e3e81-087b-406f-a9e3-f9971f14f779 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 10:49:56.841155 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 399/787] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:49:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:56.846908 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a4fe7-2df6-4d43-8c55-bf578ce3cc5f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:57.000598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a4fe7-2df6-4d43-8c55-bf578ce3cc5f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:57.036528 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f38ac2-7888-4607-bfa5-1dc1fab0f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:57.037234 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f38ac2-7888-4607-bfa5-1dc1fab0f5ae None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:57.037553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f38ac2-7888-4607-bfa5-1dc1fab0f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:57.037832 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f38ac2-7888-4607-bfa5-1dc1fab0f5ae None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:57.038673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f38ac2-7888-4607-bfa5-1dc1fab0f5ae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:57.038983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f38ac2-7888-4607-bfa5-1dc1fab0f5ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:57.040454 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f38ac2-7888-4607-bfa5-1dc1fab0f5ae None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:57.059203 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 389/788] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Apr 6 10:49:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:57.064887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e3e81-087b-406f-a9e3-f9971f14f779 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:57.176916 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e3e81-087b-406f-a9e3-f9971f14f779 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:57.220934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fd421-b4c7-4100-bc32-15e9783b844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:57.221761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fd421-b4c7-4100-bc32-15e9783b844a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:57.222046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fd421-b4c7-4100-bc32-15e9783b844a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:57.222320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fd421-b4c7-4100-bc32-15e9783b844a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:57.239027 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fd421-b4c7-4100-bc32-15e9783b844a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:57.240489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fd421-b4c7-4100-bc32-15e9783b844a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:57.262256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-140fd421-b4c7-4100-bc32-15e9783b844a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:57.263738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 400/789] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:57.269136 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f38ac2-7888-4607-bfa5-1dc1fab0f5ae None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:57.421022 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f38ac2-7888-4607-bfa5-1dc1fab0f5ae None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:57.454658 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dac87-882c-42bf-a02c-a961e22ec6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:57.455326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dac87-882c-42bf-a02c-a961e22ec6ef None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:57.455605 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dac87-882c-42bf-a02c-a961e22ec6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:57.455879 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dac87-882c-42bf-a02c-a961e22ec6ef None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:57.456607 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dac87-882c-42bf-a02c-a961e22ec6ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:57.456912 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dac87-882c-42bf-a02c-a961e22ec6ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:57.458349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dac87-882c-42bf-a02c-a961e22ec6ef None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:57.476421 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 390/790] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:57.481595 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fd421-b4c7-4100-bc32-15e9783b844a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:57.591622 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71611225-6c73-4e91-af1e-fef584aff80f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:57.591840 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71611225-6c73-4e91-af1e-fef584aff80f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:57.592120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71611225-6c73-4e91-af1e-fef584aff80f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:57.593667 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 391/791] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:57.607557 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fd1fc-f0bf-4266-baf9-5e7321d2f770 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:57.607848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fd1fc-f0bf-4266-baf9-5e7321d2f770 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:57.608134 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fd1fc-f0bf-4266-baf9-5e7321d2f770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:57.631003 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fd421-b4c7-4100-bc32-15e9783b844a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:57.639697 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2a2fd1fc-f0bf-4266-baf9-5e7321d2f770 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:57.641032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2a2fd1fc-f0bf-4266-baf9-5e7321d2f770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:57.677137 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01152602-7df9-4993-bf57-dcca4f69ebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:57.678210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01152602-7df9-4993-bf57-dcca4f69ebe7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:57.678496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01152602-7df9-4993-bf57-dcca4f69ebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:57.678772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01152602-7df9-4993-bf57-dcca4f69ebe7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:57.686570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01152602-7df9-4993-bf57-dcca4f69ebe7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:57.688404 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01152602-7df9-4993-bf57-dcca4f69ebe7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:57.706044 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-01152602-7df9-4993-bf57-dcca4f69ebe7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:49:57.707726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 401/792] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:57.714290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01152602-7df9-4993-bf57-dcca4f69ebe7 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:57.799876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 392/793] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:49:57.841036 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01152602-7df9-4993-bf57-dcca4f69ebe7 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:57.876817 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fd1fc-f0bf-4266-baf9-5e7321d2f770 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:57.890841 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3a73d-e19c-4e9b-92ae-9de5237240e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:57.891512 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3a73d-e19c-4e9b-92ae-9de5237240e5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:57.891796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3a73d-e19c-4e9b-92ae-9de5237240e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:57.892072 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3a73d-e19c-4e9b-92ae-9de5237240e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:57.892866 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3a73d-e19c-4e9b-92ae-9de5237240e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:57.893204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3a73d-e19c-4e9b-92ae-9de5237240e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:57.894647 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3a73d-e19c-4e9b-92ae-9de5237240e5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:57.914461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 402/794] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:49:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:49:57.922126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3a73d-e19c-4e9b-92ae-9de5237240e5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:57.999995 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fd1fc-f0bf-4266-baf9-5e7321d2f770 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:58.038834 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba0676-84b6-42e5-8947-f7feafcdfe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:58.039781 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0676-84b6-42e5-8947-f7feafcdfe1b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:58.040071 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0676-84b6-42e5-8947-f7feafcdfe1b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:58.040346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0676-84b6-42e5-8947-f7feafcdfe1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:58.051513 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba0676-84b6-42e5-8947-f7feafcdfe1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:58.060017 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-3aba0676-84b6-42e5-8947-f7feafcdfe1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:49:58.061585 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 393/795] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:49:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:49:58.067727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba0676-84b6-42e5-8947-f7feafcdfe1b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:58.125596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3a73d-e19c-4e9b-92ae-9de5237240e5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:58.160749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7956c1-9df0-43e7-adf1-804799c3c963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:58.161590 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7956c1-9df0-43e7-adf1-804799c3c963 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:58.161871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7956c1-9df0-43e7-adf1-804799c3c963 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:58.162146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7956c1-9df0-43e7-adf1-804799c3c963 None admin] PATH_INFO: `/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/89101c5ca3b048939a46b0bb246d2cbd/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:58.164676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7956c1-9df0-43e7-adf1-804799c3c963 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4306a6b12434cc495650e4f3b9afbde, user_id=89101c5ca3b048939a46b0bb246d2cbd, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:58.166145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7956c1-9df0-43e7-adf1-804799c3c963 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:58.174527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba0676-84b6-42e5-8947-f7feafcdfe1b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:58.207013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7ffd6-b7c8-47a9-836a-bccffc612684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:58.207670 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7ffd6-b7c8-47a9-836a-bccffc612684 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:58.207951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7ffd6-b7c8-47a9-836a-bccffc612684 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:58.208227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7ffd6-b7c8-47a9-836a-bccffc612684 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:58.208966 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7ffd6-b7c8-47a9-836a-bccffc612684 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:58.209317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7ffd6-b7c8-47a9-836a-bccffc612684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:58.210735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7ffd6-b7c8-47a9-836a-bccffc612684 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:58.218497 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 394/796] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:49:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:58.219775 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734a414-9203-428d-9438-00970595578c None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:58.220062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734a414-9203-428d-9438-00970595578c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:58.220336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734a414-9203-428d-9438-00970595578c None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:58.221734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 395/797] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:58.223751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ae7ad-20f7-4e2a-bd83-5e3f6b0474fd None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:58.224044 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ae7ad-20f7-4e2a-bd83-5e3f6b0474fd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:58.224326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ae7ad-20f7-4e2a-bd83-5e3f6b0474fd None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:58.226223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 396/798] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:58.226796 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ae7ad-20f7-4e2a-bd83-5e3f6b0474fd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:58.236043 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 403/799] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:49:57 2022] PUT /identity/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/89101c5ca3b048939a46b0bb246d2cbd/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:49:58.246648 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5db9a6-dfdb-41cd-99b1-1a37bcb23c7e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:58.247017 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5db9a6-dfdb-41cd-99b1-1a37bcb23c7e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:58.247308 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5db9a6-dfdb-41cd-99b1-1a37bcb23c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:58.291162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4c5db9a6-dfdb-41cd-99b1-1a37bcb23c7e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:58.292390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4c5db9a6-dfdb-41cd-99b1-1a37bcb23c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:58.350498 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ae7ad-20f7-4e2a-bd83-5e3f6b0474fd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:58.390495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8e00c-f273-47fa-a576-0ad28eb5ddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:58.391491 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8e00c-f273-47fa-a576-0ad28eb5ddeb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:58.391907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8e00c-f273-47fa-a576-0ad28eb5ddeb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:58.392409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8e00c-f273-47fa-a576-0ad28eb5ddeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:58.392779 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 404/800] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:49:58.394309 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906780ed-9db1-4592-91ff-a3021285f699 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:58.394796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906780ed-9db1-4592-91ff-a3021285f699 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:58.395204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906780ed-9db1-4592-91ff-a3021285f699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:58.414410 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-906780ed-9db1-4592-91ff-a3021285f699 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:58.415889 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-906780ed-9db1-4592-91ff-a3021285f699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:58.418664 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8e00c-f273-47fa-a576-0ad28eb5ddeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:58.420308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8e00c-f273-47fa-a576-0ad28eb5ddeb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:58.444811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-6ac8e00c-f273-47fa-a576-0ad28eb5ddeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:58.447706 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 397/801] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:58.447706 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8e00c-f273-47fa-a576-0ad28eb5ddeb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:58.498441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 405/802] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:49:58.500127 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906780ed-9db1-4592-91ff-a3021285f699 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:58.575739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8e00c-f273-47fa-a576-0ad28eb5ddeb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:58.617324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906780ed-9db1-4592-91ff-a3021285f699 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:58.623770 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e201008-01c3-4e6b-9168-fe1df34e3d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:58.624586 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e201008-01c3-4e6b-9168-fe1df34e3d81 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:58.625370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e201008-01c3-4e6b-9168-fe1df34e3d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:58.625662 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e201008-01c3-4e6b-9168-fe1df34e3d81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:58.638686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e201008-01c3-4e6b-9168-fe1df34e3d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:49:58.648795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-5e201008-01c3-4e6b-9168-fe1df34e3d81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:49:58.652032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 398/803] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:49:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:58.652032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e201008-01c3-4e6b-9168-fe1df34e3d81 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:58.653865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb0df4-b12d-43c1-895b-8e852b2ee167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:58.665168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb0df4-b12d-43c1-895b-8e852b2ee167 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:58.665168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb0df4-b12d-43c1-895b-8e852b2ee167 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:58.665168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb0df4-b12d-43c1-895b-8e852b2ee167 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:58.665168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb0df4-b12d-43c1-895b-8e852b2ee167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:58.665168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb0df4-b12d-43c1-895b-8e852b2ee167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:58.665168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb0df4-b12d-43c1-895b-8e852b2ee167 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:58.672186 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 406/804] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:58.676173 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb0df4-b12d-43c1-895b-8e852b2ee167 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:58.760137 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e201008-01c3-4e6b-9168-fe1df34e3d81 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:58.777905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb0df4-b12d-43c1-895b-8e852b2ee167 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:58.795352 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0248f53-4d50-426d-9fbd-30f591b483fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:58.796293 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248f53-4d50-426d-9fbd-30f591b483fe None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:58.796643 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248f53-4d50-426d-9fbd-30f591b483fe None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:58.797018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248f53-4d50-426d-9fbd-30f591b483fe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:58.797821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0248f53-4d50-426d-9fbd-30f591b483fe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:58.799302 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0248f53-4d50-426d-9fbd-30f591b483fe None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:58.811345 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-f0248f53-4d50-426d-9fbd-30f591b483fe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 06 10:49:58.812631 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300d5eb-0fcc-4b0e-9550-e7255fc8757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:58.813508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300d5eb-0fcc-4b0e-9550-e7255fc8757f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:58.813794 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300d5eb-0fcc-4b0e-9550-e7255fc8757f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:58.814072 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300d5eb-0fcc-4b0e-9550-e7255fc8757f None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:58.814823 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300d5eb-0fcc-4b0e-9550-e7255fc8757f None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:58.815133 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300d5eb-0fcc-4b0e-9550-e7255fc8757f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:58.816595 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300d5eb-0fcc-4b0e-9550-e7255fc8757f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:58.816846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 399/805] 10.222.0.62 () {56 vars in 1129 bytes} [Wed Apr 6 10:49:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:58.817702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0248f53-4d50-426d-9fbd-30f591b483fe None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:58.825635 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 407/806] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:49:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:58.826468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300d5eb-0fcc-4b0e-9550-e7255fc8757f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:58.926253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0248f53-4d50-426d-9fbd-30f591b483fe None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:58.926941 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300d5eb-0fcc-4b0e-9550-e7255fc8757f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:58.961131 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffaf947-a102-4c0b-a2ef-3eab3c7a5c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:58.961662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79440e00-b3c8-407c-a2cd-d00025d12a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:58.962020 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffaf947-a102-4c0b-a2ef-3eab3c7a5c8d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:58.962304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffaf947-a102-4c0b-a2ef-3eab3c7a5c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:58.962415 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79440e00-b3c8-407c-a2cd-d00025d12a6b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:58.962570 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffaf947-a102-4c0b-a2ef-3eab3c7a5c8d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:58.962727 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79440e00-b3c8-407c-a2cd-d00025d12a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:58.962874 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79440e00-b3c8-407c-a2cd-d00025d12a6b None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:58.963561 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79440e00-b3c8-407c-a2cd-d00025d12a6b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:58.963869 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79440e00-b3c8-407c-a2cd-d00025d12a6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:58.965262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79440e00-b3c8-407c-a2cd-d00025d12a6b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:58.970201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 408/807] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Apr 6 10:49:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:58.971008 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79440e00-b3c8-407c-a2cd-d00025d12a6b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:58.974369 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffaf947-a102-4c0b-a2ef-3eab3c7a5c8d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:58.975938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffaf947-a102-4c0b-a2ef-3eab3c7a5c8d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:58.991422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-8ffaf947-a102-4c0b-a2ef-3eab3c7a5c8d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 10:49:58.993092 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 400/808] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Apr 6 10:49:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:58.993891 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffaf947-a102-4c0b-a2ef-3eab3c7a5c8d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:59.075921 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79440e00-b3c8-407c-a2cd-d00025d12a6b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:59.097610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffaf947-a102-4c0b-a2ef-3eab3c7a5c8d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:59.111773 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dff2f-282e-4625-89b1-cf99b497afbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:59.112586 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dff2f-282e-4625-89b1-cf99b497afbd None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:59.112868 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dff2f-282e-4625-89b1-cf99b497afbd None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:59.113176 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dff2f-282e-4625-89b1-cf99b497afbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:59.123908 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94dff2f-282e-4625-89b1-cf99b497afbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:59.125447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94dff2f-282e-4625-89b1-cf99b497afbd None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:59.135076 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1c776-057f-488f-b872-ead23d12261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:59.135752 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1c776-057f-488f-b872-ead23d12261e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:59.136032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1c776-057f-488f-b872-ead23d12261e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:59.136305 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1c776-057f-488f-b872-ead23d12261e None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:59.137005 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1c776-057f-488f-b872-ead23d12261e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:59.137346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1c776-057f-488f-b872-ead23d12261e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:59.138756 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1c776-057f-488f-b872-ead23d12261e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:59.144608 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 401/809] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Apr 6 10:49:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:59.149988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1c776-057f-488f-b872-ead23d12261e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:59.150278 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-a94dff2f-282e-4625-89b1-cf99b497afbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:59.152295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 409/810] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:59.153322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dff2f-282e-4625-89b1-cf99b497afbd None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:59.252445 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1c776-057f-488f-b872-ead23d12261e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:59.254635 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dff2f-282e-4625-89b1-cf99b497afbd None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:59.287343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a5ec8-bbc6-4e8f-8b5b-ae1c69f727e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:59.288054 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a5ec8-bbc6-4e8f-8b5b-ae1c69f727e9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:59.288334 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a5ec8-bbc6-4e8f-8b5b-ae1c69f727e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:59.288603 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a5ec8-bbc6-4e8f-8b5b-ae1c69f727e9 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:59.289472 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a5ec8-bbc6-4e8f-8b5b-ae1c69f727e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:59.289776 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a5ec8-bbc6-4e8f-8b5b-ae1c69f727e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:59.291776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3634b-9e2b-447e-88d5-53021a38f0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:59.292142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a5ec8-bbc6-4e8f-8b5b-ae1c69f727e9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:59.292885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3634b-9e2b-447e-88d5-53021a38f0b0 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:59.293374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3634b-9e2b-447e-88d5-53021a38f0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:59.293846 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3634b-9e2b-447e-88d5-53021a38f0b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:59.294843 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3634b-9e2b-447e-88d5-53021a38f0b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:59.296490 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3634b-9e2b-447e-88d5-53021a38f0b0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:59.311253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 402/811] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Apr 6 10:49:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:59.312181 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a5ec8-bbc6-4e8f-8b5b-ae1c69f727e9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:59.393407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 410/812] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Apr 6 10:49:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:49:59.395700 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3634b-9e2b-447e-88d5-53021a38f0b0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:59.419551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a5ec8-bbc6-4e8f-8b5b-ae1c69f727e9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:59.464077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a70f31-ecb0-4ae6-bcac-c59ee711c594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:59.464743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a70f31-ecb0-4ae6-bcac-c59ee711c594 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:59.465025 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a70f31-ecb0-4ae6-bcac-c59ee711c594 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:59.465326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a70f31-ecb0-4ae6-bcac-c59ee711c594 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:59.466106 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a70f31-ecb0-4ae6-bcac-c59ee711c594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:59.466409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a70f31-ecb0-4ae6-bcac-c59ee711c594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:59.467974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a70f31-ecb0-4ae6-bcac-c59ee711c594 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:59.481596 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 403/813] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:59.483001 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c495a9-1d93-423e-b2b7-38c503d78160 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:59.483295 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c495a9-1d93-423e-b2b7-38c503d78160 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:59.483631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c495a9-1d93-423e-b2b7-38c503d78160 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:59.485267 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 404/814] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:49:59.487639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c495a9-1d93-423e-b2b7-38c503d78160 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:59.533547 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3634b-9e2b-447e-88d5-53021a38f0b0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:59.569595 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c0f6-676c-4df5-9ca8-865fa8151737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:59.570312 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c0f6-676c-4df5-9ca8-865fa8151737 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:59.570593 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c0f6-676c-4df5-9ca8-865fa8151737 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:59.570867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c0f6-676c-4df5-9ca8-865fa8151737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:59.626459 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c495a9-1d93-423e-b2b7-38c503d78160 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:59.658099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2c0f6-676c-4df5-9ca8-865fa8151737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:59.659573 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2c0f6-676c-4df5-9ca8-865fa8151737 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:59.681097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301747e-e518-4f9b-81c9-2ffb57a88b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:59.681097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301747e-e518-4f9b-81c9-2ffb57a88b4f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:59.681097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301747e-e518-4f9b-81c9-2ffb57a88b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:59.681097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301747e-e518-4f9b-81c9-2ffb57a88b4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:59.683665 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301747e-e518-4f9b-81c9-2ffb57a88b4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:59.685231 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301747e-e518-4f9b-81c9-2ffb57a88b4f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:59.703660 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-1301747e-e518-4f9b-81c9-2ffb57a88b4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 10:49:59.705496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 405/815] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Apr 6 10:49:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:59.709272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10dad2-69bd-4ac1-86fd-205df9371ac1 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:59.710178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10dad2-69bd-4ac1-86fd-205df9371ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:59.713074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10dad2-69bd-4ac1-86fd-205df9371ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:59.730418 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-fc10dad2-69bd-4ac1-86fd-205df9371ac1 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:49:59.732101 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fc10dad2-69bd-4ac1-86fd-205df9371ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:49:59.776512 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 411/816] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:49:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:49:59.777417 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c0f6-676c-4df5-9ca8-865fa8151737 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:59.817096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 406/817] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:49:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:49:59.817879 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10dad2-69bd-4ac1-86fd-205df9371ac1 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:59.904690 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c0f6-676c-4df5-9ca8-865fa8151737 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:59.916420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10dad2-69bd-4ac1-86fd-205df9371ac1 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:49:59.938795 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217632c-b0a9-4c55-b79e-d01ca56a770f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:59.939473 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217632c-b0a9-4c55-b79e-d01ca56a770f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:59.939756 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217632c-b0a9-4c55-b79e-d01ca56a770f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:59.940032 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217632c-b0a9-4c55-b79e-d01ca56a770f None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:59.940862 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217632c-b0a9-4c55-b79e-d01ca56a770f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:49:59.941204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217632c-b0a9-4c55-b79e-d01ca56a770f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:59.942621 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217632c-b0a9-4c55-b79e-d01ca56a770f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:59.951057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd1210-8ea0-4d43-b75a-04caba606196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:49:59.951854 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd1210-8ea0-4d43-b75a-04caba606196 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:49:59.952141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd1210-8ea0-4d43-b75a-04caba606196 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:49:59.952419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd1210-8ea0-4d43-b75a-04caba606196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:49:59.961153 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 412/818] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Apr 6 10:49:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:49:59.962035 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217632c-b0a9-4c55-b79e-d01ca56a770f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:49:59.967325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd1210-8ea0-4d43-b75a-04caba606196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:49:59.969096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd1210-8ea0-4d43-b75a-04caba606196 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:49:59.991218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-20dd1210-8ea0-4d43-b75a-04caba606196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:49:59.993340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 407/819] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:49:59.994190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd1210-8ea0-4d43-b75a-04caba606196 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:00.085003 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217632c-b0a9-4c55-b79e-d01ca56a770f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:00.103907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd1210-8ea0-4d43-b75a-04caba606196 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:00.128848 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30be6da-73eb-4558-b159-cb04a6958643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:00.129763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30be6da-73eb-4558-b159-cb04a6958643 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:00.130044 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30be6da-73eb-4558-b159-cb04a6958643 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:00.130313 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30be6da-73eb-4558-b159-cb04a6958643 None admin] PATH_INFO: `/v3/services/network` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:00.130973 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30be6da-73eb-4558-b159-cb04a6958643 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:00.132928 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30be6da-73eb-4558-b159-cb04a6958643 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:00.144217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75e1dd-f43b-4468-a621-3b3d630844ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:00.144526 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-c30be6da-73eb-4558-b159-cb04a6958643 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 06 10:50:00.145016 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75e1dd-f43b-4468-a621-3b3d630844ea None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:00.145322 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75e1dd-f43b-4468-a621-3b3d630844ea None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:00.145600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75e1dd-f43b-4468-a621-3b3d630844ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:00.150563 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 413/820] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:49:59 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:00.151401 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30be6da-73eb-4558-b159-cb04a6958643 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:00.157365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75e1dd-f43b-4468-a621-3b3d630844ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:00.158864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75e1dd-f43b-4468-a621-3b3d630844ea None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:00.181864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-ef75e1dd-f43b-4468-a621-3b3d630844ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:00.188722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 408/821] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:00.190421 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75e1dd-f43b-4468-a621-3b3d630844ea None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:00.256018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30be6da-73eb-4558-b159-cb04a6958643 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:00.296482 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2df42d-9232-4657-98c0-46ec5536fdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:00.297217 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2df42d-9232-4657-98c0-46ec5536fdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:00.297669 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2df42d-9232-4657-98c0-46ec5536fdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:00.297858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75e1dd-f43b-4468-a621-3b3d630844ea None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:00.298013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2df42d-9232-4657-98c0-46ec5536fdd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:00.298685 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2df42d-9232-4657-98c0-46ec5536fdd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:00.298992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2df42d-9232-4657-98c0-46ec5536fdd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:00.301631 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2df42d-9232-4657-98c0-46ec5536fdd3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:00.316681 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 414/822] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:00.317646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2df42d-9232-4657-98c0-46ec5536fdd3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:00.337870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca8ed2-ea42-4820-8e20-e21899811886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:00.339385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca8ed2-ea42-4820-8e20-e21899811886 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:00.339385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca8ed2-ea42-4820-8e20-e21899811886 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:00.339385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca8ed2-ea42-4820-8e20-e21899811886 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:00.339832 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca8ed2-ea42-4820-8e20-e21899811886 None admin] RBAC: Adding query filter params (name=network) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:00.340106 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca8ed2-ea42-4820-8e20-e21899811886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:00.341734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca8ed2-ea42-4820-8e20-e21899811886 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:00.351493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 409/823] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Apr 6 10:50:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:00.351493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca8ed2-ea42-4820-8e20-e21899811886 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:00.450651 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca8ed2-ea42-4820-8e20-e21899811886 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:00.456163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2df42d-9232-4657-98c0-46ec5536fdd3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:00.492553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9d1d3-070b-4ab6-aefe-790892ac171b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:00.493673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9d1d3-070b-4ab6-aefe-790892ac171b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:00.494156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654925c8-3fef-447f-b2fd-944a8cd777ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:00.494314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9d1d3-070b-4ab6-aefe-790892ac171b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:00.494719 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9d1d3-070b-4ab6-aefe-790892ac171b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:00.495089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654925c8-3fef-447f-b2fd-944a8cd777ef None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:00.495469 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654925c8-3fef-447f-b2fd-944a8cd777ef None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:00.496001 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654925c8-3fef-447f-b2fd-944a8cd777ef None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:00.496838 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654925c8-3fef-447f-b2fd-944a8cd777ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:00.497455 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654925c8-3fef-447f-b2fd-944a8cd777ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:00.498843 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654925c8-3fef-447f-b2fd-944a8cd777ef None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:00.503575 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9d1d3-070b-4ab6-aefe-790892ac171b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:00.505338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9d1d3-070b-4ab6-aefe-790892ac171b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:00.516258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 415/824] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:00.517319 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654925c8-3fef-447f-b2fd-944a8cd777ef None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:00.522953 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-e3e9d1d3-070b-4ab6-aefe-790892ac171b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:50:00.524695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 410/825] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:50:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:00.525767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9d1d3-070b-4ab6-aefe-790892ac171b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:00.629140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654925c8-3fef-447f-b2fd-944a8cd777ef None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:00.649004 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9d1d3-070b-4ab6-aefe-790892ac171b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:00.667246 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97743f-adb1-47f1-bcc4-9904750c2786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:00.667918 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97743f-adb1-47f1-bcc4-9904750c2786 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:00.668201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97743f-adb1-47f1-bcc4-9904750c2786 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:00.668479 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97743f-adb1-47f1-bcc4-9904750c2786 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:00.669236 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97743f-adb1-47f1-bcc4-9904750c2786 None admin] RBAC: Adding query filter params (type=network) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:00.669546 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97743f-adb1-47f1-bcc4-9904750c2786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:00.671292 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97743f-adb1-47f1-bcc4-9904750c2786 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:00.677226 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 416/826] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Apr 6 10:50:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:00.677226 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97743f-adb1-47f1-bcc4-9904750c2786 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:00.687460 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2b59f-f275-4743-bb0f-14dda0e8331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:00.688259 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2b59f-f275-4743-bb0f-14dda0e8331f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:00.688537 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2b59f-f275-4743-bb0f-14dda0e8331f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:00.688807 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2b59f-f275-4743-bb0f-14dda0e8331f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:00.695547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2b59f-f275-4743-bb0f-14dda0e8331f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:00.697016 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2b59f-f275-4743-bb0f-14dda0e8331f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:00.714042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-e3b2b59f-f275-4743-bb0f-14dda0e8331f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:50:00.720062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 411/827] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:50:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:00.720062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941c216-bc63-4690-b1d3-dfb178c2da05 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:00.720062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941c216-bc63-4690-b1d3-dfb178c2da05 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:00.720062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941c216-bc63-4690-b1d3-dfb178c2da05 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:00.720062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 412/828] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:00.720062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941c216-bc63-4690-b1d3-dfb178c2da05 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:00.786540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97743f-adb1-47f1-bcc4-9904750c2786 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:00.819668 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941c216-bc63-4690-b1d3-dfb178c2da05 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:00.823190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762164dc-eda0-4dda-a2cb-8ee0a8073573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:00.823934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762164dc-eda0-4dda-a2cb-8ee0a8073573 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:00.824301 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762164dc-eda0-4dda-a2cb-8ee0a8073573 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:00.824644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762164dc-eda0-4dda-a2cb-8ee0a8073573 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:00.825531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762164dc-eda0-4dda-a2cb-8ee0a8073573 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:00.825906 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762164dc-eda0-4dda-a2cb-8ee0a8073573 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:00.827471 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762164dc-eda0-4dda-a2cb-8ee0a8073573 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:00.840096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 417/829] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:50:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:00.840895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762164dc-eda0-4dda-a2cb-8ee0a8073573 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:00.858609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492413b0-3fd8-4c12-90f5-cf3fbd4c259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:00.859266 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492413b0-3fd8-4c12-90f5-cf3fbd4c259d None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:00.859549 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492413b0-3fd8-4c12-90f5-cf3fbd4c259d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:00.859821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492413b0-3fd8-4c12-90f5-cf3fbd4c259d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:00.860553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492413b0-3fd8-4c12-90f5-cf3fbd4c259d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:00.862001 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492413b0-3fd8-4c12-90f5-cf3fbd4c259d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:00.932655 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 413/830] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Apr 6 10:50:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:50:00.933958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133919d-5e94-49ec-be58-31bc35f2e7f5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:00.934245 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133919d-5e94-49ec-be58-31bc35f2e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:00.934524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133919d-5e94-49ec-be58-31bc35f2e7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:00.950533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762164dc-eda0-4dda-a2cb-8ee0a8073573 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:00.954474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2133919d-5e94-49ec-be58-31bc35f2e7f5 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:00.955253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2133919d-5e94-49ec-be58-31bc35f2e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:01.007465 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9673c1-2af5-4762-9b23-da1264d00f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:01.008592 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9673c1-2af5-4762-9b23-da1264d00f73 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:01.009448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9673c1-2af5-4762-9b23-da1264d00f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:01.009734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9673c1-2af5-4762-9b23-da1264d00f73 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:01.011533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9673c1-2af5-4762-9b23-da1264d00f73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:01.011877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9673c1-2af5-4762-9b23-da1264d00f73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:01.013424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9673c1-2af5-4762-9b23-da1264d00f73 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:01.027582 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 418/831] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:50:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:01.028638 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9673c1-2af5-4762-9b23-da1264d00f73 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:01.039938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 414/832] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:01.041248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133919d-5e94-49ec-be58-31bc35f2e7f5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:01.154300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133919d-5e94-49ec-be58-31bc35f2e7f5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:01.161229 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9673c1-2af5-4762-9b23-da1264d00f73 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:01.190401 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2f86e-0eea-4736-830d-431554728066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:01.191218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2f86e-0eea-4736-830d-431554728066 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:01.191496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2f86e-0eea-4736-830d-431554728066 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:01.191769 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2f86e-0eea-4736-830d-431554728066 None admin] PATH_INFO: `/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/4daf4512881842a1bdf191e0d75139cd/roles/07e6d0f9bf5345c99ce158cd3e62c1c5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:01.196520 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34c412-80d7-4602-9714-1c6abce88f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:01.196876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c412-80d7-4602-9714-1c6abce88f08 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:01.198120 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c412-80d7-4602-9714-1c6abce88f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:01.198120 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c412-80d7-4602-9714-1c6abce88f08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:01.198343 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34c412-80d7-4602-9714-1c6abce88f08 None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=650c5809116e4bcd808044236c06dcc2) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:01.198712 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34c412-80d7-4602-9714-1c6abce88f08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:01.200170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34c412-80d7-4602-9714-1c6abce88f08 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:01.207897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 419/833] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:50:01 2022] GET /identity/v3/role_assignments?user.id=650c5809116e4bcd808044236c06dcc2&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=090ba4d1ae32495289276665920d4a2c => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:01.208517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34c412-80d7-4602-9714-1c6abce88f08 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:01.215431 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2f86e-0eea-4736-830d-431554728066 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4306a6b12434cc495650e4f3b9afbde, user_id=4daf4512881842a1bdf191e0d75139cd, role_id=07e6d0f9bf5345c99ce158cd3e62c1c5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:01.217375 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2f86e-0eea-4736-830d-431554728066 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:01.313904 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 415/834] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:50:01 2022] PUT /identity/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/4daf4512881842a1bdf191e0d75139cd/roles/07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:50:01.337405 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34c412-80d7-4602-9714-1c6abce88f08 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:01.375825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799a3c3-d4d9-48c6-a6c3-e43b7ad365d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:01.376958 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799a3c3-d4d9-48c6-a6c3-e43b7ad365d9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:01.377440 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799a3c3-d4d9-48c6-a6c3-e43b7ad365d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:01.377855 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799a3c3-d4d9-48c6-a6c3-e43b7ad365d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:01.391485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799a3c3-d4d9-48c6-a6c3-e43b7ad365d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:50:01.399613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-d799a3c3-d4d9-48c6-a6c3-e43b7ad365d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:50:01.401532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 420/835] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:50:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:01.411374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2f86e-0eea-4736-830d-431554728066 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:01.524509 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2f86e-0eea-4736-830d-431554728066 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:01.558927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e077d-8381-4b25-b9e4-5f80ce6224e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:01.559605 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e077d-8381-4b25-b9e4-5f80ce6224e1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:01.559888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e077d-8381-4b25-b9e4-5f80ce6224e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:01.560164 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e077d-8381-4b25-b9e4-5f80ce6224e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:01.560908 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e077d-8381-4b25-b9e4-5f80ce6224e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:01.561251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e077d-8381-4b25-b9e4-5f80ce6224e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:01.562910 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e077d-8381-4b25-b9e4-5f80ce6224e1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:01.572437 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 416/836] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:50:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:01.577700 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799a3c3-d4d9-48c6-a6c3-e43b7ad365d9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:01.682530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799a3c3-d4d9-48c6-a6c3-e43b7ad365d9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:01.718244 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b724e-473b-4dc8-9015-10f84c4d6f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:01.719045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b724e-473b-4dc8-9015-10f84c4d6f0c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:01.719329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b724e-473b-4dc8-9015-10f84c4d6f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:01.719603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b724e-473b-4dc8-9015-10f84c4d6f0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:01.731036 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b724e-473b-4dc8-9015-10f84c4d6f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:01.732488 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b724e-473b-4dc8-9015-10f84c4d6f0c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:01.749443 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-508b724e-473b-4dc8-9015-10f84c4d6f0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:01.750991 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 421/837] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:01.756584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e077d-8381-4b25-b9e4-5f80ce6224e1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:01.860992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94357f6b-94dc-42b4-9e6f-ba7711edacd0 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:01.860992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94357f6b-94dc-42b4-9e6f-ba7711edacd0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:01.860992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94357f6b-94dc-42b4-9e6f-ba7711edacd0 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:01.860992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 422/838] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:50:01.866646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbad601-0507-4405-97b7-6e7c4ba336a1 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:01.867044 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e077d-8381-4b25-b9e4-5f80ce6224e1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:01.867388 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbad601-0507-4405-97b7-6e7c4ba336a1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:01.867850 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbad601-0507-4405-97b7-6e7c4ba336a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:01.891899 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5cbad601-0507-4405-97b7-6e7c4ba336a1 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:01.893586 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5cbad601-0507-4405-97b7-6e7c4ba336a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:01.905545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895e79-241e-4535-9f99-1d4f414888ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:01.906531 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895e79-241e-4535-9f99-1d4f414888ca None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:01.906819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895e79-241e-4535-9f99-1d4f414888ca None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:01.907380 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895e79-241e-4535-9f99-1d4f414888ca None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:01.908107 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a895e79-241e-4535-9f99-1d4f414888ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:01.908413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a895e79-241e-4535-9f99-1d4f414888ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:01.910377 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a895e79-241e-4535-9f99-1d4f414888ca None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:01.926967 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 417/839] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:01.932741 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895e79-241e-4535-9f99-1d4f414888ca None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:01.985074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 423/840] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:02.001510 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbad601-0507-4405-97b7-6e7c4ba336a1 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:02.045993 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895e79-241e-4535-9f99-1d4f414888ca None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:02.087922 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9760fa-9a5c-4b7c-81f1-05348a174ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:02.088728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9760fa-9a5c-4b7c-81f1-05348a174ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:02.089381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9760fa-9a5c-4b7c-81f1-05348a174ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:02.089381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9760fa-9a5c-4b7c-81f1-05348a174ee2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:02.096582 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9760fa-9a5c-4b7c-81f1-05348a174ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:02.098103 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9760fa-9a5c-4b7c-81f1-05348a174ee2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:02.101930 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbad601-0507-4405-97b7-6e7c4ba336a1 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:02.111670 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-2f9760fa-9a5c-4b7c-81f1-05348a174ee2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 10:50:02.117165 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 418/841] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:50:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:02.119497 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9760fa-9a5c-4b7c-81f1-05348a174ee2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:02.142283 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efd6bc-8e6f-44bb-a1a8-59af46eba516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:02.143513 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd6bc-8e6f-44bb-a1a8-59af46eba516 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:02.143996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd6bc-8e6f-44bb-a1a8-59af46eba516 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:02.144467 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd6bc-8e6f-44bb-a1a8-59af46eba516 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:02.145438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efd6bc-8e6f-44bb-a1a8-59af46eba516 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:02.147638 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efd6bc-8e6f-44bb-a1a8-59af46eba516 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:02.162687 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-09efd6bc-8e6f-44bb-a1a8-59af46eba516 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 06 10:50:02.172020 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 424/842] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:50:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:02.173717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efd6bc-8e6f-44bb-a1a8-59af46eba516 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:02.227653 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9760fa-9a5c-4b7c-81f1-05348a174ee2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:02.261337 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9f530-e041-40c6-adc9-ea9f387d17f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:02.262011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9f530-e041-40c6-adc9-ea9f387d17f2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:02.262290 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9f530-e041-40c6-adc9-ea9f387d17f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:02.262564 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9f530-e041-40c6-adc9-ea9f387d17f2 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:02.263386 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9f530-e041-40c6-adc9-ea9f387d17f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:02.263692 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9f530-e041-40c6-adc9-ea9f387d17f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:02.265167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9f530-e041-40c6-adc9-ea9f387d17f2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:02.285789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efd6bc-8e6f-44bb-a1a8-59af46eba516 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:02.287604 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 419/843] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Apr 6 10:50:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:02.288480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9f530-e041-40c6-adc9-ea9f387d17f2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:02.320972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b0695-9735-469a-b03c-a266e5f48fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:02.321728 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b0695-9735-469a-b03c-a266e5f48fcf None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:02.322013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b0695-9735-469a-b03c-a266e5f48fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:02.322290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b0695-9735-469a-b03c-a266e5f48fcf None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:02.323001 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b0695-9735-469a-b03c-a266e5f48fcf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:02.323309 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b0695-9735-469a-b03c-a266e5f48fcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:02.324670 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b0695-9735-469a-b03c-a266e5f48fcf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:02.329713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 425/844] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:50:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:02.342316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b0695-9735-469a-b03c-a266e5f48fcf None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:02.388451 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9f530-e041-40c6-adc9-ea9f387d17f2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:02.422755 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d6c4d-73c6-40f0-9179-b5bb2f6944e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:02.423448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d6c4d-73c6-40f0-9179-b5bb2f6944e7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:02.423728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d6c4d-73c6-40f0-9179-b5bb2f6944e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:02.424000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d6c4d-73c6-40f0-9179-b5bb2f6944e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:02.468576 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b0695-9735-469a-b03c-a266e5f48fcf None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:02.502435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d6c4d-73c6-40f0-9179-b5bb2f6944e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:02.504277 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d6c4d-73c6-40f0-9179-b5bb2f6944e7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:02.504760 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5103f-ced1-4464-aa0a-6b7762d4dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:02.505523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5103f-ced1-4464-aa0a-6b7762d4dcb9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:02.505811 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5103f-ced1-4464-aa0a-6b7762d4dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:02.506116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5103f-ced1-4464-aa0a-6b7762d4dcb9 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:02.506846 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5103f-ced1-4464-aa0a-6b7762d4dcb9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:02.507155 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5103f-ced1-4464-aa0a-6b7762d4dcb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:02.508567 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5103f-ced1-4464-aa0a-6b7762d4dcb9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:02.514003 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 426/845] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:50:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:02.626445 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 420/846] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:50:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:50:02.632588 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5103f-ced1-4464-aa0a-6b7762d4dcb9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:02.738932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5103f-ced1-4464-aa0a-6b7762d4dcb9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:02.773703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc49209-13ef-4b55-af17-3f7800a6dac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:02.774506 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc49209-13ef-4b55-af17-3f7800a6dac3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:02.774787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc49209-13ef-4b55-af17-3f7800a6dac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:02.775059 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc49209-13ef-4b55-af17-3f7800a6dac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:02.785627 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc49209-13ef-4b55-af17-3f7800a6dac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:02.787058 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc49209-13ef-4b55-af17-3f7800a6dac3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:02.804256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-8fc49209-13ef-4b55-af17-3f7800a6dac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:02.805835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 427/847] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:02.811148 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d6c4d-73c6-40f0-9179-b5bb2f6944e7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:02.907795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d6c4d-73c6-40f0-9179-b5bb2f6944e7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:02.942193 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10572b03-8d86-4134-862a-d3f04b63906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:02.942770 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10572b03-8d86-4134-862a-d3f04b63906b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:02.943044 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10572b03-8d86-4134-862a-d3f04b63906b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:02.943313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10572b03-8d86-4134-862a-d3f04b63906b None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:02.944060 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10572b03-8d86-4134-862a-d3f04b63906b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:02.944360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10572b03-8d86-4134-862a-d3f04b63906b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:02.945788 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10572b03-8d86-4134-862a-d3f04b63906b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:02.961354 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 421/848] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:02.962685 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc49209-13ef-4b55-af17-3f7800a6dac3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:03.062170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc49209-13ef-4b55-af17-3f7800a6dac3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:03.096405 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f34128-4856-4a2d-927f-725d39f33a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:03.097583 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f34128-4856-4a2d-927f-725d39f33a9f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:03.098073 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f34128-4856-4a2d-927f-725d39f33a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:03.098549 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f34128-4856-4a2d-927f-725d39f33a9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:03.106245 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f34128-4856-4a2d-927f-725d39f33a9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:03.107898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f34128-4856-4a2d-927f-725d39f33a9f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:03.122177 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-c5f34128-4856-4a2d-927f-725d39f33a9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:50:03.123967 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 428/849] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:50:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:03.129373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10572b03-8d86-4134-862a-d3f04b63906b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:03.229993 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10572b03-8d86-4134-862a-d3f04b63906b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:03.264113 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72778c-4a10-47b2-9465-4335216c0e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:03.264778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72778c-4a10-47b2-9465-4335216c0e2e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:03.265069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72778c-4a10-47b2-9465-4335216c0e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:03.265379 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72778c-4a10-47b2-9465-4335216c0e2e None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:03.266164 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72778c-4a10-47b2-9465-4335216c0e2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:03.266463 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72778c-4a10-47b2-9465-4335216c0e2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:03.267989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72778c-4a10-47b2-9465-4335216c0e2e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:03.280516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 422/850] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:50:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:03.286414 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f34128-4856-4a2d-927f-725d39f33a9f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:03.396666 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f34128-4856-4a2d-927f-725d39f33a9f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:03.433803 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec099db-d65d-401e-93d1-16f0ea5861e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:03.434463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec099db-d65d-401e-93d1-16f0ea5861e0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:03.434743 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec099db-d65d-401e-93d1-16f0ea5861e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:03.435019 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec099db-d65d-401e-93d1-16f0ea5861e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:03.435844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec099db-d65d-401e-93d1-16f0ea5861e0 None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=89101c5ca3b048939a46b0bb246d2cbd) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:03.436156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec099db-d65d-401e-93d1-16f0ea5861e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:03.437877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec099db-d65d-401e-93d1-16f0ea5861e0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:03.444820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 429/851] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:50:03 2022] GET /identity/v3/role_assignments?user.id=89101c5ca3b048939a46b0bb246d2cbd&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=090ba4d1ae32495289276665920d4a2c => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:03.733853 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1356df-4cee-4142-a633-2a95af05be92 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:03.734180 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1356df-4cee-4142-a633-2a95af05be92 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:03.734418 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1356df-4cee-4142-a633-2a95af05be92 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:03.736076 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 423/852] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:03.741573 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96206e4e-427d-4352-bf7f-4f90fd7982ac None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:03.742048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96206e4e-427d-4352-bf7f-4f90fd7982ac None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:03.742133 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96206e4e-427d-4352-bf7f-4f90fd7982ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:03.759578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-96206e4e-427d-4352-bf7f-4f90fd7982ac None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:03.760777 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-96206e4e-427d-4352-bf7f-4f90fd7982ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:03.776024 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6a73d-a0e6-419d-a43c-f0e5d04efa27 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:03.776307 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6a73d-a0e6-419d-a43c-f0e5d04efa27 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:03.776656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6a73d-a0e6-419d-a43c-f0e5d04efa27 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:03.778292 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 424/853] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:03.783440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe058d3-56ce-4455-a803-a0b1273cdfd3 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:03.783726 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe058d3-56ce-4455-a803-a0b1273cdfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:03.784005 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe058d3-56ce-4455-a803-a0b1273cdfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:03.802626 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5fe058d3-56ce-4455-a803-a0b1273cdfd3 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:03.804801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5fe058d3-56ce-4455-a803-a0b1273cdfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:03.837165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 430/854] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:03.854074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96206e4e-427d-4352-bf7f-4f90fd7982ac None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:03.886319 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 425/855] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:03.910482 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe058d3-56ce-4455-a803-a0b1273cdfd3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:03.958905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96206e4e-427d-4352-bf7f-4f90fd7982ac None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:03.991852 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775fa23-2187-48eb-a2e8-7fc10905bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:03.992662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775fa23-2187-48eb-a2e8-7fc10905bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:03.992943 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775fa23-2187-48eb-a2e8-7fc10905bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:03.993343 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775fa23-2187-48eb-a2e8-7fc10905bbcf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:03.994048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775fa23-2187-48eb-a2e8-7fc10905bbcf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:03.995474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775fa23-2187-48eb-a2e8-7fc10905bbcf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:04.007424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-5775fa23-2187-48eb-a2e8-7fc10905bbcf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 06 10:50:04.014825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 431/856] 10.222.0.62 () {56 vars in 1132 bytes} [Wed Apr 6 10:50:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:04.016040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775fa23-2187-48eb-a2e8-7fc10905bbcf None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:04.023625 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe058d3-56ce-4455-a803-a0b1273cdfd3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:04.065230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df597c-3a26-4a86-b71a-0b00f57dc473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:04.066310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df597c-3a26-4a86-b71a-0b00f57dc473 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:04.066757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df597c-3a26-4a86-b71a-0b00f57dc473 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:04.067194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df597c-3a26-4a86-b71a-0b00f57dc473 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:04.079140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df597c-3a26-4a86-b71a-0b00f57dc473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:50:04.086432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-04df597c-3a26-4a86-b71a-0b00f57dc473 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:50:04.088158 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 426/857] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:50:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:04.093577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df597c-3a26-4a86-b71a-0b00f57dc473 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:04.126140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775fa23-2187-48eb-a2e8-7fc10905bbcf None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:04.169362 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddf34e-03d7-416b-b0b4-7de24e6ae32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:04.170616 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddf34e-03d7-416b-b0b4-7de24e6ae32a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:04.171289 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddf34e-03d7-416b-b0b4-7de24e6ae32a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:04.171708 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddf34e-03d7-416b-b0b4-7de24e6ae32a None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:04.172733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddf34e-03d7-416b-b0b4-7de24e6ae32a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:04.173545 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddf34e-03d7-416b-b0b4-7de24e6ae32a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:04.175303 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddf34e-03d7-416b-b0b4-7de24e6ae32a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:04.182146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 432/858] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Apr 6 10:50:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:04.187646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddf34e-03d7-416b-b0b4-7de24e6ae32a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:04.196803 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df597c-3a26-4a86-b71a-0b00f57dc473 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:04.237440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c52fb-e111-4558-9b68-4bb954f5ce34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:04.239258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c52fb-e111-4558-9b68-4bb954f5ce34 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:04.239749 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c52fb-e111-4558-9b68-4bb954f5ce34 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:04.240545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c52fb-e111-4558-9b68-4bb954f5ce34 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:04.242312 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c52fb-e111-4558-9b68-4bb954f5ce34 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:04.242803 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c52fb-e111-4558-9b68-4bb954f5ce34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:04.245086 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c52fb-e111-4558-9b68-4bb954f5ce34 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:04.255894 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 427/859] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:50:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:04.260853 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c52fb-e111-4558-9b68-4bb954f5ce34 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:04.314950 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddf34e-03d7-416b-b0b4-7de24e6ae32a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:04.355940 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8597be-7ae2-4a3b-b6d1-0415be146ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:04.356858 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8597be-7ae2-4a3b-b6d1-0415be146ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:04.357315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8597be-7ae2-4a3b-b6d1-0415be146ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:04.357810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8597be-7ae2-4a3b-b6d1-0415be146ca9 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:04.358656 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8597be-7ae2-4a3b-b6d1-0415be146ca9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:04.359108 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8597be-7ae2-4a3b-b6d1-0415be146ca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:04.361031 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8597be-7ae2-4a3b-b6d1-0415be146ca9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:04.373374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 433/860] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Apr 6 10:50:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:04.391602 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c52fb-e111-4558-9b68-4bb954f5ce34 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:04.428630 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50433bb2-7d68-4345-95f0-d94c9c75739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:04.429469 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50433bb2-7d68-4345-95f0-d94c9c75739a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:04.429748 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50433bb2-7d68-4345-95f0-d94c9c75739a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:04.430027 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50433bb2-7d68-4345-95f0-d94c9c75739a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:04.441888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50433bb2-7d68-4345-95f0-d94c9c75739a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:04.443419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50433bb2-7d68-4345-95f0-d94c9c75739a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:04.462695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-50433bb2-7d68-4345-95f0-d94c9c75739a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:04.464347 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 428/861] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:04.469688 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8597be-7ae2-4a3b-b6d1-0415be146ca9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:04.584216 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8597be-7ae2-4a3b-b6d1-0415be146ca9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:04.622246 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930519e-5292-410c-9970-d790952569d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:04.622987 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930519e-5292-410c-9970-d790952569d9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:04.623275 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930519e-5292-410c-9970-d790952569d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:04.623549 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930519e-5292-410c-9970-d790952569d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:04.624293 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930519e-5292-410c-9970-d790952569d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:04.624600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930519e-5292-410c-9970-d790952569d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:04.626143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930519e-5292-410c-9970-d790952569d9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:04.639729 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 434/862] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:04.646225 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50433bb2-7d68-4345-95f0-d94c9c75739a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:04.758673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50433bb2-7d68-4345-95f0-d94c9c75739a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:04.793648 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7a242-587e-4903-9901-34d95ddff07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:04.794954 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7a242-587e-4903-9901-34d95ddff07b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:04.795237 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7a242-587e-4903-9901-34d95ddff07b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:04.795512 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7a242-587e-4903-9901-34d95ddff07b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:04.803600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7a242-587e-4903-9901-34d95ddff07b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:04.805089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7a242-587e-4903-9901-34d95ddff07b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:04.820535 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-12a7a242-587e-4903-9901-34d95ddff07b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 10:50:04.826659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 429/863] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Apr 6 10:50:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:04.828673 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930519e-5292-410c-9970-d790952569d9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:04.942249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930519e-5292-410c-9970-d790952569d9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:04.976202 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2834-5933-41b1-a4f1-bc2f34e1451d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:04.976500 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2834-5933-41b1-a4f1-bc2f34e1451d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:04.976812 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2834-5933-41b1-a4f1-bc2f34e1451d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:04.977580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df82eff-b915-41a6-be80-75b4e413854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:04.978488 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 430/864] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:50:04.978649 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df82eff-b915-41a6-be80-75b4e413854f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:04.978949 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df82eff-b915-41a6-be80-75b4e413854f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:04.979225 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df82eff-b915-41a6-be80-75b4e413854f None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:04.980072 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df82eff-b915-41a6-be80-75b4e413854f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:04.980384 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df82eff-b915-41a6-be80-75b4e413854f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:04.984774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df82eff-b915-41a6-be80-75b4e413854f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:04.987310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e5c8-7399-43c2-8cf1-5fbc0b22f1cb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:04.987858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e5c8-7399-43c2-8cf1-5fbc0b22f1cb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:04.988333 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e5c8-7399-43c2-8cf1-5fbc0b22f1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:05.000881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 435/865] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Apr 6 10:50:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:05.008153 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f1f3e5c8-7399-43c2-8cf1-5fbc0b22f1cb None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:05.009438 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f1f3e5c8-7399-43c2-8cf1-5fbc0b22f1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:05.010004 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df82eff-b915-41a6-be80-75b4e413854f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:05.093176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 431/866] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:05.110269 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e5c8-7399-43c2-8cf1-5fbc0b22f1cb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:05.115871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df82eff-b915-41a6-be80-75b4e413854f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:05.156367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82077dab-a09f-46a7-9614-2a3e87ef71a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:05.157027 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82077dab-a09f-46a7-9614-2a3e87ef71a9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:05.157354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82077dab-a09f-46a7-9614-2a3e87ef71a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:05.157628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82077dab-a09f-46a7-9614-2a3e87ef71a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:05.226743 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82077dab-a09f-46a7-9614-2a3e87ef71a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:05.228231 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82077dab-a09f-46a7-9614-2a3e87ef71a9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:05.230463 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e5c8-7399-43c2-8cf1-5fbc0b22f1cb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:05.270603 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707f30b-dd06-4990-b9c2-e55baa9bd127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:05.271376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f30b-dd06-4990-b9c2-e55baa9bd127 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:05.271553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f30b-dd06-4990-b9c2-e55baa9bd127 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:05.272382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f30b-dd06-4990-b9c2-e55baa9bd127 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:05.273143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707f30b-dd06-4990-b9c2-e55baa9bd127 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:05.274559 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707f30b-dd06-4990-b9c2-e55baa9bd127 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:05.328536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 436/867] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:50:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:50:05.334237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82077dab-a09f-46a7-9614-2a3e87ef71a9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:05.344180 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 432/868] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Apr 6 10:50:05 2022] POST /identity/v3/services => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:50:05.452576 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82077dab-a09f-46a7-9614-2a3e87ef71a9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:05.501144 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926bed2-339b-4949-b3ba-223db35cf97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:05.502364 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926bed2-339b-4949-b3ba-223db35cf97c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:05.502809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926bed2-339b-4949-b3ba-223db35cf97c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:05.503310 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926bed2-339b-4949-b3ba-223db35cf97c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:05.516431 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926bed2-339b-4949-b3ba-223db35cf97c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:05.517957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926bed2-339b-4949-b3ba-223db35cf97c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:05.536442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-5926bed2-339b-4949-b3ba-223db35cf97c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:05.538085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 437/869] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:05.543547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707f30b-dd06-4990-b9c2-e55baa9bd127 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:05.646679 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707f30b-dd06-4990-b9c2-e55baa9bd127 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:05.688894 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94c08d-12a8-42a3-874b-8b845fec08bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:05.689604 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94c08d-12a8-42a3-874b-8b845fec08bb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:05.689882 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94c08d-12a8-42a3-874b-8b845fec08bb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:05.690154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94c08d-12a8-42a3-874b-8b845fec08bb None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:05.690876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94c08d-12a8-42a3-874b-8b845fec08bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:05.691181 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94c08d-12a8-42a3-874b-8b845fec08bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:05.692604 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94c08d-12a8-42a3-874b-8b845fec08bb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:05.705951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 433/870] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:05.711038 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926bed2-339b-4949-b3ba-223db35cf97c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:05.813537 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926bed2-339b-4949-b3ba-223db35cf97c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:05.851910 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d63dea-0423-4478-9ab8-85eb7e9ef948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:05.852710 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d63dea-0423-4478-9ab8-85eb7e9ef948 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:05.852996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d63dea-0423-4478-9ab8-85eb7e9ef948 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:05.853300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d63dea-0423-4478-9ab8-85eb7e9ef948 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:05.860138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d63dea-0423-4478-9ab8-85eb7e9ef948 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:05.861611 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d63dea-0423-4478-9ab8-85eb7e9ef948 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:05.875217 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-48d63dea-0423-4478-9ab8-85eb7e9ef948 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:50:05.876717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 438/871] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:50:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:05.882339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94c08d-12a8-42a3-874b-8b845fec08bb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:05.882739 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123b767-fe61-4658-81d9-ecdc9fbd5a99 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:05.883034 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123b767-fe61-4658-81d9-ecdc9fbd5a99 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:05.883307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123b767-fe61-4658-81d9-ecdc9fbd5a99 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:05.884816 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 439/872] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:05.890128 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c9c39-0084-4d18-a41c-534f5b34d0ee None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:05.890419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c9c39-0084-4d18-a41c-534f5b34d0ee None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:05.890693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c9c39-0084-4d18-a41c-534f5b34d0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:05.907234 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a68c9c39-0084-4d18-a41c-534f5b34d0ee None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:05.908415 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a68c9c39-0084-4d18-a41c-534f5b34d0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:05.981154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 440/873] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:05 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:05.997924 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c9c39-0084-4d18-a41c-534f5b34d0ee None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:05.998475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94c08d-12a8-42a3-874b-8b845fec08bb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:06.032937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12197275-8966-4ed1-9369-4a38df6fc3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:06.033958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197275-8966-4ed1-9369-4a38df6fc3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:06.034451 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197275-8966-4ed1-9369-4a38df6fc3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:06.034924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197275-8966-4ed1-9369-4a38df6fc3c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:06.035946 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12197275-8966-4ed1-9369-4a38df6fc3c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:06.036534 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12197275-8966-4ed1-9369-4a38df6fc3c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:06.038772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12197275-8966-4ed1-9369-4a38df6fc3c5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:06.051042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 434/874] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:50:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:06.056430 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12197275-8966-4ed1-9369-4a38df6fc3c5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:06.112329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c9c39-0084-4d18-a41c-534f5b34d0ee None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:06.149800 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2923a-7689-424a-a929-c906f01639e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:06.150927 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2923a-7689-424a-a929-c906f01639e1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:06.151497 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2923a-7689-424a-a929-c906f01639e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:06.152042 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2923a-7689-424a-a929-c906f01639e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:06.152936 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2923a-7689-424a-a929-c906f01639e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:06.154583 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2923a-7689-424a-a929-c906f01639e1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:06.166739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12197275-8966-4ed1-9369-4a38df6fc3c5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:06.167140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-61d2923a-7689-424a-a929-c906f01639e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 10:50:06.177217 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 441/875] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Apr 6 10:50:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:06.180341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2923a-7689-424a-a929-c906f01639e1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:06.202733 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e1d24-1255-4a43-be0a-1a73227d56f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:06.203753 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e1d24-1255-4a43-be0a-1a73227d56f7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:06.204160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e1d24-1255-4a43-be0a-1a73227d56f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:06.204535 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e1d24-1255-4a43-be0a-1a73227d56f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:06.205510 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e1d24-1255-4a43-be0a-1a73227d56f7 None admin] RBAC: Adding query filter params (role.id=07e6d0f9bf5345c99ce158cd3e62c1c5, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=4daf4512881842a1bdf191e0d75139cd) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:06.205932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e1d24-1255-4a43-be0a-1a73227d56f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:06.207500 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e1d24-1255-4a43-be0a-1a73227d56f7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:06.213716 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 435/876] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:50:06 2022] GET /identity/v3/role_assignments?user.id=4daf4512881842a1bdf191e0d75139cd&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:06.300518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2923a-7689-424a-a929-c906f01639e1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:06.344743 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506c61b-f599-4a8c-b5d4-ac371a04fc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:06.345464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506c61b-f599-4a8c-b5d4-ac371a04fc88 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:06.345747 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506c61b-f599-4a8c-b5d4-ac371a04fc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:06.346023 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506c61b-f599-4a8c-b5d4-ac371a04fc88 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:06.346741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506c61b-f599-4a8c-b5d4-ac371a04fc88 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:06.347046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506c61b-f599-4a8c-b5d4-ac371a04fc88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:06.348429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506c61b-f599-4a8c-b5d4-ac371a04fc88 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:06.354298 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 442/877] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Apr 6 10:50:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:06.359702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e1d24-1255-4a43-be0a-1a73227d56f7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:06.471599 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e1d24-1255-4a43-be0a-1a73227d56f7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:06.511292 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcb3b3-6c7a-40aa-935b-2ffd6e490643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:06.512061 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcb3b3-6c7a-40aa-935b-2ffd6e490643 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:06.512345 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcb3b3-6c7a-40aa-935b-2ffd6e490643 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:06.512622 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcb3b3-6c7a-40aa-935b-2ffd6e490643 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:06.513444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcb3b3-6c7a-40aa-935b-2ffd6e490643 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:06.513754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcb3b3-6c7a-40aa-935b-2ffd6e490643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:06.515237 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcb3b3-6c7a-40aa-935b-2ffd6e490643 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:06.521126 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 436/878] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Apr 6 10:50:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:06.894850 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69342c7-4e43-4ea3-b0e4-2583665399c7 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:06.895399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69342c7-4e43-4ea3-b0e4-2583665399c7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:06.895399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69342c7-4e43-4ea3-b0e4-2583665399c7 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:06.897615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 443/879] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:06.902768 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2cb26-318f-4b1e-9659-702202b164d6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:06.903024 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2cb26-318f-4b1e-9659-702202b164d6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:06.903302 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2cb26-318f-4b1e-9659-702202b164d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:06.920461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b9d2cb26-318f-4b1e-9659-702202b164d6 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:06.921695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b9d2cb26-318f-4b1e-9659-702202b164d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:06.988117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 437/880] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:06 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:07.011332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69342c7-4e43-4ea3-b0e4-2583665399c7 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:07.112135 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69342c7-4e43-4ea3-b0e4-2583665399c7 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:07.151626 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97411a-9fe3-4618-ba78-f06c91fdb130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:07.152280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97411a-9fe3-4618-ba78-f06c91fdb130 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:07.152573 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97411a-9fe3-4618-ba78-f06c91fdb130 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:07.152850 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97411a-9fe3-4618-ba78-f06c91fdb130 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:07.153629 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97411a-9fe3-4618-ba78-f06c91fdb130 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:07.155056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97411a-9fe3-4618-ba78-f06c91fdb130 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:07.259684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 444/881] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Apr 6 10:50:07 2022] POST /identity/v3/services => generated 269 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:50:07.887370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc099b-e19b-42b6-95ae-36f54b6600b9 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:07.887370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc099b-e19b-42b6-95ae-36f54b6600b9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:07.887370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc099b-e19b-42b6-95ae-36f54b6600b9 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:07.888386 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 438/882] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:07.894951 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa685c32-4af6-4ea4-b5eb-9b10d81a195e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:07.895740 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa685c32-4af6-4ea4-b5eb-9b10d81a195e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:07.896407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa685c32-4af6-4ea4-b5eb-9b10d81a195e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:07.915954 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-aa685c32-4af6-4ea4-b5eb-9b10d81a195e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:07.917268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-aa685c32-4af6-4ea4-b5eb-9b10d81a195e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:08.001069 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 445/883] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:08.030015 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc099b-e19b-42b6-95ae-36f54b6600b9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:08.148007 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc099b-e19b-42b6-95ae-36f54b6600b9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:08.188731 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c44cb-a713-4a52-8fc7-2e79ff0271f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:08.189937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c44cb-a713-4a52-8fc7-2e79ff0271f6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:08.190416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c44cb-a713-4a52-8fc7-2e79ff0271f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:08.190883 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c44cb-a713-4a52-8fc7-2e79ff0271f6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:08.191748 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c44cb-a713-4a52-8fc7-2e79ff0271f6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:08.194132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c44cb-a713-4a52-8fc7-2e79ff0271f6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:08.207847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-229c44cb-a713-4a52-8fc7-2e79ff0271f6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 06 10:50:08.215373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 439/884] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:50:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:08.217236 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa685c32-4af6-4ea4-b5eb-9b10d81a195e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:08.332104 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa685c32-4af6-4ea4-b5eb-9b10d81a195e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:08.366936 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50e924-a3db-4aa4-8ec6-36d14bb70822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:08.367616 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e924-a3db-4aa4-8ec6-36d14bb70822 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:08.367898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e924-a3db-4aa4-8ec6-36d14bb70822 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:08.368170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e924-a3db-4aa4-8ec6-36d14bb70822 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:08.368883 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50e924-a3db-4aa4-8ec6-36d14bb70822 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:08.369222 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50e924-a3db-4aa4-8ec6-36d14bb70822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:08.370596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50e924-a3db-4aa4-8ec6-36d14bb70822 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:08.375805 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 446/885] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:50:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:08.382392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c44cb-a713-4a52-8fc7-2e79ff0271f6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:08.510456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c44cb-a713-4a52-8fc7-2e79ff0271f6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:08.550244 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c5670-748d-4ea5-9dc8-b1845860d277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:08.551282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c5670-748d-4ea5-9dc8-b1845860d277 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:08.551759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c5670-748d-4ea5-9dc8-b1845860d277 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:08.552376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c5670-748d-4ea5-9dc8-b1845860d277 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:08.554524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c5670-748d-4ea5-9dc8-b1845860d277 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:08.555291 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c5670-748d-4ea5-9dc8-b1845860d277 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:08.557482 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c5670-748d-4ea5-9dc8-b1845860d277 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:08.569236 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 440/886] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:50:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:08.571177 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50e924-a3db-4aa4-8ec6-36d14bb70822 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:08.682019 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50e924-a3db-4aa4-8ec6-36d14bb70822 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:08.717505 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ba74e-fc5f-4cc4-ab4a-5d0b38f35636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:08.718212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ba74e-fc5f-4cc4-ab4a-5d0b38f35636 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:08.718496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ba74e-fc5f-4cc4-ab4a-5d0b38f35636 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:08.718764 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ba74e-fc5f-4cc4-ab4a-5d0b38f35636 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:08.719556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ba74e-fc5f-4cc4-ab4a-5d0b38f35636 None admin] RBAC: Adding query filter params (interface=public, service_id=eb56eb9515974e3e887548035c49eac1, region_id=RegionOne) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:08.719866 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ba74e-fc5f-4cc4-ab4a-5d0b38f35636 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:08.721317 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ba74e-fc5f-4cc4-ab4a-5d0b38f35636 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:08.729188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 447/887] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Apr 6 10:50:08 2022] GET /identity/v3/endpoints?service_id=eb56eb9515974e3e887548035c49eac1&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:08.734433 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c5670-748d-4ea5-9dc8-b1845860d277 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:08.812302 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582ca5e-d5b1-42c1-9d5c-808e02566c2a None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:08.812983 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582ca5e-d5b1-42c1-9d5c-808e02566c2a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:08.813534 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582ca5e-d5b1-42c1-9d5c-808e02566c2a None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:08.815369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 448/888] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:08.820962 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d50ce-3330-40f2-a045-584f5ac94f94 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:08.821553 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d50ce-3330-40f2-a045-584f5ac94f94 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:08.822040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d50ce-3330-40f2-a045-584f5ac94f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:08.839782 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-300d50ce-3330-40f2-a045-584f5ac94f94 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:08.841210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c5670-748d-4ea5-9dc8-b1845860d277 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:08.841622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-300d50ce-3330-40f2-a045-584f5ac94f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:08.877044 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1019cd4-0f2c-4eca-8ba9-c375e12daa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:08.878121 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019cd4-0f2c-4eca-8ba9-c375e12daa00 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:08.878611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019cd4-0f2c-4eca-8ba9-c375e12daa00 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:08.879250 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019cd4-0f2c-4eca-8ba9-c375e12daa00 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:08.881810 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1019cd4-0f2c-4eca-8ba9-c375e12daa00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:08.883263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1019cd4-0f2c-4eca-8ba9-c375e12daa00 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:08.889099 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 441/889] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Apr 6 10:50:08 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:50:08.890462 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78f37f-9648-488e-995b-f6f72a0e0bde None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:08.890753 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78f37f-9648-488e-995b-f6f72a0e0bde None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:08.891026 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78f37f-9648-488e-995b-f6f72a0e0bde None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:08.892447 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 442/890] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:08.898638 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d3523-5000-4f99-964e-0d2e71a45218 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:08.898957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d3523-5000-4f99-964e-0d2e71a45218 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:08.899193 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d3523-5000-4f99-964e-0d2e71a45218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:08.916293 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-430d3523-5000-4f99-964e-0d2e71a45218 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:08.917605 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-430d3523-5000-4f99-964e-0d2e71a45218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:08.922764 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 449/891] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:08.948290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d50ce-3330-40f2-a045-584f5ac94f94 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:09.009676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 443/892] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:09.030340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d3523-5000-4f99-964e-0d2e71a45218 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:09.065043 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d50ce-3330-40f2-a045-584f5ac94f94 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:09.109676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206663c-ee02-44b6-8a13-28e45a30ddb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:09.110503 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206663c-ee02-44b6-8a13-28e45a30ddb8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:09.110881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206663c-ee02-44b6-8a13-28e45a30ddb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:09.111067 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206663c-ee02-44b6-8a13-28e45a30ddb8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:09.122872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206663c-ee02-44b6-8a13-28e45a30ddb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:50:09.130476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-5206663c-ee02-44b6-8a13-28e45a30ddb8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 10:50:09.132657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 450/893] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Apr 6 10:50:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:09.138601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206663c-ee02-44b6-8a13-28e45a30ddb8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:09.139002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d3523-5000-4f99-964e-0d2e71a45218 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:09.181286 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fabbf-a4b0-4e0a-b7a5-b300ac9a2d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:09.182722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fabbf-a4b0-4e0a-b7a5-b300ac9a2d0a None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:09.183220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fabbf-a4b0-4e0a-b7a5-b300ac9a2d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:09.183997 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fabbf-a4b0-4e0a-b7a5-b300ac9a2d0a None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:09.185305 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fabbf-a4b0-4e0a-b7a5-b300ac9a2d0a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:09.187765 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fabbf-a4b0-4e0a-b7a5-b300ac9a2d0a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:09.238693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206663c-ee02-44b6-8a13-28e45a30ddb8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:09.269327 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 444/894] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Apr 6 10:50:09 2022] POST /identity/v3/services => generated 241 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:50:09.281922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d880f5-a61f-459f-8421-ee1ec83f6cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:09.283514 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d880f5-a61f-459f-8421-ee1ec83f6cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:09.283514 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d880f5-a61f-459f-8421-ee1ec83f6cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:09.283514 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d880f5-a61f-459f-8421-ee1ec83f6cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:09.284017 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d880f5-a61f-459f-8421-ee1ec83f6cf0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:09.284368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d880f5-a61f-459f-8421-ee1ec83f6cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:09.285865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d880f5-a61f-459f-8421-ee1ec83f6cf0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:09.297027 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 451/895] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Apr 6 10:50:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:09.302819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fabbf-a4b0-4e0a-b7a5-b300ac9a2d0a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:09.412977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fabbf-a4b0-4e0a-b7a5-b300ac9a2d0a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:09.449867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80027fc3-4372-4e58-b007-f6acb9c43fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:09.450973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027fc3-4372-4e58-b007-f6acb9c43fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:09.451413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027fc3-4372-4e58-b007-f6acb9c43fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:09.451828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027fc3-4372-4e58-b007-f6acb9c43fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:09.464157 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80027fc3-4372-4e58-b007-f6acb9c43fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:09.465914 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80027fc3-4372-4e58-b007-f6acb9c43fa9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:09.484339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-80027fc3-4372-4e58-b007-f6acb9c43fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:09.486111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 445/896] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:09.492371 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d880f5-a61f-459f-8421-ee1ec83f6cf0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:09.593786 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d880f5-a61f-459f-8421-ee1ec83f6cf0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:09.627996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80e254-79f8-4ff2-9b94-f6f60943e442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:09.628674 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80e254-79f8-4ff2-9b94-f6f60943e442 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:09.628957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80e254-79f8-4ff2-9b94-f6f60943e442 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:09.629261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80e254-79f8-4ff2-9b94-f6f60943e442 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:09.629988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80e254-79f8-4ff2-9b94-f6f60943e442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:09.630292 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80e254-79f8-4ff2-9b94-f6f60943e442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:09.631690 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80e254-79f8-4ff2-9b94-f6f60943e442 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:09.644064 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 452/897] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:09.649910 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80027fc3-4372-4e58-b007-f6acb9c43fa9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:09.664803 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6900d82-64e5-49b0-a8b2-073a7d834e9d None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:09.665119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6900d82-64e5-49b0-a8b2-073a7d834e9d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:09.665390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6900d82-64e5-49b0-a8b2-073a7d834e9d None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:09.667047 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 453/898] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:50:09.677169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995442d-46df-47ac-aa24-e88236232993 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:09.677612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995442d-46df-47ac-aa24-e88236232993 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:09.678598 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995442d-46df-47ac-aa24-e88236232993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:09.695214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c995442d-46df-47ac-aa24-e88236232993 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:09.696604 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c995442d-46df-47ac-aa24-e88236232993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:09.756999 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80027fc3-4372-4e58-b007-f6acb9c43fa9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:09.781397 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 454/899] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:09.795125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c92c6-4a5a-47a5-bacc-6fb1f82f54cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:09.796149 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c92c6-4a5a-47a5-bacc-6fb1f82f54cc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:09.796574 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c92c6-4a5a-47a5-bacc-6fb1f82f54cc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:09.797000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c92c6-4a5a-47a5-bacc-6fb1f82f54cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:09.803466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995442d-46df-47ac-aa24-e88236232993 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:09.807742 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c92c6-4a5a-47a5-bacc-6fb1f82f54cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:09.809268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c92c6-4a5a-47a5-bacc-6fb1f82f54cc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:09.827894 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-5d3c92c6-4a5a-47a5-bacc-6fb1f82f54cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 10:50:09.830054 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 446/900] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Apr 6 10:50:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:09.836140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c92c6-4a5a-47a5-bacc-6fb1f82f54cc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:09.915737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995442d-46df-47ac-aa24-e88236232993 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:09.949555 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229acb94-9c31-47a1-8e53-f5d9436186ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:09.951132 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229acb94-9c31-47a1-8e53-f5d9436186ed None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:09.951607 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229acb94-9c31-47a1-8e53-f5d9436186ed None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:09.952055 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229acb94-9c31-47a1-8e53-f5d9436186ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:09.952888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229acb94-9c31-47a1-8e53-f5d9436186ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:09.954476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229acb94-9c31-47a1-8e53-f5d9436186ed None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:09.963644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c92c6-4a5a-47a5-bacc-6fb1f82f54cc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:09.967617 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-229acb94-9c31-47a1-8e53-f5d9436186ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 06 10:50:09.973376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 455/901] 10.222.0.62 () {56 vars in 1132 bytes} [Wed Apr 6 10:50:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:09.975807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229acb94-9c31-47a1-8e53-f5d9436186ed None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:10.005029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269b495-844b-4512-b426-9a5d3cbf1aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:10.005739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269b495-844b-4512-b426-9a5d3cbf1aad None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:10.006248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269b495-844b-4512-b426-9a5d3cbf1aad None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:10.006549 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269b495-844b-4512-b426-9a5d3cbf1aad None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:10.007788 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269b495-844b-4512-b426-9a5d3cbf1aad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:10.008099 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269b495-844b-4512-b426-9a5d3cbf1aad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:10.010167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269b495-844b-4512-b426-9a5d3cbf1aad None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:10.037172 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 447/902] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Apr 6 10:50:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:10.039184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269b495-844b-4512-b426-9a5d3cbf1aad None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:10.089085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229acb94-9c31-47a1-8e53-f5d9436186ed None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:10.124859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bbd96-1435-49aa-adb9-a2505bc1f003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:10.125373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bbd96-1435-49aa-adb9-a2505bc1f003 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:10.125655 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bbd96-1435-49aa-adb9-a2505bc1f003 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:10.125930 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bbd96-1435-49aa-adb9-a2505bc1f003 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:10.126638 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bbd96-1435-49aa-adb9-a2505bc1f003 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:10.126946 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bbd96-1435-49aa-adb9-a2505bc1f003 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:10.128315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bbd96-1435-49aa-adb9-a2505bc1f003 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:10.139441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 456/903] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Apr 6 10:50:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:10.140314 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bbd96-1435-49aa-adb9-a2505bc1f003 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:10.167077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269b495-844b-4512-b426-9a5d3cbf1aad None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:10.211050 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44896139-a5f9-4cf3-a0ba-c83fb4717097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:10.212154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44896139-a5f9-4cf3-a0ba-c83fb4717097 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:10.212515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44896139-a5f9-4cf3-a0ba-c83fb4717097 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:10.212866 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44896139-a5f9-4cf3-a0ba-c83fb4717097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:10.257539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bbd96-1435-49aa-adb9-a2505bc1f003 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:10.299047 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44896139-a5f9-4cf3-a0ba-c83fb4717097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:10.299225 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7919414-4a0c-419f-b64a-831f56288a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:10.299875 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7919414-4a0c-419f-b64a-831f56288a4a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:10.300223 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7919414-4a0c-419f-b64a-831f56288a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:10.300562 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7919414-4a0c-419f-b64a-831f56288a4a None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:10.301390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7919414-4a0c-419f-b64a-831f56288a4a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:10.301759 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7919414-4a0c-419f-b64a-831f56288a4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:10.302075 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44896139-a5f9-4cf3-a0ba-c83fb4717097 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:10.303787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7919414-4a0c-419f-b64a-831f56288a4a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:10.314324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 457/904] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Apr 6 10:50:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:10.315796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7919414-4a0c-419f-b64a-831f56288a4a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:10.410777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 448/905] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:50:10 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 06 10:50:10.411852 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44896139-a5f9-4cf3-a0ba-c83fb4717097 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:10.426960 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7919414-4a0c-419f-b64a-831f56288a4a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:10.461523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7815a4-ba85-4227-aa3f-b5378b8c2607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:10.462447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7815a4-ba85-4227-aa3f-b5378b8c2607 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:10.462879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7815a4-ba85-4227-aa3f-b5378b8c2607 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:10.463300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7815a4-ba85-4227-aa3f-b5378b8c2607 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:10.464232 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7815a4-ba85-4227-aa3f-b5378b8c2607 None admin] RBAC: Adding query filter params (interface=public, service_id=71b74b2b5f504647a9e0b9cd5606ed87, region_id=RegionOne) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:10.464782 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7815a4-ba85-4227-aa3f-b5378b8c2607 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:10.466329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7815a4-ba85-4227-aa3f-b5378b8c2607 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:10.476777 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 458/906] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Apr 6 10:50:10 2022] GET /identity/v3/endpoints?service_id=71b74b2b5f504647a9e0b9cd5606ed87&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:10.477934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7815a4-ba85-4227-aa3f-b5378b8c2607 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:10.512757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44896139-a5f9-4cf3-a0ba-c83fb4717097 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:10.549982 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03753800-5152-4569-aeeb-0e90740fbc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:10.550818 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03753800-5152-4569-aeeb-0e90740fbc50 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:10.551132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03753800-5152-4569-aeeb-0e90740fbc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:10.551483 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03753800-5152-4569-aeeb-0e90740fbc50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:10.562426 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03753800-5152-4569-aeeb-0e90740fbc50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:10.564312 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03753800-5152-4569-aeeb-0e90740fbc50 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:10.583339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-03753800-5152-4569-aeeb-0e90740fbc50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:10.584820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7815a4-ba85-4227-aa3f-b5378b8c2607 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:10.585807 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 449/907] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:10.591322 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03753800-5152-4569-aeeb-0e90740fbc50 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:10.620681 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689e371-10d0-4b5c-ba89-0cabec853b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:10.621568 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e371-10d0-4b5c-ba89-0cabec853b62 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:10.621954 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e371-10d0-4b5c-ba89-0cabec853b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:10.622365 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e371-10d0-4b5c-ba89-0cabec853b62 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:10.623175 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689e371-10d0-4b5c-ba89-0cabec853b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:10.624651 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689e371-10d0-4b5c-ba89-0cabec853b62 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:10.631540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 459/908] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Apr 6 10:50:10 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:50:10.700815 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03753800-5152-4569-aeeb-0e90740fbc50 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:10.737594 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e1f85-b1e5-4473-a0cd-4958eca786ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:10.738272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e1f85-b1e5-4473-a0cd-4958eca786ff None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:10.738552 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e1f85-b1e5-4473-a0cd-4958eca786ff None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:10.738826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e1f85-b1e5-4473-a0cd-4958eca786ff None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:10.739553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e1f85-b1e5-4473-a0cd-4958eca786ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:10.739859 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e1f85-b1e5-4473-a0cd-4958eca786ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:10.741836 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e1f85-b1e5-4473-a0cd-4958eca786ff None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:10.754705 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 450/909] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:10.762189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689e371-10d0-4b5c-ba89-0cabec853b62 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:10.871074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689e371-10d0-4b5c-ba89-0cabec853b62 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:10.906518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb3986-3ecb-4a84-b4f3-bfb95bc5c455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:10.907628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3986-3ecb-4a84-b4f3-bfb95bc5c455 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:10.908089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3986-3ecb-4a84-b4f3-bfb95bc5c455 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:10.908542 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3986-3ecb-4a84-b4f3-bfb95bc5c455 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:10.916071 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb3986-3ecb-4a84-b4f3-bfb95bc5c455 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:10.917790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb3986-3ecb-4a84-b4f3-bfb95bc5c455 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:10.934358 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-6cbb3986-3ecb-4a84-b4f3-bfb95bc5c455 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:50:10.936288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 460/910] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:10.942703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e1f85-b1e5-4473-a0cd-4958eca786ff None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:11.045042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e1f85-b1e5-4473-a0cd-4958eca786ff None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:11.079846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d863388-a51d-40f2-a0f1-ff397c58afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:11.080844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d863388-a51d-40f2-a0f1-ff397c58afcf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:11.081332 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d863388-a51d-40f2-a0f1-ff397c58afcf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:11.081800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d863388-a51d-40f2-a0f1-ff397c58afcf None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:11.082754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d863388-a51d-40f2-a0f1-ff397c58afcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:11.083256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d863388-a51d-40f2-a0f1-ff397c58afcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:11.084934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d863388-a51d-40f2-a0f1-ff397c58afcf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:11.097760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 451/911] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:11.104402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb3986-3ecb-4a84-b4f3-bfb95bc5c455 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:11.202578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb3986-3ecb-4a84-b4f3-bfb95bc5c455 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:11.239400 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1936387-92bc-40fb-8a40-8b692e932854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:11.240056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1936387-92bc-40fb-8a40-8b692e932854 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:11.240448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1936387-92bc-40fb-8a40-8b692e932854 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:11.241333 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1936387-92bc-40fb-8a40-8b692e932854 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:11.242159 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1936387-92bc-40fb-8a40-8b692e932854 None admin] RBAC: Adding query filter params (role.id=2a2949c54fe047d5970c08741cf8fffe, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=4daf4512881842a1bdf191e0d75139cd) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:11.242468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1936387-92bc-40fb-8a40-8b692e932854 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:11.243876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1936387-92bc-40fb-8a40-8b692e932854 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:11.249868 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 461/912] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:50:11 2022] GET /identity/v3/role_assignments?user.id=4daf4512881842a1bdf191e0d75139cd&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=2a2949c54fe047d5970c08741cf8fffe => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:11.311264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d9385-284f-4f4a-a060-680de292c9c0 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:11.313588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d9385-284f-4f4a-a060-680de292c9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:11.313588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d9385-284f-4f4a-a060-680de292c9c0 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:11.314091 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 452/913] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:11.320560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5db08-734a-4922-acdd-8dd7c62f65cc None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:11.321139 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5db08-734a-4922-acdd-8dd7c62f65cc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:11.321588 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5db08-734a-4922-acdd-8dd7c62f65cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:11.339900 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-cbd5db08-734a-4922-acdd-8dd7c62f65cc None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:11.341463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-cbd5db08-734a-4922-acdd-8dd7c62f65cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:11.424510 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 462/914] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:11.450124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d9385-284f-4f4a-a060-680de292c9c0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:11.565014 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d9385-284f-4f4a-a060-680de292c9c0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:11.601688 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313060a-b255-40bb-bb87-7ca1bb1d05d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:11.602496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313060a-b255-40bb-bb87-7ca1bb1d05d0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:11.602775 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313060a-b255-40bb-bb87-7ca1bb1d05d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:11.603050 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313060a-b255-40bb-bb87-7ca1bb1d05d0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:11.603704 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313060a-b255-40bb-bb87-7ca1bb1d05d0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:11.605208 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313060a-b255-40bb-bb87-7ca1bb1d05d0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:11.618322 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-2313060a-b255-40bb-bb87-7ca1bb1d05d0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 06 10:50:11.619952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 453/915] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:50:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:11.625876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5db08-734a-4922-acdd-8dd7c62f65cc None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:11.736933 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5db08-734a-4922-acdd-8dd7c62f65cc None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:11.737638 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128640-6a51-457d-abfb-b92b998d9308 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:11.738167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128640-6a51-457d-abfb-b92b998d9308 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:11.738661 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128640-6a51-457d-abfb-b92b998d9308 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:11.741035 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 454/916] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:50:11.745650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe33f-e7c6-4f62-b0f5-56a9d19cb892 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:11.746325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe33f-e7c6-4f62-b0f5-56a9d19cb892 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:11.746824 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe33f-e7c6-4f62-b0f5-56a9d19cb892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:11.766933 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-bd3fe33f-e7c6-4f62-b0f5-56a9d19cb892 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:11.768754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-bd3fe33f-e7c6-4f62-b0f5-56a9d19cb892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:11.771530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e67d6-989d-454e-9f8b-735b7a07f1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:11.772252 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e67d6-989d-454e-9f8b-735b7a07f1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:11.772544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e67d6-989d-454e-9f8b-735b7a07f1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:11.772809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e67d6-989d-454e-9f8b-735b7a07f1a9 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:11.773584 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e67d6-989d-454e-9f8b-735b7a07f1a9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:11.773896 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e67d6-989d-454e-9f8b-735b7a07f1a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:11.775262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e67d6-989d-454e-9f8b-735b7a07f1a9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:11.780404 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 463/917] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:50:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:11.786536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e67d6-989d-454e-9f8b-735b7a07f1a9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:11.856143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 455/918] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:11.879945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fe33f-e7c6-4f62-b0f5-56a9d19cb892 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:11.910034 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e67d6-989d-454e-9f8b-735b7a07f1a9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:11.955255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103c6b9-5552-4343-bde3-b72a83e927c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:11.956602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103c6b9-5552-4343-bde3-b72a83e927c9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:11.957092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103c6b9-5552-4343-bde3-b72a83e927c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:11.957876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103c6b9-5552-4343-bde3-b72a83e927c9 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:11.958765 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103c6b9-5552-4343-bde3-b72a83e927c9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:11.960069 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103c6b9-5552-4343-bde3-b72a83e927c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:11.961926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103c6b9-5552-4343-bde3-b72a83e927c9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:11.973467 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 464/919] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Apr 6 10:50:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:11.974034 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103c6b9-5552-4343-bde3-b72a83e927c9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:11.986263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fe33f-e7c6-4f62-b0f5-56a9d19cb892 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:12.032777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00e49b-716f-462c-9736-631dbd20824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:12.034370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00e49b-716f-462c-9736-631dbd20824c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:12.035188 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00e49b-716f-462c-9736-631dbd20824c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:12.035699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00e49b-716f-462c-9736-631dbd20824c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:12.037076 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00e49b-716f-462c-9736-631dbd20824c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:12.039181 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00e49b-716f-462c-9736-631dbd20824c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:12.054630 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-ca00e49b-716f-462c-9736-631dbd20824c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 10:50:12.057454 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 456/920] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Apr 6 10:50:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:12.063142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00e49b-716f-462c-9736-631dbd20824c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:12.085938 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103c6b9-5552-4343-bde3-b72a83e927c9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:12.127527 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f74c09-d1a2-407c-96ea-62c21d0399f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:12.128252 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74c09-d1a2-407c-96ea-62c21d0399f0 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:12.128435 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74c09-d1a2-407c-96ea-62c21d0399f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:12.128753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74c09-d1a2-407c-96ea-62c21d0399f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:12.129716 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f74c09-d1a2-407c-96ea-62c21d0399f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:12.131966 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f74c09-d1a2-407c-96ea-62c21d0399f0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:12.181373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00e49b-716f-462c-9736-631dbd20824c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:12.217496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 465/921] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Apr 6 10:50:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:50:12.227414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f13ea-8996-4358-a533-5efb7d866f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:12.228597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f13ea-8996-4358-a533-5efb7d866f3f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:12.229315 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f13ea-8996-4358-a533-5efb7d866f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:12.237554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f13ea-8996-4358-a533-5efb7d866f3f None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:12.237554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f13ea-8996-4358-a533-5efb7d866f3f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:12.237554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f13ea-8996-4358-a533-5efb7d866f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:12.237554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f13ea-8996-4358-a533-5efb7d866f3f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:12.239412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 457/922] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Apr 6 10:50:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:12.245458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f74c09-d1a2-407c-96ea-62c21d0399f0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:12.360268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f74c09-d1a2-407c-96ea-62c21d0399f0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:12.398196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac29aa-d9cd-44a8-b079-1d12cf5169b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:12.399283 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac29aa-d9cd-44a8-b079-1d12cf5169b2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:12.399769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac29aa-d9cd-44a8-b079-1d12cf5169b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:12.400243 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac29aa-d9cd-44a8-b079-1d12cf5169b2 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:12.401186 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac29aa-d9cd-44a8-b079-1d12cf5169b2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:12.401698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac29aa-d9cd-44a8-b079-1d12cf5169b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:12.403307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac29aa-d9cd-44a8-b079-1d12cf5169b2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:12.409161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 466/923] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Apr 6 10:50:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:12.415773 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f13ea-8996-4358-a533-5efb7d866f3f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:12.520220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f13ea-8996-4358-a533-5efb7d866f3f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:12.552996 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecf983-2855-4bad-af9d-1e55bcdf6218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:12.553714 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecf983-2855-4bad-af9d-1e55bcdf6218 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:12.553987 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecf983-2855-4bad-af9d-1e55bcdf6218 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:12.554299 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecf983-2855-4bad-af9d-1e55bcdf6218 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:12.555079 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecf983-2855-4bad-af9d-1e55bcdf6218 None admin] RBAC: Adding query filter params (interface=public, service_id=32af57379ffd4ce7b995f4f19ee81745, region_id=RegionOne) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:12.555387 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecf983-2855-4bad-af9d-1e55bcdf6218 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:12.556783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecf983-2855-4bad-af9d-1e55bcdf6218 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:12.562335 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 458/924] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Apr 6 10:50:12 2022] GET /identity/v3/endpoints?service_id=32af57379ffd4ce7b995f4f19ee81745&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:12.568118 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac29aa-d9cd-44a8-b079-1d12cf5169b2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:12.685096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac29aa-d9cd-44a8-b079-1d12cf5169b2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:12.722081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4521f4c-121d-4e1a-999a-91101e4a4722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:12.723127 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521f4c-121d-4e1a-999a-91101e4a4722 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:12.723614 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521f4c-121d-4e1a-999a-91101e4a4722 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:12.724092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521f4c-121d-4e1a-999a-91101e4a4722 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:12.725011 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4521f4c-121d-4e1a-999a-91101e4a4722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:12.726652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4521f4c-121d-4e1a-999a-91101e4a4722 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:12.733999 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 467/925] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Apr 6 10:50:12 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:50:13.121106 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408fb25-f165-46dc-ace8-417dc0960e49 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:13.121613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408fb25-f165-46dc-ace8-417dc0960e49 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:13.121712 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408fb25-f165-46dc-ace8-417dc0960e49 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:13.123249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 459/926] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:13.128625 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c3e8-718f-487c-a751-9f09710103fd None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:13.129087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c3e8-718f-487c-a751-9f09710103fd None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:13.129267 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c3e8-718f-487c-a751-9f09710103fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:13.147556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e734c3e8-718f-487c-a751-9f09710103fd None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:13.149097 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e734c3e8-718f-487c-a751-9f09710103fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:13.216642 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 468/927] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:13.241149 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408fb25-f165-46dc-ace8-417dc0960e49 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:13.346654 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408fb25-f165-46dc-ace8-417dc0960e49 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:13.379508 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5eb3a-1150-40c1-bf9a-601228b0afa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:13.380661 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5eb3a-1150-40c1-bf9a-601228b0afa9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:13.381686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5eb3a-1150-40c1-bf9a-601228b0afa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:13.382164 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5eb3a-1150-40c1-bf9a-601228b0afa9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:13.383018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5eb3a-1150-40c1-bf9a-601228b0afa9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:13.384624 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5eb3a-1150-40c1-bf9a-601228b0afa9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:13.396745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-b1f5eb3a-1150-40c1-bf9a-601228b0afa9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 06 10:50:13.398590 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 460/928] 10.222.0.62 () {56 vars in 1132 bytes} [Wed Apr 6 10:50:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:13.406162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734c3e8-718f-487c-a751-9f09710103fd None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:13.507766 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734c3e8-718f-487c-a751-9f09710103fd None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:13.542020 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f3809-3e39-4ce4-bb02-ca8b83826f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:13.543090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f3809-3e39-4ce4-bb02-ca8b83826f7a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:13.543580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f3809-3e39-4ce4-bb02-ca8b83826f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:13.544068 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f3809-3e39-4ce4-bb02-ca8b83826f7a None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:13.544980 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f3809-3e39-4ce4-bb02-ca8b83826f7a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:13.545515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f3809-3e39-4ce4-bb02-ca8b83826f7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:13.547114 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f3809-3e39-4ce4-bb02-ca8b83826f7a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:13.556536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 469/929] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Apr 6 10:50:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:13.562720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5eb3a-1150-40c1-bf9a-601228b0afa9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:13.662533 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5eb3a-1150-40c1-bf9a-601228b0afa9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:13.669694 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0e2c6-eb7f-4bd5-aab5-c378a5989d70 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:13.670238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0e2c6-eb7f-4bd5-aab5-c378a5989d70 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:13.670740 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0e2c6-eb7f-4bd5-aab5-c378a5989d70 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:13.676425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 470/930] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:13.679359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce43bc-27ea-44ab-98ee-0d9dc58b0bd7 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:13.679932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce43bc-27ea-44ab-98ee-0d9dc58b0bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:13.680470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce43bc-27ea-44ab-98ee-0d9dc58b0bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:13.696560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f0382-98d8-4fbd-a281-0922a357ac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:13.697248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f0382-98d8-4fbd-a281-0922a357ac22 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:13.697526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f0382-98d8-4fbd-a281-0922a357ac22 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:13.697798 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f0382-98d8-4fbd-a281-0922a357ac22 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:13.698489 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f0382-98d8-4fbd-a281-0922a357ac22 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:13.698790 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f0382-98d8-4fbd-a281-0922a357ac22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:13.700182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f0382-98d8-4fbd-a281-0922a357ac22 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:13.702449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c9ce43bc-27ea-44ab-98ee-0d9dc58b0bd7 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:13.704141 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c9ce43bc-27ea-44ab-98ee-0d9dc58b0bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:13.705275 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 461/931] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Apr 6 10:50:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:13.710695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f0382-98d8-4fbd-a281-0922a357ac22 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:13.779921 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 471/932] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:13.798154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce43bc-27ea-44ab-98ee-0d9dc58b0bd7 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:13.809960 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f0382-98d8-4fbd-a281-0922a357ac22 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:13.844679 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84712015-08ec-409c-8627-ab014f7bfa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:13.845462 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84712015-08ec-409c-8627-ab014f7bfa72 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:13.845684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84712015-08ec-409c-8627-ab014f7bfa72 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:13.845916 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84712015-08ec-409c-8627-ab014f7bfa72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:13.846657 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84712015-08ec-409c-8627-ab014f7bfa72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:13.848053 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84712015-08ec-409c-8627-ab014f7bfa72 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:13.908511 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce43bc-27ea-44ab-98ee-0d9dc58b0bd7 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:13.929169 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 462/933] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Apr 6 10:50:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:50:13.958586 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c3694-be23-447d-b59d-9a5515b892f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:13.959688 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c3694-be23-447d-b59d-9a5515b892f4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:13.959964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c3694-be23-447d-b59d-9a5515b892f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:13.960233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c3694-be23-447d-b59d-9a5515b892f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:13.972256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c3694-be23-447d-b59d-9a5515b892f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:50:13.980634 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-657c3694-be23-447d-b59d-9a5515b892f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 10:50:13.982270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 472/934] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Apr 6 10:50:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:13.988060 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84712015-08ec-409c-8627-ab014f7bfa72 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:14.093999 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84712015-08ec-409c-8627-ab014f7bfa72 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:14.130009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b17fe9-8e81-4c06-aa00-c9b664e8c6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:14.130780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17fe9-8e81-4c06-aa00-c9b664e8c6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:14.131026 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17fe9-8e81-4c06-aa00-c9b664e8c6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:14.131280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17fe9-8e81-4c06-aa00-c9b664e8c6c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:14.132035 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b17fe9-8e81-4c06-aa00-c9b664e8c6c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:14.132344 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b17fe9-8e81-4c06-aa00-c9b664e8c6c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:14.133852 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b17fe9-8e81-4c06-aa00-c9b664e8c6c4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:14.146189 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 463/935] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Apr 6 10:50:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:14.151227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c3694-be23-447d-b59d-9a5515b892f4 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:14.254209 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c3694-be23-447d-b59d-9a5515b892f4 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:14.288534 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b3da3-2c36-420f-a918-d17c6e1c2df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:14.289374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b3da3-2c36-420f-a918-d17c6e1c2df8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:14.289655 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b3da3-2c36-420f-a918-d17c6e1c2df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:14.289928 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b3da3-2c36-420f-a918-d17c6e1c2df8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:14.301976 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b3da3-2c36-420f-a918-d17c6e1c2df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:14.303527 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b3da3-2c36-420f-a918-d17c6e1c2df8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:14.326480 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-418b3da3-2c36-420f-a918-d17c6e1c2df8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:14.329131 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 473/936] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:14.333905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b17fe9-8e81-4c06-aa00-c9b664e8c6c4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:14.435158 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b17fe9-8e81-4c06-aa00-c9b664e8c6c4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:14.469264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a5fbf-6c0f-4bc1-8d13-8718aa914be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:14.469937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5fbf-6c0f-4bc1-8d13-8718aa914be1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:14.470217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5fbf-6c0f-4bc1-8d13-8718aa914be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:14.470492 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5fbf-6c0f-4bc1-8d13-8718aa914be1 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:14.471213 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a5fbf-6c0f-4bc1-8d13-8718aa914be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:14.471516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a5fbf-6c0f-4bc1-8d13-8718aa914be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:14.472932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a5fbf-6c0f-4bc1-8d13-8718aa914be1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:14.489166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 464/937] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:14.491168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b3da3-2c36-420f-a918-d17c6e1c2df8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:14.600482 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b3da3-2c36-420f-a918-d17c6e1c2df8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:14.633902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58365e43-05ce-4614-a402-13ce146883f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:14.634726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58365e43-05ce-4614-a402-13ce146883f4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:14.635008 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58365e43-05ce-4614-a402-13ce146883f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:14.635284 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58365e43-05ce-4614-a402-13ce146883f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:14.643074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58365e43-05ce-4614-a402-13ce146883f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:14.644517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58365e43-05ce-4614-a402-13ce146883f4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:14.659148 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-58365e43-05ce-4614-a402-13ce146883f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 10:50:14.665158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 474/938] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Apr 6 10:50:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:14.666942 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a5fbf-6c0f-4bc1-8d13-8718aa914be1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:14.692809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfdb2a-fd87-4f1e-8d45-94bacdda71df None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:14.693116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfdb2a-fd87-4f1e-8d45-94bacdda71df None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:14.693911 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfdb2a-fd87-4f1e-8d45-94bacdda71df None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:14.695530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 475/939] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:14.700998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b94061-2541-47b9-8c71-222b2b4d62e7 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:14.701340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b94061-2541-47b9-8c71-222b2b4d62e7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:14.701582 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b94061-2541-47b9-8c71-222b2b4d62e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:14.720000 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e3b94061-2541-47b9-8c71-222b2b4d62e7 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:14.721245 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e3b94061-2541-47b9-8c71-222b2b4d62e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:14.785824 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a5fbf-6c0f-4bc1-8d13-8718aa914be1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:14.799532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 476/940] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:14.822689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7f2d6-4f06-455d-b58f-8c73aded511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:14.823371 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7f2d6-4f06-455d-b58f-8c73aded511b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:14.823647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7f2d6-4f06-455d-b58f-8c73aded511b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:14.824164 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7f2d6-4f06-455d-b58f-8c73aded511b None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:14.825103 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b94061-2541-47b9-8c71-222b2b4d62e7 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:14.825948 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7f2d6-4f06-455d-b58f-8c73aded511b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:14.826267 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7f2d6-4f06-455d-b58f-8c73aded511b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:14.827809 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7f2d6-4f06-455d-b58f-8c73aded511b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:14.845680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 465/941] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Apr 6 10:50:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:14.852041 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7f2d6-4f06-455d-b58f-8c73aded511b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:14.942804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b94061-2541-47b9-8c71-222b2b4d62e7 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:14.976524 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5bf59-bc74-423e-aeee-6f8cd2790e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:14.977265 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5bf59-bc74-423e-aeee-6f8cd2790e7c None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:14.977552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5bf59-bc74-423e-aeee-6f8cd2790e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:14.977825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5bf59-bc74-423e-aeee-6f8cd2790e7c None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:14.978531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5bf59-bc74-423e-aeee-6f8cd2790e7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:14.979955 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5bf59-bc74-423e-aeee-6f8cd2790e7c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:14.980957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7f2d6-4f06-455d-b58f-8c73aded511b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:14.981407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.common [None req-29a5bf59-bc74-423e-aeee-6f8cd2790e7c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 06 10:50:15.019438 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ed13a-e699-483a-8de5-f05e861e9cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:15.020229 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ed13a-e699-483a-8de5-f05e861e9cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:15.020512 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ed13a-e699-483a-8de5-f05e861e9cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:15.020793 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ed13a-e699-483a-8de5-f05e861e9cf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:15.031322 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ed13a-e699-483a-8de5-f05e861e9cf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:15.032844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ed13a-e699-483a-8de5-f05e861e9cf7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:15.035080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.sql.core [None req-29a5bf59-bc74-423e-aeee-6f8cd2790e7c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 06 10:50:15.035080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 06 10:50:15.035080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [parameters: {'id': '4532764a3be84f7cb07eab31eacbd2b1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 06 10:50:15.035080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80201) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 06 10:50:15.044082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-29a5bf59-bc74-423e-aeee-6f8cd2790e7c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4532764a3be84f7cb07eab31eacbd2b1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4532764a3be84f7cb07eab31eacbd2b1. Apr 06 10:50:15.045785 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 477/942] 10.222.0.62 () {60 vars in 1140 bytes} [Wed Apr 6 10:50:14 2022] POST /identity/v3/projects => generated 262 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:15.050557 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-b13ed13a-e699-483a-8de5-f05e861e9cf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:15.051238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5bf59-bc74-423e-aeee-6f8cd2790e7c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:15.056355 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 466/943] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:15.057730 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ed13a-e699-483a-8de5-f05e861e9cf7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:15.160485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5bf59-bc74-423e-aeee-6f8cd2790e7c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:15.170767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ed13a-e699-483a-8de5-f05e861e9cf7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:15.194147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f920c-ed16-485f-ba9b-b0ccbf67072d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:15.194970 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f920c-ed16-485f-ba9b-b0ccbf67072d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:15.195257 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f920c-ed16-485f-ba9b-b0ccbf67072d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:15.195530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f920c-ed16-485f-ba9b-b0ccbf67072d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:15.202782 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f920c-ed16-485f-ba9b-b0ccbf67072d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:15.204460 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f920c-ed16-485f-ba9b-b0ccbf67072d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:15.206199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1293c-f2e5-45ef-a841-684f5071aa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:15.206875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1293c-f2e5-45ef-a841-684f5071aa49 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:15.207155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1293c-f2e5-45ef-a841-684f5071aa49 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:15.207433 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1293c-f2e5-45ef-a841-684f5071aa49 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:15.208156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1293c-f2e5-45ef-a841-684f5071aa49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:15.208463 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1293c-f2e5-45ef-a841-684f5071aa49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:15.210423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1293c-f2e5-45ef-a841-684f5071aa49 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:15.220361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-c12f920c-ed16-485f-ba9b-b0ccbf67072d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:50:15.221564 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 467/944] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:15.222354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 478/945] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:50:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:15.222835 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a1176-6142-46e8-aa85-3633806a879d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:15.223123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a1176-6142-46e8-aa85-3633806a879d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:15.223402 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a1176-6142-46e8-aa85-3633806a879d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:15.225342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 468/946] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:15.230602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f920c-ed16-485f-ba9b-b0ccbf67072d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:15.232180 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd187a2-bbf4-4aff-9153-0e12188a821f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:15.232464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd187a2-bbf4-4aff-9153-0e12188a821f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:15.232740 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd187a2-bbf4-4aff-9153-0e12188a821f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:15.248895 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2fd187a2-bbf4-4aff-9153-0e12188a821f None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:15.250214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2fd187a2-bbf4-4aff-9153-0e12188a821f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:15.317310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 469/947] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:15.318153 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd187a2-bbf4-4aff-9153-0e12188a821f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:15.331235 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f920c-ed16-485f-ba9b-b0ccbf67072d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:15.365281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b718ee1-3f1b-4c80-b0b3-33875a4c9826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:15.366291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b718ee1-3f1b-4c80-b0b3-33875a4c9826 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:15.366802 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b718ee1-3f1b-4c80-b0b3-33875a4c9826 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:15.367274 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b718ee1-3f1b-4c80-b0b3-33875a4c9826 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:15.368028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b718ee1-3f1b-4c80-b0b3-33875a4c9826 None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:15.368334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b718ee1-3f1b-4c80-b0b3-33875a4c9826 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:15.369783 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b718ee1-3f1b-4c80-b0b3-33875a4c9826 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:15.389945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 479/948] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Apr 6 10:50:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:15.390670 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b718ee1-3f1b-4c80-b0b3-33875a4c9826 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:15.437515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd187a2-bbf4-4aff-9153-0e12188a821f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:15.474743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480252d-64ba-4f0e-ae62-bcecb0e4a5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:15.475965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480252d-64ba-4f0e-ae62-bcecb0e4a5cb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:15.476449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480252d-64ba-4f0e-ae62-bcecb0e4a5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:15.476945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480252d-64ba-4f0e-ae62-bcecb0e4a5cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:15.484636 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480252d-64ba-4f0e-ae62-bcecb0e4a5cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:15.486492 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480252d-64ba-4f0e-ae62-bcecb0e4a5cb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:15.504342 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b718ee1-3f1b-4c80-b0b3-33875a4c9826 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:15.507166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-7480252d-64ba-4f0e-ae62-bcecb0e4a5cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:50:15.509951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 470/949] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:50:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:15.515770 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480252d-64ba-4f0e-ae62-bcecb0e4a5cb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:15.545425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c5fc9-aa9a-4fc0-98d2-0ebbb225fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:15.546266 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c5fc9-aa9a-4fc0-98d2-0ebbb225fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:15.546551 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c5fc9-aa9a-4fc0-98d2-0ebbb225fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:15.546825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c5fc9-aa9a-4fc0-98d2-0ebbb225fbc1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:15.547493 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c5fc9-aa9a-4fc0-98d2-0ebbb225fbc1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:15.548892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c5fc9-aa9a-4fc0-98d2-0ebbb225fbc1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:15.561089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-0b1c5fc9-aa9a-4fc0-98d2-0ebbb225fbc1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 10:50:15.562959 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 480/950] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Apr 6 10:50:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:15.569480 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c5fc9-aa9a-4fc0-98d2-0ebbb225fbc1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:15.656315 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480252d-64ba-4f0e-ae62-bcecb0e4a5cb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:15.694038 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c5fc9-aa9a-4fc0-98d2-0ebbb225fbc1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:15.700098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ca62c-4956-4a4f-ba85-487f032dc6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:15.700765 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ca62c-4956-4a4f-ba85-487f032dc6fe None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:15.701043 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ca62c-4956-4a4f-ba85-487f032dc6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:15.701415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ca62c-4956-4a4f-ba85-487f032dc6fe None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:15.702356 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ca62c-4956-4a4f-ba85-487f032dc6fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:15.702669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ca62c-4956-4a4f-ba85-487f032dc6fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:15.704156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ca62c-4956-4a4f-ba85-487f032dc6fe None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:15.726195 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 471/951] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:50:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:15.732890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd100207-5b4a-4dbb-86b1-8f201c92fbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:15.733613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd100207-5b4a-4dbb-86b1-8f201c92fbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:15.733895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd100207-5b4a-4dbb-86b1-8f201c92fbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:15.734167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd100207-5b4a-4dbb-86b1-8f201c92fbb3 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:15.734874 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd100207-5b4a-4dbb-86b1-8f201c92fbb3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:15.735179 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd100207-5b4a-4dbb-86b1-8f201c92fbb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:15.736535 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd100207-5b4a-4dbb-86b1-8f201c92fbb3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:15.737628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ca62c-4956-4a4f-ba85-487f032dc6fe None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:15.741524 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 481/952] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Apr 6 10:50:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:15.747149 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd100207-5b4a-4dbb-86b1-8f201c92fbb3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:15.851031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ca62c-4956-4a4f-ba85-487f032dc6fe None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:15.864863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd100207-5b4a-4dbb-86b1-8f201c92fbb3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:15.895750 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35660c26-bcbe-4605-bf7e-2956a7c4c6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:15.898069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35660c26-bcbe-4605-bf7e-2956a7c4c6e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:15.898521 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35660c26-bcbe-4605-bf7e-2956a7c4c6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:15.898942 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35660c26-bcbe-4605-bf7e-2956a7c4c6e4 None admin] PATH_INFO: `/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/4daf4512881842a1bdf191e0d75139cd/roles/2a2949c54fe047d5970c08741cf8fffe` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:15.900755 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b61d4-ed88-47b9-8169-3053cec74c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:15.901705 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b61d4-ed88-47b9-8169-3053cec74c5b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:15.902024 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35660c26-bcbe-4605-bf7e-2956a7c4c6e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4306a6b12434cc495650e4f3b9afbde, user_id=4daf4512881842a1bdf191e0d75139cd, role_id=2a2949c54fe047d5970c08741cf8fffe)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:15.902403 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b61d4-ed88-47b9-8169-3053cec74c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:15.902867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b61d4-ed88-47b9-8169-3053cec74c5b None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:15.903498 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35660c26-bcbe-4605-bf7e-2956a7c4c6e4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:15.903988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b61d4-ed88-47b9-8169-3053cec74c5b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:15.904481 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b61d4-ed88-47b9-8169-3053cec74c5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:15.906041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b61d4-ed88-47b9-8169-3053cec74c5b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:15.916894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 482/953] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Apr 6 10:50:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:15.917828 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b61d4-ed88-47b9-8169-3053cec74c5b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:15.981395 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 472/954] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:50:15 2022] PUT /identity/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/4daf4512881842a1bdf191e0d75139cd/roles/2a2949c54fe047d5970c08741cf8fffe => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:50:16.033907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b61d4-ed88-47b9-8169-3053cec74c5b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:16.076956 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949b512-9a27-454d-922f-fe33c499d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:16.078065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949b512-9a27-454d-922f-fe33c499d1c8 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:16.078656 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949b512-9a27-454d-922f-fe33c499d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:16.079126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949b512-9a27-454d-922f-fe33c499d1c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:16.080090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949b512-9a27-454d-922f-fe33c499d1c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:16.081820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949b512-9a27-454d-922f-fe33c499d1c8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:16.156840 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 483/955] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Apr 6 10:50:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:50:16.407934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233f2b4-4a1a-4714-9dd1-147802ec4936 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:16.408915 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233f2b4-4a1a-4714-9dd1-147802ec4936 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:16.409419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233f2b4-4a1a-4714-9dd1-147802ec4936 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:16.411285 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 473/956] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:16.416245 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6dfd1-49f5-4f06-966c-ab9751cd1945 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:16.416699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6dfd1-49f5-4f06-966c-ab9751cd1945 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:16.416875 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6dfd1-49f5-4f06-966c-ab9751cd1945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:16.434359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-49d6dfd1-49f5-4f06-966c-ab9751cd1945 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:16.435856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-49d6dfd1-49f5-4f06-966c-ab9751cd1945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:16.510446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 484/957] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:16.532858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233f2b4-4a1a-4714-9dd1-147802ec4936 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:16.635006 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233f2b4-4a1a-4714-9dd1-147802ec4936 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:16.675015 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098f812-682b-4b8d-a886-db305c74c498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:16.675860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f812-682b-4b8d-a886-db305c74c498 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:16.676121 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f812-682b-4b8d-a886-db305c74c498 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:16.676400 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f812-682b-4b8d-a886-db305c74c498 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:16.677090 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098f812-682b-4b8d-a886-db305c74c498 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:16.679054 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098f812-682b-4b8d-a886-db305c74c498 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:16.690963 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-9098f812-682b-4b8d-a886-db305c74c498 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 06 10:50:16.692493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 474/958] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:50:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:16.700293 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6dfd1-49f5-4f06-966c-ab9751cd1945 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:16.799652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6dfd1-49f5-4f06-966c-ab9751cd1945 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:16.837098 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d899d86-db46-485a-b3c5-2d9f7c017c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:16.838172 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d899d86-db46-485a-b3c5-2d9f7c017c51 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:16.838680 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d899d86-db46-485a-b3c5-2d9f7c017c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:16.839174 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d899d86-db46-485a-b3c5-2d9f7c017c51 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:16.840114 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d899d86-db46-485a-b3c5-2d9f7c017c51 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:16.840620 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d899d86-db46-485a-b3c5-2d9f7c017c51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:16.842232 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d899d86-db46-485a-b3c5-2d9f7c017c51 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:16.847679 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 485/959] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Apr 6 10:50:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:16.853641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098f812-682b-4b8d-a886-db305c74c498 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:16.953039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098f812-682b-4b8d-a886-db305c74c498 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:16.986446 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf90203-6801-4396-99d7-b2f09c52921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:16.987437 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf90203-6801-4396-99d7-b2f09c52921d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:16.987958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf90203-6801-4396-99d7-b2f09c52921d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:16.988426 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf90203-6801-4396-99d7-b2f09c52921d None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:16.989352 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf90203-6801-4396-99d7-b2f09c52921d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:16.989855 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf90203-6801-4396-99d7-b2f09c52921d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:16.992106 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf90203-6801-4396-99d7-b2f09c52921d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:16.998573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 475/960] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Apr 6 10:50:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:17.874827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc7d17-93f9-4c27-b2f4-3b4e2e2baf0f None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:17.875682 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc7d17-93f9-4c27-b2f4-3b4e2e2baf0f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:17.876110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc7d17-93f9-4c27-b2f4-3b4e2e2baf0f None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:17.877923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 486/961] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:17.884116 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0c677-8988-4401-8c32-4a52815c46d2 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:17.884940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0c677-8988-4401-8c32-4a52815c46d2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:17.885469 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0c677-8988-4401-8c32-4a52815c46d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:17.903417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d1a0c677-8988-4401-8c32-4a52815c46d2 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:17.904949 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d1a0c677-8988-4401-8c32-4a52815c46d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:17.977183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 476/962] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:17.999615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc7d17-93f9-4c27-b2f4-3b4e2e2baf0f None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:18.109326 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc7d17-93f9-4c27-b2f4-3b4e2e2baf0f None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:18.146151 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c60501-c973-42f3-a59f-f95def55e4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:18.146880 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c60501-c973-42f3-a59f-f95def55e4b8 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:18.147166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c60501-c973-42f3-a59f-f95def55e4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:18.147442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c60501-c973-42f3-a59f-f95def55e4b8 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:18.148282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c60501-c973-42f3-a59f-f95def55e4b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:18.149749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c60501-c973-42f3-a59f-f95def55e4b8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:18.189268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.sql.core [None req-41c60501-c973-42f3-a59f-f95def55e4b8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 06 10:50:18.189268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 06 10:50:18.189268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [parameters: {'user_id': 'd34ef268a9ab484988b9399b4b3f1043', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 06 10:50:18.189268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80201) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 06 10:50:18.196213 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-41c60501-c973-42f3-a59f-f95def55e4b8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 06 10:50:18.197853 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 487/963] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Apr 6 10:50:17 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:18.203523 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0c677-8988-4401-8c32-4a52815c46d2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:18.311542 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0c677-8988-4401-8c32-4a52815c46d2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:18.346346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26657e-1db2-406f-80a5-e6ece32996c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:18.347147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26657e-1db2-406f-80a5-e6ece32996c4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:18.347428 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26657e-1db2-406f-80a5-e6ece32996c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:18.347702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26657e-1db2-406f-80a5-e6ece32996c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:18.354919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26657e-1db2-406f-80a5-e6ece32996c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:18.356404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26657e-1db2-406f-80a5-e6ece32996c4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:18.370632 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-bb26657e-1db2-406f-80a5-e6ece32996c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 06 10:50:18.372151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 477/964] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:50:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:18.378158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c60501-c973-42f3-a59f-f95def55e4b8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:18.387114 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239ead0-867a-4c74-8ac9-a9b591822e42 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:18.387398 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239ead0-867a-4c74-8ac9-a9b591822e42 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:18.387681 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239ead0-867a-4c74-8ac9-a9b591822e42 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:18.389025 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 478/965] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:50:18.394919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bb2c2-dd0f-451c-a607-e482a40be902 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:18.396125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bb2c2-dd0f-451c-a607-e482a40be902 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:18.396819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bb2c2-dd0f-451c-a607-e482a40be902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:18.418583 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-336bb2c2-dd0f-451c-a607-e482a40be902 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:18.420539 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-336bb2c2-dd0f-451c-a607-e482a40be902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:18.492599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c60501-c973-42f3-a59f-f95def55e4b8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:18.509190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 479/966] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:18.534330 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bb2c2-dd0f-451c-a607-e482a40be902 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:18.539351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53b24a-2623-49fd-80ae-b3bf396123e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:18.540053 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53b24a-2623-49fd-80ae-b3bf396123e0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:18.540340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53b24a-2623-49fd-80ae-b3bf396123e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:18.540622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53b24a-2623-49fd-80ae-b3bf396123e0 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:18.541508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53b24a-2623-49fd-80ae-b3bf396123e0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:18.541819 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53b24a-2623-49fd-80ae-b3bf396123e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:18.543472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53b24a-2623-49fd-80ae-b3bf396123e0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:18.593406 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 488/967] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Apr 6 10:50:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:18.645025 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257e391-7c81-4904-a229-8c03ddd82a5e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:18.645377 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257e391-7c81-4904-a229-8c03ddd82a5e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:18.645624 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257e391-7c81-4904-a229-8c03ddd82a5e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:18.647292 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 489/968] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:50:18.652517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bb2c2-dd0f-451c-a607-e482a40be902 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:18.654810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39137285-5303-4bf7-bb86-911dfc016714 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:18.656260 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39137285-5303-4bf7-bb86-911dfc016714 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:18.656783 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39137285-5303-4bf7-bb86-911dfc016714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:18.683582 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-39137285-5303-4bf7-bb86-911dfc016714 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:18.685670 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-39137285-5303-4bf7-bb86-911dfc016714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:18.693119 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d904d42-5f99-47ef-b7a0-16aac46fb56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:18.694008 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904d42-5f99-47ef-b7a0-16aac46fb56d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:18.694288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904d42-5f99-47ef-b7a0-16aac46fb56d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:18.694560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904d42-5f99-47ef-b7a0-16aac46fb56d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:18.706280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d904d42-5f99-47ef-b7a0-16aac46fb56d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:50:18.714074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-7d904d42-5f99-47ef-b7a0-16aac46fb56d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 10:50:18.715890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 480/969] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Apr 6 10:50:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:18.722242 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d904d42-5f99-47ef-b7a0-16aac46fb56d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:18.781373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 490/970] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:18.799115 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39137285-5303-4bf7-bb86-911dfc016714 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:18.852616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d904d42-5f99-47ef-b7a0-16aac46fb56d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:18.893659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a0dfe-fd90-4664-82b3-a2ce8f16b3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:18.893659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a0dfe-fd90-4664-82b3-a2ce8f16b3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:18.893659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a0dfe-fd90-4664-82b3-a2ce8f16b3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:18.893659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a0dfe-fd90-4664-82b3-a2ce8f16b3e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:18.894451 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a0dfe-fd90-4664-82b3-a2ce8f16b3e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:18.894451 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a0dfe-fd90-4664-82b3-a2ce8f16b3e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:18.895421 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a0dfe-fd90-4664-82b3-a2ce8f16b3e0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:18.907318 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 481/971] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Apr 6 10:50:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:18.913470 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a0dfe-fd90-4664-82b3-a2ce8f16b3e0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:18.914000 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39137285-5303-4bf7-bb86-911dfc016714 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:18.949941 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765ec2e-4b54-4fcf-bd82-9f45a3b27d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:18.950762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765ec2e-4b54-4fcf-bd82-9f45a3b27d54 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:18.951046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765ec2e-4b54-4fcf-bd82-9f45a3b27d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:18.951328 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765ec2e-4b54-4fcf-bd82-9f45a3b27d54 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:18.951985 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765ec2e-4b54-4fcf-bd82-9f45a3b27d54 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:18.953404 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765ec2e-4b54-4fcf-bd82-9f45a3b27d54 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:18.966050 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-c765ec2e-4b54-4fcf-bd82-9f45a3b27d54 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 10:50:18.972294 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 491/972] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Apr 6 10:50:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:18.973664 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765ec2e-4b54-4fcf-bd82-9f45a3b27d54 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:19.016673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a0dfe-fd90-4664-82b3-a2ce8f16b3e0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:19.053074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ac635-b524-4938-9b74-02df5047ae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:19.053889 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ac635-b524-4938-9b74-02df5047ae14 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:19.054432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ac635-b524-4938-9b74-02df5047ae14 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:19.054432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ac635-b524-4938-9b74-02df5047ae14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:19.065735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ac635-b524-4938-9b74-02df5047ae14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:19.067220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ac635-b524-4938-9b74-02df5047ae14 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:19.072568 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765ec2e-4b54-4fcf-bd82-9f45a3b27d54 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:19.083230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-6f9ac635-b524-4938-9b74-02df5047ae14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:19.085185 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 482/973] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:19.090401 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ac635-b524-4938-9b74-02df5047ae14 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:19.106346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be748be5-27a3-4d6e-b94e-8c410fa08470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:19.106956 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be748be5-27a3-4d6e-b94e-8c410fa08470 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:19.107232 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be748be5-27a3-4d6e-b94e-8c410fa08470 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:19.107505 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be748be5-27a3-4d6e-b94e-8c410fa08470 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:19.108208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be748be5-27a3-4d6e-b94e-8c410fa08470 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:19.108511 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be748be5-27a3-4d6e-b94e-8c410fa08470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:19.109894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be748be5-27a3-4d6e-b94e-8c410fa08470 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:19.119774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 492/974] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Apr 6 10:50:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:19.121238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be748be5-27a3-4d6e-b94e-8c410fa08470 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:19.187103 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ac635-b524-4938-9b74-02df5047ae14 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:19.216192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be748be5-27a3-4d6e-b94e-8c410fa08470 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:19.221642 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ca4b0-6858-4495-b4a1-16b5406324df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:19.222308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ca4b0-6858-4495-b4a1-16b5406324df None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:19.222590 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ca4b0-6858-4495-b4a1-16b5406324df None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:19.223265 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ca4b0-6858-4495-b4a1-16b5406324df None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:19.224002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ca4b0-6858-4495-b4a1-16b5406324df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:19.224311 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ca4b0-6858-4495-b4a1-16b5406324df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:19.226959 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ca4b0-6858-4495-b4a1-16b5406324df None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:19.239791 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 483/975] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:19.245516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ca4b0-6858-4495-b4a1-16b5406324df None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:19.256506 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c781bb-22bf-4b6c-a760-f7ff4649030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:19.257212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c781bb-22bf-4b6c-a760-f7ff4649030c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:19.257505 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c781bb-22bf-4b6c-a760-f7ff4649030c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:19.257830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c781bb-22bf-4b6c-a760-f7ff4649030c None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:19.258468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c781bb-22bf-4b6c-a760-f7ff4649030c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:19.258769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c781bb-22bf-4b6c-a760-f7ff4649030c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:19.260115 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c781bb-22bf-4b6c-a760-f7ff4649030c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:19.264953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 493/976] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Apr 6 10:50:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:19.270360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c781bb-22bf-4b6c-a760-f7ff4649030c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:19.343102 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ca4b0-6858-4495-b4a1-16b5406324df None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:19.371480 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c781bb-22bf-4b6c-a760-f7ff4649030c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:19.376224 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2f4bc-1024-4a97-af94-3c9da0846a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:19.377022 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2f4bc-1024-4a97-af94-3c9da0846a5a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:19.377331 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2f4bc-1024-4a97-af94-3c9da0846a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:19.377601 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2f4bc-1024-4a97-af94-3c9da0846a5a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:19.384373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2f4bc-1024-4a97-af94-3c9da0846a5a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:19.385877 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2f4bc-1024-4a97-af94-3c9da0846a5a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:19.399647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-bad2f4bc-1024-4a97-af94-3c9da0846a5a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 10:50:19.400983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 484/977] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Apr 6 10:50:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:19.402057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223109e-d39b-4fff-a023-b5809a325ba9 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:19.402338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223109e-d39b-4fff-a023-b5809a325ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:19.402611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223109e-d39b-4fff-a023-b5809a325ba9 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:19.404002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 485/978] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:19.406709 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223109e-d39b-4fff-a023-b5809a325ba9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:19.407077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ca5f2-7ae1-4c9b-81f4-e6abbd7416eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:19.407820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ca5f2-7ae1-4c9b-81f4-e6abbd7416eb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:19.408099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ca5f2-7ae1-4c9b-81f4-e6abbd7416eb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:19.408373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ca5f2-7ae1-4c9b-81f4-e6abbd7416eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:19.409228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ca5f2-7ae1-4c9b-81f4-e6abbd7416eb None admin] RBAC: Adding query filter params (interface=admin, service_id=32af57379ffd4ce7b995f4f19ee81745, region_id=RegionOne) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:19.409539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ca5f2-7ae1-4c9b-81f4-e6abbd7416eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:19.410895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ca5f2-7ae1-4c9b-81f4-e6abbd7416eb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:19.420753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 494/979] 10.222.0.62 () {56 vars in 1249 bytes} [Wed Apr 6 10:50:19 2022] GET /identity/v3/endpoints?service_id=32af57379ffd4ce7b995f4f19ee81745&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:19.420753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eec96-ccaa-40eb-8cf7-39914f88193a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:19.420753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eec96-ccaa-40eb-8cf7-39914f88193a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:19.420753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eec96-ccaa-40eb-8cf7-39914f88193a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:19.434357 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-352eec96-ccaa-40eb-8cf7-39914f88193a None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:19.435635 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-352eec96-ccaa-40eb-8cf7-39914f88193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:19.513082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 495/980] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:19.513082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eec96-ccaa-40eb-8cf7-39914f88193a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:19.513368 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223109e-d39b-4fff-a023-b5809a325ba9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:19.535507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a68b3c-99b6-4075-9e04-54e887e5f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:19.536176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a68b3c-99b6-4075-9e04-54e887e5f387 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:19.536465 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a68b3c-99b6-4075-9e04-54e887e5f387 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:19.536737 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a68b3c-99b6-4075-9e04-54e887e5f387 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:19.538189 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a68b3c-99b6-4075-9e04-54e887e5f387 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:19.538490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a68b3c-99b6-4075-9e04-54e887e5f387 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:19.540121 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a68b3c-99b6-4075-9e04-54e887e5f387 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:19.556702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 486/981] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Apr 6 10:50:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:19.557546 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a68b3c-99b6-4075-9e04-54e887e5f387 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:19.597067 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eec96-ccaa-40eb-8cf7-39914f88193a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:19.629477 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce23e9e-96d7-4a29-b92b-d2edeca30352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:19.630075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce23e9e-96d7-4a29-b92b-d2edeca30352 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:19.630359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce23e9e-96d7-4a29-b92b-d2edeca30352 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:19.630635 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce23e9e-96d7-4a29-b92b-d2edeca30352 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:19.631317 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce23e9e-96d7-4a29-b92b-d2edeca30352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:19.632686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce23e9e-96d7-4a29-b92b-d2edeca30352 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:19.638628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 496/982] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Apr 6 10:50:19 2022] GET /identity/v3/services => generated 1497 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:50:19.639402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce23e9e-96d7-4a29-b92b-d2edeca30352 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:19.650492 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a68b3c-99b6-4075-9e04-54e887e5f387 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:19.690494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915d940-bcb1-4b09-bede-36a6c94c5893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:19.691173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915d940-bcb1-4b09-bede-36a6c94c5893 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:19.691456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915d940-bcb1-4b09-bede-36a6c94c5893 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:19.691738 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915d940-bcb1-4b09-bede-36a6c94c5893 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:19.692468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915d940-bcb1-4b09-bede-36a6c94c5893 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:19.693971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915d940-bcb1-4b09-bede-36a6c94c5893 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:19.750981 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce23e9e-96d7-4a29-b92b-d2edeca30352 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:19.787680 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24424dfe-e33d-499e-b465-11c74bae6f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:19.788373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24424dfe-e33d-499e-b465-11c74bae6f92 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:19.788660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24424dfe-e33d-499e-b465-11c74bae6f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:19.788935 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24424dfe-e33d-499e-b465-11c74bae6f92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:19.798718 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 487/983] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Apr 6 10:50:19 2022] POST /identity/v3/services => generated 242 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:50:19.865979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24424dfe-e33d-499e-b465-11c74bae6f92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:19.867510 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24424dfe-e33d-499e-b465-11c74bae6f92 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:19.977179 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 497/984] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:50:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:50:19.977761 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915d940-bcb1-4b09-bede-36a6c94c5893 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:20.081350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915d940-bcb1-4b09-bede-36a6c94c5893 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:20.113392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ef416-cf8c-439c-bbab-df0c69cbddd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:20.114185 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ef416-cf8c-439c-bbab-df0c69cbddd0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:20.114462 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ef416-cf8c-439c-bbab-df0c69cbddd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:20.114736 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ef416-cf8c-439c-bbab-df0c69cbddd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:20.124758 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ef416-cf8c-439c-bbab-df0c69cbddd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:20.126258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ef416-cf8c-439c-bbab-df0c69cbddd0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:20.142378 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-658ef416-cf8c-439c-bbab-df0c69cbddd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:20.143724 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 488/985] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:20.149730 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24424dfe-e33d-499e-b465-11c74bae6f92 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:20.241754 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24424dfe-e33d-499e-b465-11c74bae6f92 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:20.273942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666d428-a9dd-4a5d-8aac-b2c0b1201a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:20.274605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666d428-a9dd-4a5d-8aac-b2c0b1201a80 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:20.274887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666d428-a9dd-4a5d-8aac-b2c0b1201a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:20.275164 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666d428-a9dd-4a5d-8aac-b2c0b1201a80 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:20.275877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666d428-a9dd-4a5d-8aac-b2c0b1201a80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:20.276195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666d428-a9dd-4a5d-8aac-b2c0b1201a80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:20.277567 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666d428-a9dd-4a5d-8aac-b2c0b1201a80 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:20.292342 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 498/986] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:20.297666 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ef416-cf8c-439c-bbab-df0c69cbddd0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:20.399235 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ef416-cf8c-439c-bbab-df0c69cbddd0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:20.431597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781c827-496a-4a3d-8533-9afd336e5ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:20.432392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781c827-496a-4a3d-8533-9afd336e5ebb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:20.432669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781c827-496a-4a3d-8533-9afd336e5ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:20.432936 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781c827-496a-4a3d-8533-9afd336e5ebb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:20.439667 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781c827-496a-4a3d-8533-9afd336e5ebb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:20.441162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781c827-496a-4a3d-8533-9afd336e5ebb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:20.454812 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-4781c827-496a-4a3d-8533-9afd336e5ebb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:50:20.456162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 489/987] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:50:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:20.461703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666d428-a9dd-4a5d-8aac-b2c0b1201a80 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:20.558225 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666d428-a9dd-4a5d-8aac-b2c0b1201a80 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:20.590162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8934fb1-7bb4-4d61-8ee0-762acf7ac8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:20.590825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8934fb1-7bb4-4d61-8ee0-762acf7ac8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:20.591108 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8934fb1-7bb4-4d61-8ee0-762acf7ac8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:20.591383 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8934fb1-7bb4-4d61-8ee0-762acf7ac8c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:20.592163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8934fb1-7bb4-4d61-8ee0-762acf7ac8c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:20.592472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8934fb1-7bb4-4d61-8ee0-762acf7ac8c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:20.593924 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8934fb1-7bb4-4d61-8ee0-762acf7ac8c1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:20.605664 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 499/988] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:50:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:20.611432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781c827-496a-4a3d-8533-9afd336e5ebb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:20.717045 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781c827-496a-4a3d-8533-9afd336e5ebb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:20.756244 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4853b80-ed83-470f-955c-92bc2b0be6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:20.756989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4853b80-ed83-470f-955c-92bc2b0be6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:20.757321 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4853b80-ed83-470f-955c-92bc2b0be6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:20.757609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4853b80-ed83-470f-955c-92bc2b0be6c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:20.758496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4853b80-ed83-470f-955c-92bc2b0be6c7 None admin] RBAC: Adding query filter params (role.id=2a2949c54fe047d5970c08741cf8fffe, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=4daf4512881842a1bdf191e0d75139cd) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:20.758880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4853b80-ed83-470f-955c-92bc2b0be6c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:20.760344 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4853b80-ed83-470f-955c-92bc2b0be6c7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:20.766218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 490/989] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:50:20 2022] GET /identity/v3/role_assignments?user.id=4daf4512881842a1bdf191e0d75139cd&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=2a2949c54fe047d5970c08741cf8fffe => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:22.018813 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b701f-ce6f-4042-b13a-f8580fad06a5 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:22.019334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b701f-ce6f-4042-b13a-f8580fad06a5 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:22.019409 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b701f-ce6f-4042-b13a-f8580fad06a5 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:22.020906 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 500/990] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:22.026790 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3ce32-c988-4001-bddb-2438a05cea48 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:22.027233 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3ce32-c988-4001-bddb-2438a05cea48 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:22.027419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3ce32-c988-4001-bddb-2438a05cea48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:22.044512 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-75c3ce32-c988-4001-bddb-2438a05cea48 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:22.045735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-75c3ce32-c988-4001-bddb-2438a05cea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:22.109276 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 491/991] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:22.134026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b701f-ce6f-4042-b13a-f8580fad06a5 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:22.136041 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b56b25-0d0a-4656-9bbd-7422d18783fd None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:22.136337 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b56b25-0d0a-4656-9bbd-7422d18783fd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:22.136613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b56b25-0d0a-4656-9bbd-7422d18783fd None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:22.138006 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 492/992] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:22.143153 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edf02b-a769-44bf-88cc-0f644a3ca618 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:22.143444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edf02b-a769-44bf-88cc-0f644a3ca618 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:22.143720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edf02b-a769-44bf-88cc-0f644a3ca618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:22.160264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e0edf02b-a769-44bf-88cc-0f644a3ca618 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:22.161555 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e0edf02b-a769-44bf-88cc-0f644a3ca618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:22.226829 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 493/993] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:22.236824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b701f-ce6f-4042-b13a-f8580fad06a5 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:22.251075 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edf02b-a769-44bf-88cc-0f644a3ca618 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:22.270106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23526c-812f-4dda-90bc-83ac9fb03f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:22.270832 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23526c-812f-4dda-90bc-83ac9fb03f6f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:22.271113 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23526c-812f-4dda-90bc-83ac9fb03f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:22.271399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23526c-812f-4dda-90bc-83ac9fb03f6f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:22.272630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23526c-812f-4dda-90bc-83ac9fb03f6f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:22.274044 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23526c-812f-4dda-90bc-83ac9fb03f6f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:22.285448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-4e23526c-812f-4dda-90bc-83ac9fb03f6f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 10:50:22.286643 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 501/994] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Apr 6 10:50:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:22.293074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23526c-812f-4dda-90bc-83ac9fb03f6f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:22.355111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edf02b-a769-44bf-88cc-0f644a3ca618 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:22.388743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163deeed-99ac-4193-bace-00aba4e0418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:22.389568 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163deeed-99ac-4193-bace-00aba4e0418f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:22.389870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163deeed-99ac-4193-bace-00aba4e0418f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:22.390224 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163deeed-99ac-4193-bace-00aba4e0418f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:22.390887 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163deeed-99ac-4193-bace-00aba4e0418f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:22.392317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163deeed-99ac-4193-bace-00aba4e0418f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:22.393634 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23526c-812f-4dda-90bc-83ac9fb03f6f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:22.403872 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-163deeed-99ac-4193-bace-00aba4e0418f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 06 10:50:22.405254 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 494/995] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:50:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:22.410777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163deeed-99ac-4193-bace-00aba4e0418f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:22.427848 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23856f-d18c-45e1-b104-7cc1e0a221c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:22.428523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23856f-d18c-45e1-b104-7cc1e0a221c7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:22.428803 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23856f-d18c-45e1-b104-7cc1e0a221c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:22.429094 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23856f-d18c-45e1-b104-7cc1e0a221c7 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:22.429810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23856f-d18c-45e1-b104-7cc1e0a221c7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:22.430117 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23856f-d18c-45e1-b104-7cc1e0a221c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:22.431481 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23856f-d18c-45e1-b104-7cc1e0a221c7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:22.436119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 502/996] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Apr 6 10:50:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:22.441960 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23856f-d18c-45e1-b104-7cc1e0a221c7 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:22.508461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163deeed-99ac-4193-bace-00aba4e0418f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:22.538745 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23856f-d18c-45e1-b104-7cc1e0a221c7 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:22.543094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1643f7-9e90-44a3-9cce-14b7092a1aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:22.543768 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1643f7-9e90-44a3-9cce-14b7092a1aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:22.544050 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1643f7-9e90-44a3-9cce-14b7092a1aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:22.544326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1643f7-9e90-44a3-9cce-14b7092a1aa3 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:22.545030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1643f7-9e90-44a3-9cce-14b7092a1aa3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:22.545361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1643f7-9e90-44a3-9cce-14b7092a1aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:22.546774 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1643f7-9e90-44a3-9cce-14b7092a1aa3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:22.556678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 495/997] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Apr 6 10:50:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:22.557595 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1643f7-9e90-44a3-9cce-14b7092a1aa3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:22.572639 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a457e79-b6d6-4fbe-8ef5-013fc34638c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:22.573344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a457e79-b6d6-4fbe-8ef5-013fc34638c2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:22.573627 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a457e79-b6d6-4fbe-8ef5-013fc34638c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:22.573902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a457e79-b6d6-4fbe-8ef5-013fc34638c2 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:22.574606 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a457e79-b6d6-4fbe-8ef5-013fc34638c2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:22.574912 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a457e79-b6d6-4fbe-8ef5-013fc34638c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:22.576266 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a457e79-b6d6-4fbe-8ef5-013fc34638c2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:22.581454 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 503/998] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Apr 6 10:50:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:22.587285 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a457e79-b6d6-4fbe-8ef5-013fc34638c2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:22.660714 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1643f7-9e90-44a3-9cce-14b7092a1aa3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:22.692765 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a457e79-b6d6-4fbe-8ef5-013fc34638c2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:22.697538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c42ae-ce46-49ee-8b44-0d6ef9c5d78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:22.698206 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c42ae-ce46-49ee-8b44-0d6ef9c5d78e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:22.698488 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c42ae-ce46-49ee-8b44-0d6ef9c5d78e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:22.698763 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c42ae-ce46-49ee-8b44-0d6ef9c5d78e None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:22.699460 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c42ae-ce46-49ee-8b44-0d6ef9c5d78e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:22.699764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c42ae-ce46-49ee-8b44-0d6ef9c5d78e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:22.701190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c42ae-ce46-49ee-8b44-0d6ef9c5d78e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:22.706630 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 496/999] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Apr 6 10:50:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:22.712933 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c42ae-ce46-49ee-8b44-0d6ef9c5d78e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:22.728119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c1dc6-cf8a-4857-a5bd-0a2f6f68d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:22.728779 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c1dc6-cf8a-4857-a5bd-0a2f6f68d6a8 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:22.729085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c1dc6-cf8a-4857-a5bd-0a2f6f68d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:22.729355 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c1dc6-cf8a-4857-a5bd-0a2f6f68d6a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:22.730085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c1dc6-cf8a-4857-a5bd-0a2f6f68d6a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:22.731428 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c1dc6-cf8a-4857-a5bd-0a2f6f68d6a8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:22.817168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 504/1000] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Apr 6 10:50:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:50:22.817359 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c42ae-ce46-49ee-8b44-0d6ef9c5d78e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:22.857107 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2966dd2-e3bb-44df-9b38-fc57c0228cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:22.857777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966dd2-e3bb-44df-9b38-fc57c0228cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:22.858057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966dd2-e3bb-44df-9b38-fc57c0228cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:22.858331 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966dd2-e3bb-44df-9b38-fc57c0228cc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:22.859128 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2966dd2-e3bb-44df-9b38-fc57c0228cc2 None admin] RBAC: Adding query filter params (interface=public, service_id=5167363a8aed4306b849d1bbae8f81e9, region_id=RegionOne) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:22.859441 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2966dd2-e3bb-44df-9b38-fc57c0228cc2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:22.860940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2966dd2-e3bb-44df-9b38-fc57c0228cc2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:22.872059 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 497/1001] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Apr 6 10:50:22 2022] GET /identity/v3/endpoints?service_id=5167363a8aed4306b849d1bbae8f81e9&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:22.873144 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c1dc6-cf8a-4857-a5bd-0a2f6f68d6a8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:22.976656 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c1dc6-cf8a-4857-a5bd-0a2f6f68d6a8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:23.011328 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745d1e4-2bb9-4600-ad3c-9ca770e566b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:23.011951 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745d1e4-2bb9-4600-ad3c-9ca770e566b6 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:23.012234 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745d1e4-2bb9-4600-ad3c-9ca770e566b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:23.012511 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745d1e4-2bb9-4600-ad3c-9ca770e566b6 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:23.013242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745d1e4-2bb9-4600-ad3c-9ca770e566b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:23.014593 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745d1e4-2bb9-4600-ad3c-9ca770e566b6 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:23.020978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 505/1002] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Apr 6 10:50:22 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:50:23.127293 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f5ee8-e40d-467c-8f2b-1b84232eb46c None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:23.127810 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f5ee8-e40d-467c-8f2b-1b84232eb46c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:23.127810 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f5ee8-e40d-467c-8f2b-1b84232eb46c None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:23.129307 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 498/1003] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:23.134896 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2c771-3f92-4c0e-9fd9-03bd75598e1b None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:23.135190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2c771-3f92-4c0e-9fd9-03bd75598e1b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:23.135469 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2c771-3f92-4c0e-9fd9-03bd75598e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:23.153272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-f1e2c771-3f92-4c0e-9fd9-03bd75598e1b None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:23.154496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f1e2c771-3f92-4c0e-9fd9-03bd75598e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:23.229361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 506/1004] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:23 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:23.251836 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f5ee8-e40d-467c-8f2b-1b84232eb46c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:23.348298 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f5ee8-e40d-467c-8f2b-1b84232eb46c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:23.379791 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f580d9-54a6-4604-a28a-fc0cc0ac0750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:23.380502 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f580d9-54a6-4604-a28a-fc0cc0ac0750 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:23.380803 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f580d9-54a6-4604-a28a-fc0cc0ac0750 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:23.381088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f580d9-54a6-4604-a28a-fc0cc0ac0750 None admin] PATH_INFO: `/v3/services/image` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:23.381731 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f580d9-54a6-4604-a28a-fc0cc0ac0750 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:23.383123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f580d9-54a6-4604-a28a-fc0cc0ac0750 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:23.393638 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-e5f580d9-54a6-4604-a28a-fc0cc0ac0750 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 06 10:50:23.394807 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 499/1005] 10.222.0.62 () {56 vars in 1105 bytes} [Wed Apr 6 10:50:23 2022] GET /identity/v3/services/image => generated 86 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:23.403098 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2c771-3f92-4c0e-9fd9-03bd75598e1b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:23.499580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2c771-3f92-4c0e-9fd9-03bd75598e1b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:23.531879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8e54f-6b35-4e92-afee-0226a142ed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:23.532549 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e54f-6b35-4e92-afee-0226a142ed94 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:23.532833 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e54f-6b35-4e92-afee-0226a142ed94 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:23.533135 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e54f-6b35-4e92-afee-0226a142ed94 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:23.533841 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8e54f-6b35-4e92-afee-0226a142ed94 None admin] RBAC: Adding query filter params (name=image) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:23.534149 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8e54f-6b35-4e92-afee-0226a142ed94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:23.535509 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8e54f-6b35-4e92-afee-0226a142ed94 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:23.540149 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 507/1006] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:23.545901 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f580d9-54a6-4604-a28a-fc0cc0ac0750 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:23.640639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f580d9-54a6-4604-a28a-fc0cc0ac0750 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:23.676444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2b8b4-0cbd-448b-bf06-cb409775e861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:23.677137 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b8b4-0cbd-448b-bf06-cb409775e861 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:23.677418 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b8b4-0cbd-448b-bf06-cb409775e861 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:23.677726 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b8b4-0cbd-448b-bf06-cb409775e861 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:23.678420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2b8b4-0cbd-448b-bf06-cb409775e861 None admin] RBAC: Adding query filter params (type=image) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:23.678722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2b8b4-0cbd-448b-bf06-cb409775e861 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:23.680115 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2b8b4-0cbd-448b-bf06-cb409775e861 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:23.684970 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 500/1007] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:25.141096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7ba7-2e25-4e03-a216-24386d32aff9 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:25.141620 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7ba7-2e25-4e03-a216-24386d32aff9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:25.141695 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7ba7-2e25-4e03-a216-24386d32aff9 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:25.143166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 508/1008] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:25.148125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae5e5-8370-4a95-aed1-4d9d9eda8eaa None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:25.148496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae5e5-8370-4a95-aed1-4d9d9eda8eaa None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:25.148686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae5e5-8370-4a95-aed1-4d9d9eda8eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:25.166168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-af0ae5e5-8370-4a95-aed1-4d9d9eda8eaa None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:25.167343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-af0ae5e5-8370-4a95-aed1-4d9d9eda8eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:25.232166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 501/1009] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:25.256620 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c7ba7-2e25-4e03-a216-24386d32aff9 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:25.350117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f622-2671-4d3d-a627-b6101adb3cf4 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:25.350413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f622-2671-4d3d-a627-b6101adb3cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:25.350693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f622-2671-4d3d-a627-b6101adb3cf4 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:25.352290 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 502/1010] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:25.356983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b84e5b-fcb0-4c6c-8a9c-ec3e76a70040 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:25.357399 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b84e5b-fcb0-4c6c-8a9c-ec3e76a70040 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:25.357747 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b84e5b-fcb0-4c6c-8a9c-ec3e76a70040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:25.364053 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c7ba7-2e25-4e03-a216-24386d32aff9 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:25.374895 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a3b84e5b-fcb0-4c6c-8a9c-ec3e76a70040 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:25.376100 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a3b84e5b-fcb0-4c6c-8a9c-ec3e76a70040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:25.400772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a4383-4bb1-4ddc-8b7e-775387a8ebe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:25.401530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a4383-4bb1-4ddc-8b7e-775387a8ebe6 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:25.401813 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a4383-4bb1-4ddc-8b7e-775387a8ebe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:25.402084 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a4383-4bb1-4ddc-8b7e-775387a8ebe6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:25.403272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a4383-4bb1-4ddc-8b7e-775387a8ebe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:25.404708 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a4383-4bb1-4ddc-8b7e-775387a8ebe6 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:25.410976 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 509/1011] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:25.412840 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a4383-4bb1-4ddc-8b7e-775387a8ebe6 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:25.442207 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 503/1012] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:25.466851 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b84e5b-fcb0-4c6c-8a9c-ec3e76a70040 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:25.509395 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a4383-4bb1-4ddc-8b7e-775387a8ebe6 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:25.542355 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e2139-1970-456d-a2da-017a2a801e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:25.543013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e2139-1970-456d-a2da-017a2a801e5e None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:25.543291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e2139-1970-456d-a2da-017a2a801e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:25.543559 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e2139-1970-456d-a2da-017a2a801e5e None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:25.544257 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e2139-1970-456d-a2da-017a2a801e5e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:25.545705 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e2139-1970-456d-a2da-017a2a801e5e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:25.563931 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b84e5b-fcb0-4c6c-8a9c-ec3e76a70040 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:25.598010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ef6b1-ccbf-451a-94d0-219d857ba48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:25.598837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ef6b1-ccbf-451a-94d0-219d857ba48d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:25.599123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ef6b1-ccbf-451a-94d0-219d857ba48d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:25.599400 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ef6b1-ccbf-451a-94d0-219d857ba48d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:25.600647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ef6b1-ccbf-451a-94d0-219d857ba48d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:25.602156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ef6b1-ccbf-451a-94d0-219d857ba48d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:25.614092 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-1f1ef6b1-ccbf-451a-94d0-219d857ba48d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 06 10:50:25.615474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 504/1013] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:50:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:25.621562 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ef6b1-ccbf-451a-94d0-219d857ba48d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:25.661105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 510/1014] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Apr 6 10:50:25 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:50:25.750432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ef6b1-ccbf-451a-94d0-219d857ba48d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:25.786050 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea106508-52eb-4285-8a1d-e5ac72c34b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:25.786728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea106508-52eb-4285-8a1d-e5ac72c34b17 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:25.787009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea106508-52eb-4285-8a1d-e5ac72c34b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:25.787844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea106508-52eb-4285-8a1d-e5ac72c34b17 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:25.788658 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea106508-52eb-4285-8a1d-e5ac72c34b17 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:25.788964 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea106508-52eb-4285-8a1d-e5ac72c34b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:25.790575 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea106508-52eb-4285-8a1d-e5ac72c34b17 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:25.796168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 505/1015] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Apr 6 10:50:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:25.801905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e2139-1970-456d-a2da-017a2a801e5e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:25.908498 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e2139-1970-456d-a2da-017a2a801e5e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:25.979038 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324e7b6-4d63-4bb3-89de-13ed207b657a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:25.979331 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324e7b6-4d63-4bb3-89de-13ed207b657a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:25.979610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324e7b6-4d63-4bb3-89de-13ed207b657a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:25.981012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 506/1016] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:50:25.985971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f9272-b3a4-4b47-bb26-6de6b974a376 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:25.986259 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f9272-b3a4-4b47-bb26-6de6b974a376 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:25.986540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f9272-b3a4-4b47-bb26-6de6b974a376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:26.023644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-430f9272-b3a4-4b47-bb26-6de6b974a376 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:26.024819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-430f9272-b3a4-4b47-bb26-6de6b974a376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:26.045329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b95d1-7de8-4f20-ad97-9c5cae2996f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:26.046107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b95d1-7de8-4f20-ad97-9c5cae2996f0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:26.046399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b95d1-7de8-4f20-ad97-9c5cae2996f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:26.047431 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b95d1-7de8-4f20-ad97-9c5cae2996f0 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:26.047431 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b95d1-7de8-4f20-ad97-9c5cae2996f0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:26.047695 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b95d1-7de8-4f20-ad97-9c5cae2996f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:26.049038 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b95d1-7de8-4f20-ad97-9c5cae2996f0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:26.058858 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 511/1017] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Apr 6 10:50:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:26.060600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b95d1-7de8-4f20-ad97-9c5cae2996f0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:26.095516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 507/1018] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:26.119542 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f9272-b3a4-4b47-bb26-6de6b974a376 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:26.161827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b95d1-7de8-4f20-ad97-9c5cae2996f0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:26.195356 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623e45e-4208-47d3-9ac1-995a2cb021b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:26.196020 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623e45e-4208-47d3-9ac1-995a2cb021b1 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:26.196303 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623e45e-4208-47d3-9ac1-995a2cb021b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:26.196575 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623e45e-4208-47d3-9ac1-995a2cb021b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:26.197401 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623e45e-4208-47d3-9ac1-995a2cb021b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:26.198706 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623e45e-4208-47d3-9ac1-995a2cb021b1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:26.215579 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f9272-b3a4-4b47-bb26-6de6b974a376 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:26.247289 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c470e4f-a36b-42ef-b58b-f551a2f8bb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:26.247881 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c470e4f-a36b-42ef-b58b-f551a2f8bb50 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:26.248160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c470e4f-a36b-42ef-b58b-f551a2f8bb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:26.248428 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c470e4f-a36b-42ef-b58b-f551a2f8bb50 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:26.249161 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c470e4f-a36b-42ef-b58b-f551a2f8bb50 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:26.250581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c470e4f-a36b-42ef-b58b-f551a2f8bb50 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:26.273890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 512/1019] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Apr 6 10:50:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:50:26.350009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 508/1020] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Apr 6 10:50:26 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:50:28.028659 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd51b-2bad-4d1a-8a36-5abd28e1a5a0 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:28.029228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd51b-2bad-4d1a-8a36-5abd28e1a5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:28.029228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd51b-2bad-4d1a-8a36-5abd28e1a5a0 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:28.030647 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 513/1021] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:28.036420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa2930-75d3-41b8-a622-d9b1c47d92b5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:28.036828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa2930-75d3-41b8-a622-d9b1c47d92b5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:28.037553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa2930-75d3-41b8-a622-d9b1c47d92b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:28.054654 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-85fa2930-75d3-41b8-a622-d9b1c47d92b5 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:28.055824 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-85fa2930-75d3-41b8-a622-d9b1c47d92b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:28.126065 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 509/1022] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:28.151821 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dd51b-2bad-4d1a-8a36-5abd28e1a5a0 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:28.248584 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dd51b-2bad-4d1a-8a36-5abd28e1a5a0 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:28.281635 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f7e7b-fcfc-4599-8c65-d70061b4cdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:28.282441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f7e7b-fcfc-4599-8c65-d70061b4cdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:28.282723 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f7e7b-fcfc-4599-8c65-d70061b4cdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:28.282993 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f7e7b-fcfc-4599-8c65-d70061b4cdc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:28.284156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f7e7b-fcfc-4599-8c65-d70061b4cdc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:28.285619 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f7e7b-fcfc-4599-8c65-d70061b4cdc1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:28.287554 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 514/1023] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:28.293063 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa2930-75d3-41b8-a622-d9b1c47d92b5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:28.398772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa2930-75d3-41b8-a622-d9b1c47d92b5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:28.431863 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ca2d0-d259-4e95-a8c3-efe53fa2a1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:28.432880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ca2d0-d259-4e95-a8c3-efe53fa2a1d5 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:28.433388 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ca2d0-d259-4e95-a8c3-efe53fa2a1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:28.433874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ca2d0-d259-4e95-a8c3-efe53fa2a1d5 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:28.434783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ca2d0-d259-4e95-a8c3-efe53fa2a1d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:28.436433 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ca2d0-d259-4e95-a8c3-efe53fa2a1d5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:28.527199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 510/1024] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:50:28 2022] POST /identity/v3/users => generated 285 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:50:28.705867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96f8b7-05c1-476d-8d69-475f966b99ad None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:28.706211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96f8b7-05c1-476d-8d69-475f966b99ad None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:28.706425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96f8b7-05c1-476d-8d69-475f966b99ad None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:28.708021 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 515/1025] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:28.710406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540afe0-482e-4c9a-85db-b65b88ea7b8c None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:28.710772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540afe0-482e-4c9a-85db-b65b88ea7b8c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:28.711060 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540afe0-482e-4c9a-85db-b65b88ea7b8c None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:28.712500 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 511/1026] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:28.713489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468a3ad-c10f-4d8d-935a-ad329a7b4a04 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:28.713776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468a3ad-c10f-4d8d-935a-ad329a7b4a04 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:28.714048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468a3ad-c10f-4d8d-935a-ad329a7b4a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:28.718020 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0802412-5d56-4c47-a5c9-b70b398f3c41 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:28.718310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0802412-5d56-4c47-a5c9-b70b398f3c41 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:28.718586 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0802412-5d56-4c47-a5c9-b70b398f3c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:28.731634 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0468a3ad-c10f-4d8d-935a-ad329a7b4a04 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:28.733047 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0468a3ad-c10f-4d8d-935a-ad329a7b4a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:28.735692 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b0802412-5d56-4c47-a5c9-b70b398f3c41 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:28.736864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b0802412-5d56-4c47-a5c9-b70b398f3c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:28.804904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 516/1027] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:28.810413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 512/1028] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:28.832235 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468a3ad-c10f-4d8d-935a-ad329a7b4a04 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:28.835320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0802412-5d56-4c47-a5c9-b70b398f3c41 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:28.932031 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468a3ad-c10f-4d8d-935a-ad329a7b4a04 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:28.934243 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0802412-5d56-4c47-a5c9-b70b398f3c41 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:28.968951 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd50405-163b-4a43-944a-adc2042417d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:28.969785 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd50405-163b-4a43-944a-adc2042417d5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:28.970066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd50405-163b-4a43-944a-adc2042417d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:28.970407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd50405-163b-4a43-944a-adc2042417d5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:28.970997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd50405-163b-4a43-944a-adc2042417d5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:28.972377 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd50405-163b-4a43-944a-adc2042417d5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:28.973757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c6b64-f839-4ff8-ae58-2d84578addc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:28.975089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c6b64-f839-4ff8-ae58-2d84578addc2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:28.975368 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c6b64-f839-4ff8-ae58-2d84578addc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:28.975641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c6b64-f839-4ff8-ae58-2d84578addc2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:28.983963 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-edd50405-163b-4a43-944a-adc2042417d5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 06 10:50:28.985387 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 517/1029] 10.222.0.62 () {56 vars in 1105 bytes} [Wed Apr 6 10:50:28 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:28.985497 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c6b64-f839-4ff8-ae58-2d84578addc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:50:28.991654 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd50405-163b-4a43-944a-adc2042417d5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:28.993760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-e85c6b64-f839-4ff8-ae58-2d84578addc2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 10:50:28.995125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 513/1030] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Apr 6 10:50:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:29.001857 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c6b64-f839-4ff8-ae58-2d84578addc2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:29.091407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd50405-163b-4a43-944a-adc2042417d5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:29.109120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c6b64-f839-4ff8-ae58-2d84578addc2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:29.124403 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeb591-10ae-4736-854f-906a49e721f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:29.125181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeb591-10ae-4736-854f-906a49e721f3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:29.125457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeb591-10ae-4736-854f-906a49e721f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:29.125721 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeb591-10ae-4736-854f-906a49e721f3 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:29.126421 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eeb591-10ae-4736-854f-906a49e721f3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:29.126724 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eeb591-10ae-4736-854f-906a49e721f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:29.128063 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eeb591-10ae-4736-854f-906a49e721f3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:29.132855 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 518/1031] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:29.138575 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeb591-10ae-4736-854f-906a49e721f3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:29.143664 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ca912-ac61-4a22-b43d-88ec8cd0036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:29.144323 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ca912-ac61-4a22-b43d-88ec8cd0036b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:29.146314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ca912-ac61-4a22-b43d-88ec8cd0036b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:29.146314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ca912-ac61-4a22-b43d-88ec8cd0036b None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:29.146314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ca912-ac61-4a22-b43d-88ec8cd0036b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:29.146314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ca912-ac61-4a22-b43d-88ec8cd0036b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:29.147444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ca912-ac61-4a22-b43d-88ec8cd0036b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:29.155569 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 514/1032] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Apr 6 10:50:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:29.161274 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ca912-ac61-4a22-b43d-88ec8cd0036b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:29.242064 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeb591-10ae-4736-854f-906a49e721f3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:29.259989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ca912-ac61-4a22-b43d-88ec8cd0036b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:29.276978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18291fdb-3896-4163-abd9-b52bcbf84558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:29.277924 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18291fdb-3896-4163-abd9-b52bcbf84558 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:29.278380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18291fdb-3896-4163-abd9-b52bcbf84558 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:29.278826 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18291fdb-3896-4163-abd9-b52bcbf84558 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:29.279725 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18291fdb-3896-4163-abd9-b52bcbf84558 None admin] RBAC: Adding query filter params (type=image) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:29.280201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18291fdb-3896-4163-abd9-b52bcbf84558 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:29.281740 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18291fdb-3896-4163-abd9-b52bcbf84558 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:29.286908 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 519/1033] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:29.293002 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18291fdb-3896-4163-abd9-b52bcbf84558 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:29.293524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5399-9522-461a-89be-309bc33d9c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:29.294332 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5399-9522-461a-89be-309bc33d9c94 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:29.294613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5399-9522-461a-89be-309bc33d9c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:29.294888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5399-9522-461a-89be-309bc33d9c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:29.307191 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df5399-9522-461a-89be-309bc33d9c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:29.308718 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df5399-9522-461a-89be-309bc33d9c94 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:29.325817 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-83df5399-9522-461a-89be-309bc33d9c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:29.327153 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 515/1034] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:29.332547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5399-9522-461a-89be-309bc33d9c94 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:29.395555 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18291fdb-3896-4163-abd9-b52bcbf84558 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:29.429121 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11608d1b-8f2a-4e84-b25e-ba3754db8705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:29.429784 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11608d1b-8f2a-4e84-b25e-ba3754db8705 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:29.433074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11608d1b-8f2a-4e84-b25e-ba3754db8705 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:29.433074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11608d1b-8f2a-4e84-b25e-ba3754db8705 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:29.433074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11608d1b-8f2a-4e84-b25e-ba3754db8705 None admin] RBAC: Adding query filter params (interface=public, service_id=7fd09831d5954e49b0e3eba4e10a5baa, region_id=RegionOne) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:29.433074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11608d1b-8f2a-4e84-b25e-ba3754db8705 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:29.433074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11608d1b-8f2a-4e84-b25e-ba3754db8705 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:29.435516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5399-9522-461a-89be-309bc33d9c94 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:29.438119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 520/1035] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Apr 6 10:50:29 2022] GET /identity/v3/endpoints?service_id=7fd09831d5954e49b0e3eba4e10a5baa&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:29.443405 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11608d1b-8f2a-4e84-b25e-ba3754db8705 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:29.470319 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bf9a6-f948-475e-b012-4e111d548c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:29.472678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bf9a6-f948-475e-b012-4e111d548c0b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:29.472678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bf9a6-f948-475e-b012-4e111d548c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:29.472678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bf9a6-f948-475e-b012-4e111d548c0b None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:29.472678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bf9a6-f948-475e-b012-4e111d548c0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:29.472678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bf9a6-f948-475e-b012-4e111d548c0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:29.474096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bf9a6-f948-475e-b012-4e111d548c0b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:29.486290 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 516/1036] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:29.492370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bf9a6-f948-475e-b012-4e111d548c0b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:29.541345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11608d1b-8f2a-4e84-b25e-ba3754db8705 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:29.577300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b13bf-b9e7-46b7-b8d0-e21878cc3343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:29.577972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b13bf-b9e7-46b7-b8d0-e21878cc3343 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:29.578255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b13bf-b9e7-46b7-b8d0-e21878cc3343 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:29.578528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b13bf-b9e7-46b7-b8d0-e21878cc3343 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:29.579206 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b13bf-b9e7-46b7-b8d0-e21878cc3343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:29.580562 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b13bf-b9e7-46b7-b8d0-e21878cc3343 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:29.597304 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 521/1037] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Apr 6 10:50:29 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:50:29.597531 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bf9a6-f948-475e-b012-4e111d548c0b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:29.624000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7103b-c333-4a1b-8984-5f1cea04cb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:29.624809 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7103b-c333-4a1b-8984-5f1cea04cb67 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:29.625115 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7103b-c333-4a1b-8984-5f1cea04cb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:29.625398 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7103b-c333-4a1b-8984-5f1cea04cb67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:29.634039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7103b-c333-4a1b-8984-5f1cea04cb67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:29.635559 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7103b-c333-4a1b-8984-5f1cea04cb67 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:29.650340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-a8f7103b-c333-4a1b-8984-5f1cea04cb67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 10:50:29.652027 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 517/1038] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Apr 6 10:50:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:29.657846 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b13bf-b9e7-46b7-b8d0-e21878cc3343 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:29.763682 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b13bf-b9e7-46b7-b8d0-e21878cc3343 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:29.797358 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d832f-9c64-46fb-8bb2-3260ae570a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:29.798040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d832f-9c64-46fb-8bb2-3260ae570a84 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:29.798324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d832f-9c64-46fb-8bb2-3260ae570a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:29.798611 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d832f-9c64-46fb-8bb2-3260ae570a84 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:29.799436 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d832f-9c64-46fb-8bb2-3260ae570a84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:29.799747 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d832f-9c64-46fb-8bb2-3260ae570a84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:29.801214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d832f-9c64-46fb-8bb2-3260ae570a84 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:29.819826 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 522/1039] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Apr 6 10:50:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:29.825796 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7103b-c333-4a1b-8984-5f1cea04cb67 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:29.920178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7103b-c333-4a1b-8984-5f1cea04cb67 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:29.952739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc891b-3d0c-45b4-98db-56db3b896e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:29.953411 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc891b-3d0c-45b4-98db-56db3b896e93 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:29.953694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc891b-3d0c-45b4-98db-56db3b896e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:29.953968 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc891b-3d0c-45b4-98db-56db3b896e93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:30.017572 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc891b-3d0c-45b4-98db-56db3b896e93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:30.018990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc891b-3d0c-45b4-98db-56db3b896e93 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:30.118723 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 518/1040] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:50:29 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 06 10:50:30.119894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d832f-9c64-46fb-8bb2-3260ae570a84 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:30.216612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d832f-9c64-46fb-8bb2-3260ae570a84 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:30.248839 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a07a1-a63f-4748-9b2a-333c80eb3068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:30.249660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a07a1-a63f-4748-9b2a-333c80eb3068 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:30.249943 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a07a1-a63f-4748-9b2a-333c80eb3068 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:30.250216 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a07a1-a63f-4748-9b2a-333c80eb3068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:30.260171 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a07a1-a63f-4748-9b2a-333c80eb3068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:30.261644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a07a1-a63f-4748-9b2a-333c80eb3068 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:30.278675 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-e10a07a1-a63f-4748-9b2a-333c80eb3068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:30.280003 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 523/1041] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:30.285697 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc891b-3d0c-45b4-98db-56db3b896e93 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:30.386240 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc891b-3d0c-45b4-98db-56db3b896e93 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:30.422604 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa0c3c-e1b5-4c3f-bfb3-1a6cb5a308c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:30.423266 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa0c3c-e1b5-4c3f-bfb3-1a6cb5a308c2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:30.423549 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa0c3c-e1b5-4c3f-bfb3-1a6cb5a308c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:30.423823 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa0c3c-e1b5-4c3f-bfb3-1a6cb5a308c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:30.424541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa0c3c-e1b5-4c3f-bfb3-1a6cb5a308c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:30.424847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa0c3c-e1b5-4c3f-bfb3-1a6cb5a308c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:30.426322 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa0c3c-e1b5-4c3f-bfb3-1a6cb5a308c2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:30.442764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 519/1042] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:30.444052 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a07a1-a63f-4748-9b2a-333c80eb3068 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:30.545500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a07a1-a63f-4748-9b2a-333c80eb3068 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:30.582594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3a789-0071-4323-8022-a09583d3ad8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:30.583394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3a789-0071-4323-8022-a09583d3ad8d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:30.583678 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3a789-0071-4323-8022-a09583d3ad8d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:30.584013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3a789-0071-4323-8022-a09583d3ad8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:30.590922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3a789-0071-4323-8022-a09583d3ad8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:30.592362 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3a789-0071-4323-8022-a09583d3ad8d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:30.605954 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-84f3a789-0071-4323-8022-a09583d3ad8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:50:30.607376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 524/1043] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:50:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:30.612886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa0c3c-e1b5-4c3f-bfb3-1a6cb5a308c2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:30.714457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa0c3c-e1b5-4c3f-bfb3-1a6cb5a308c2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:30.757019 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2812be-ebaa-454f-979d-c6c48b5bcee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:30.758173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2812be-ebaa-454f-979d-c6c48b5bcee6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:30.758874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2812be-ebaa-454f-979d-c6c48b5bcee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:30.759370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2812be-ebaa-454f-979d-c6c48b5bcee6 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:30.760874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2812be-ebaa-454f-979d-c6c48b5bcee6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:30.761446 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2812be-ebaa-454f-979d-c6c48b5bcee6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:30.764288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2812be-ebaa-454f-979d-c6c48b5bcee6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:30.778343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 520/1044] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:50:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:30.784095 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3a789-0071-4323-8022-a09583d3ad8d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:30.887099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3a789-0071-4323-8022-a09583d3ad8d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:30.918506 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1a1b9-a4ca-421f-b470-8c70c7f11276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:30.919165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1a1b9-a4ca-421f-b470-8c70c7f11276 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:30.919444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1a1b9-a4ca-421f-b470-8c70c7f11276 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:30.919715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1a1b9-a4ca-421f-b470-8c70c7f11276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:30.919887 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2f307-983d-4904-98f8-5d637da28038 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:30.920147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2f307-983d-4904-98f8-5d637da28038 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:30.920423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2f307-983d-4904-98f8-5d637da28038 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:30.920518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1a1b9-a4ca-421f-b470-8c70c7f11276 None admin] RBAC: Adding query filter params (role.id=2a2949c54fe047d5970c08741cf8fffe, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=650c5809116e4bcd808044236c06dcc2) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:30.920830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1a1b9-a4ca-421f-b470-8c70c7f11276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:30.921941 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 521/1045] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:50:30.922335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1a1b9-a4ca-421f-b470-8c70c7f11276 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:30.926478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d73a7-24e5-4639-ad26-73a2d8373b4d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:30.926759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d73a7-24e5-4639-ad26-73a2d8373b4d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:30.927032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d73a7-24e5-4639-ad26-73a2d8373b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:30.937465 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 525/1046] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:50:30 2022] GET /identity/v3/role_assignments?user.id=650c5809116e4bcd808044236c06dcc2&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=2a2949c54fe047d5970c08741cf8fffe => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:30.954035 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-276d73a7-24e5-4639-ad26-73a2d8373b4d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:30.955283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-276d73a7-24e5-4639-ad26-73a2d8373b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:31.024739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 522/1047] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:31.050262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1a1b9-a4ca-421f-b470-8c70c7f11276 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:31.151118 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1a1b9-a4ca-421f-b470-8c70c7f11276 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:31.184223 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31d976-0623-47fe-8c01-3cbcae58948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:31.185026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31d976-0623-47fe-8c01-3cbcae58948b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:31.185535 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31d976-0623-47fe-8c01-3cbcae58948b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:31.185813 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31d976-0623-47fe-8c01-3cbcae58948b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:31.195895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31d976-0623-47fe-8c01-3cbcae58948b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:50:31.202840 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-ed31d976-0623-47fe-8c01-3cbcae58948b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:50:31.204076 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 526/1048] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:50:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:31.210165 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d73a7-24e5-4639-ad26-73a2d8373b4d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:31.303391 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d73a7-24e5-4639-ad26-73a2d8373b4d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:31.335113 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bc635-9a35-4ce1-929c-e846bd5538e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:31.335784 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bc635-9a35-4ce1-929c-e846bd5538e8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:31.336090 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bc635-9a35-4ce1-929c-e846bd5538e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:31.336361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bc635-9a35-4ce1-929c-e846bd5538e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:31.337116 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bc635-9a35-4ce1-929c-e846bd5538e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:31.337418 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bc635-9a35-4ce1-929c-e846bd5538e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:31.338829 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bc635-9a35-4ce1-929c-e846bd5538e8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:31.346940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 523/1049] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:50:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:31.352887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31d976-0623-47fe-8c01-3cbcae58948b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:31.447380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31d976-0623-47fe-8c01-3cbcae58948b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:31.479130 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d988d8e-65d0-43d8-90c8-1e86e08d2fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:31.480004 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d988d8e-65d0-43d8-90c8-1e86e08d2fcb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:31.480282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d988d8e-65d0-43d8-90c8-1e86e08d2fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:31.480551 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d988d8e-65d0-43d8-90c8-1e86e08d2fcb None admin] PATH_INFO: `/v3/users/4c4b55005fa04010b093c02682065222` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:31.494745 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d988d8e-65d0-43d8-90c8-1e86e08d2fcb None admin] RBAC: Authorizing `identity:get_user(user_id=4c4b55005fa04010b093c02682065222)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:31.496161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d988d8e-65d0-43d8-90c8-1e86e08d2fcb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:31.498019 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 527/1050] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:50:31 2022] GET /identity/v3/users/4c4b55005fa04010b093c02682065222 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:31.503493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bc635-9a35-4ce1-929c-e846bd5538e8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:31.602814 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bc635-9a35-4ce1-929c-e846bd5538e8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:31.634194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7b5ec-cb12-4ee7-9125-bd7065186114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:31.634845 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7b5ec-cb12-4ee7-9125-bd7065186114 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:31.635125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7b5ec-cb12-4ee7-9125-bd7065186114 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:31.635399 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7b5ec-cb12-4ee7-9125-bd7065186114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:31.703666 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7b5ec-cb12-4ee7-9125-bd7065186114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:31.705134 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7b5ec-cb12-4ee7-9125-bd7065186114 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:31.804010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 524/1051] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:50:31 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:50:31.805261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d988d8e-65d0-43d8-90c8-1e86e08d2fcb None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:31.901099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d988d8e-65d0-43d8-90c8-1e86e08d2fcb None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:31.908497 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b67eee-957f-4c7f-b7a6-32b122b0dc32 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:31.908782 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b67eee-957f-4c7f-b7a6-32b122b0dc32 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:31.909085 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b67eee-957f-4c7f-b7a6-32b122b0dc32 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:31.910457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 525/1052] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:50:31.915937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b17ab-0041-4f46-b0ae-6adcaba37d46 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:31.916221 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b17ab-0041-4f46-b0ae-6adcaba37d46 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:31.916531 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b17ab-0041-4f46-b0ae-6adcaba37d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:31.932451 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-068b17ab-0041-4f46-b0ae-6adcaba37d46 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:31.933667 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-068b17ab-0041-4f46-b0ae-6adcaba37d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:31.934741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c5798-1363-4db8-91c6-6d00385d71e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:31.935608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c5798-1363-4db8-91c6-6d00385d71e2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:31.935892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c5798-1363-4db8-91c6-6d00385d71e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:31.936168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c5798-1363-4db8-91c6-6d00385d71e2 None admin] PATH_INFO: `/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:31.937628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c5798-1363-4db8-91c6-6d00385d71e2 None admin] RBAC: Authorizing `identity:get_project(project_id=ea8db386dc9844f29cf44b1c6f0ce86f)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:31.939054 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c5798-1363-4db8-91c6-6d00385d71e2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:31.940935 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 528/1053] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:50:31 2022] GET /identity/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:31.947187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c5798-1363-4db8-91c6-6d00385d71e2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:32.000488 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 526/1054] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:32.025280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b17ab-0041-4f46-b0ae-6adcaba37d46 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:32.047570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c5798-1363-4db8-91c6-6d00385d71e2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:32.081429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce534c27-fe8e-4937-a77e-cd45d560daf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:32.082087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534c27-fe8e-4937-a77e-cd45d560daf5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:32.082370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534c27-fe8e-4937-a77e-cd45d560daf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:32.082648 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534c27-fe8e-4937-a77e-cd45d560daf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:32.083468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce534c27-fe8e-4937-a77e-cd45d560daf5 None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=ea8db386dc9844f29cf44b1c6f0ce86f, user.id=4c4b55005fa04010b093c02682065222) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:32.083883 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce534c27-fe8e-4937-a77e-cd45d560daf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:32.085834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce534c27-fe8e-4937-a77e-cd45d560daf5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:32.101337 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 529/1055] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:50:31 2022] GET /identity/v3/role_assignments?user.id=4c4b55005fa04010b093c02682065222&scope.project.id=ea8db386dc9844f29cf44b1c6f0ce86f&role.id=090ba4d1ae32495289276665920d4a2c => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:32.134314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b17ab-0041-4f46-b0ae-6adcaba37d46 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:32.169844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aabee9-b875-4ee7-97cf-d9c887786e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:32.170657 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aabee9-b875-4ee7-97cf-d9c887786e1a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:32.170938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aabee9-b875-4ee7-97cf-d9c887786e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:32.171209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aabee9-b875-4ee7-97cf-d9c887786e1a None admin] PATH_INFO: `/v3/services/image` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:32.171876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aabee9-b875-4ee7-97cf-d9c887786e1a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:32.173389 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aabee9-b875-4ee7-97cf-d9c887786e1a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:32.184854 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-a0aabee9-b875-4ee7-97cf-d9c887786e1a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 06 10:50:32.191273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 527/1056] 10.222.0.62 () {56 vars in 1105 bytes} [Wed Apr 6 10:50:32 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:32.192641 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce534c27-fe8e-4937-a77e-cd45d560daf5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:32.297197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce534c27-fe8e-4937-a77e-cd45d560daf5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:32.331543 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c79c4-59da-47e2-b179-6d8db78fd6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:32.332211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c79c4-59da-47e2-b179-6d8db78fd6dc None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:32.332500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c79c4-59da-47e2-b179-6d8db78fd6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:32.332776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c79c4-59da-47e2-b179-6d8db78fd6dc None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:32.333504 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c79c4-59da-47e2-b179-6d8db78fd6dc None admin] RBAC: Adding query filter params (name=image) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:32.334329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c79c4-59da-47e2-b179-6d8db78fd6dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:32.335680 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c79c4-59da-47e2-b179-6d8db78fd6dc None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:32.345011 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 530/1057] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:32.346236 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aabee9-b875-4ee7-97cf-d9c887786e1a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:32.441709 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aabee9-b875-4ee7-97cf-d9c887786e1a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:32.473719 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03010de2-5aea-4fd4-85cb-6814b7f27305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:32.474443 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03010de2-5aea-4fd4-85cb-6814b7f27305 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:32.475218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03010de2-5aea-4fd4-85cb-6814b7f27305 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:32.475493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03010de2-5aea-4fd4-85cb-6814b7f27305 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:32.476192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03010de2-5aea-4fd4-85cb-6814b7f27305 None admin] RBAC: Adding query filter params (type=image) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:32.476504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03010de2-5aea-4fd4-85cb-6814b7f27305 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:32.477945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03010de2-5aea-4fd4-85cb-6814b7f27305 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:32.482973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 528/1058] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:32.488451 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c79c4-59da-47e2-b179-6d8db78fd6dc None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:32.583452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c79c4-59da-47e2-b179-6d8db78fd6dc None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:32.616991 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbda08-757d-4c58-a7f1-32ae93b8c1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:32.617679 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbda08-757d-4c58-a7f1-32ae93b8c1c1 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:32.617963 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbda08-757d-4c58-a7f1-32ae93b8c1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:32.618237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbda08-757d-4c58-a7f1-32ae93b8c1c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:32.618979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbda08-757d-4c58-a7f1-32ae93b8c1c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:32.620332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbda08-757d-4c58-a7f1-32ae93b8c1c1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:32.715520 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 531/1059] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Apr 6 10:50:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:50:33.238986 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f5c7c-b8ec-475a-8bd8-c2c2bc478f8c None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:33.239347 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f5c7c-b8ec-475a-8bd8-c2c2bc478f8c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:33.239554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f5c7c-b8ec-475a-8bd8-c2c2bc478f8c None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:33.241166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 529/1060] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:33.246491 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104765-9406-48af-9616-58cf98e070c7 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:33.246940 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104765-9406-48af-9616-58cf98e070c7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:33.247036 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104765-9406-48af-9616-58cf98e070c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:33.263416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-95104765-9406-48af-9616-58cf98e070c7 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:33.264597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-95104765-9406-48af-9616-58cf98e070c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:33.333089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 532/1061] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:33.356376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f5c7c-b8ec-475a-8bd8-c2c2bc478f8c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:33.456381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f5c7c-b8ec-475a-8bd8-c2c2bc478f8c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:33.490962 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0af5f-3d5e-4c9a-bcde-3d2e360df5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:33.491702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0af5f-3d5e-4c9a-bcde-3d2e360df5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:33.491986 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0af5f-3d5e-4c9a-bcde-3d2e360df5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:33.492262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0af5f-3d5e-4c9a-bcde-3d2e360df5c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:33.502697 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0af5f-3d5e-4c9a-bcde-3d2e360df5c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:50:33.510163 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-baa0af5f-3d5e-4c9a-bcde-3d2e360df5c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 10:50:33.511541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 530/1062] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Apr 6 10:50:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:33.518786 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95104765-9406-48af-9616-58cf98e070c7 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:33.614350 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95104765-9406-48af-9616-58cf98e070c7 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:33.648809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a33a0-b504-426f-9903-d80b645935aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:33.652028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a33a0-b504-426f-9903-d80b645935aa None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:33.652028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a33a0-b504-426f-9903-d80b645935aa None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:33.652028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a33a0-b504-426f-9903-d80b645935aa None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:33.652028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a33a0-b504-426f-9903-d80b645935aa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:33.652028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a33a0-b504-426f-9903-d80b645935aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:33.652429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a33a0-b504-426f-9903-d80b645935aa None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:33.666837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 533/1063] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Apr 6 10:50:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:33.668533 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0af5f-3d5e-4c9a-bcde-3d2e360df5c4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:33.768964 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0af5f-3d5e-4c9a-bcde-3d2e360df5c4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:33.804417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea95514-6582-4068-8b19-77778f9e1112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:33.805242 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea95514-6582-4068-8b19-77778f9e1112 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:33.805522 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea95514-6582-4068-8b19-77778f9e1112 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:33.805792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea95514-6582-4068-8b19-77778f9e1112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:33.815844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea95514-6582-4068-8b19-77778f9e1112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:33.817355 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea95514-6582-4068-8b19-77778f9e1112 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:33.834421 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-aea95514-6582-4068-8b19-77778f9e1112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:33.835822 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 531/1064] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:33.841305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a33a0-b504-426f-9903-d80b645935aa None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:33.938004 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a33a0-b504-426f-9903-d80b645935aa None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:33.969720 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaf42f-2333-4b52-a4ac-afa23583d9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:33.970385 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaf42f-2333-4b52-a4ac-afa23583d9be None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:33.970664 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaf42f-2333-4b52-a4ac-afa23583d9be None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:33.970935 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaf42f-2333-4b52-a4ac-afa23583d9be None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:33.971648 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdaf42f-2333-4b52-a4ac-afa23583d9be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:33.971951 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdaf42f-2333-4b52-a4ac-afa23583d9be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:33.973329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdaf42f-2333-4b52-a4ac-afa23583d9be None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:33.989156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 534/1065] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:33.991365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea95514-6582-4068-8b19-77778f9e1112 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:34.091803 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea95514-6582-4068-8b19-77778f9e1112 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:34.124601 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7ef64-4b7a-4a83-b831-766f106f7c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:34.125418 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7ef64-4b7a-4a83-b831-766f106f7c23 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:34.125702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7ef64-4b7a-4a83-b831-766f106f7c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:34.125976 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7ef64-4b7a-4a83-b831-766f106f7c23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:34.132773 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7ef64-4b7a-4a83-b831-766f106f7c23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:34.134275 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7ef64-4b7a-4a83-b831-766f106f7c23 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:34.148226 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-17e7ef64-4b7a-4a83-b831-766f106f7c23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 10:50:34.154137 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 532/1066] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Apr 6 10:50:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:34.155487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaf42f-2333-4b52-a4ac-afa23583d9be None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:34.249663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaf42f-2333-4b52-a4ac-afa23583d9be None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:34.282990 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6aed2-d41c-4ed1-a0a0-75d0c5a48368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:34.283668 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6aed2-d41c-4ed1-a0a0-75d0c5a48368 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:34.283947 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6aed2-d41c-4ed1-a0a0-75d0c5a48368 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:34.284218 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6aed2-d41c-4ed1-a0a0-75d0c5a48368 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:34.285048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6aed2-d41c-4ed1-a0a0-75d0c5a48368 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:34.285410 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6aed2-d41c-4ed1-a0a0-75d0c5a48368 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:34.286862 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6aed2-d41c-4ed1-a0a0-75d0c5a48368 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:34.304206 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 535/1067] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Apr 6 10:50:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:34.309932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7ef64-4b7a-4a83-b831-766f106f7c23 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:34.404464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7ef64-4b7a-4a83-b831-766f106f7c23 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:34.405231 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84013-71b2-405c-86fd-35c3b55070fd None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:34.405351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84013-71b2-405c-86fd-35c3b55070fd None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:34.405582 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84013-71b2-405c-86fd-35c3b55070fd None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:34.406959 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 536/1068] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:50:34.412099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e84d07-8e93-4bfe-ab22-e3fe4d16dd3a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:34.412392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e84d07-8e93-4bfe-ab22-e3fe4d16dd3a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:34.412670 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e84d07-8e93-4bfe-ab22-e3fe4d16dd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:34.428894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-72e84d07-8e93-4bfe-ab22-e3fe4d16dd3a None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:34.430107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-72e84d07-8e93-4bfe-ab22-e3fe4d16dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:34.440410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8994c51-17b1-4abf-ba67-229ea6f965b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:34.441411 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8994c51-17b1-4abf-ba67-229ea6f965b1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:34.441839 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8994c51-17b1-4abf-ba67-229ea6f965b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:34.442274 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8994c51-17b1-4abf-ba67-229ea6f965b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:34.452848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8994c51-17b1-4abf-ba67-229ea6f965b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:34.454537 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8994c51-17b1-4abf-ba67-229ea6f965b1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:34.471863 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-c8994c51-17b1-4abf-ba67-229ea6f965b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:34.473328 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 533/1069] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:34.478793 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8994c51-17b1-4abf-ba67-229ea6f965b1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:34.495925 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 537/1070] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:34.518372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e84d07-8e93-4bfe-ab22-e3fe4d16dd3a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:34.578669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8994c51-17b1-4abf-ba67-229ea6f965b1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:34.612790 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed84f1d-dc66-441e-ac22-d9f39059fe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:34.613474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed84f1d-dc66-441e-ac22-d9f39059fe99 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:34.613756 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed84f1d-dc66-441e-ac22-d9f39059fe99 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:34.614044 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed84f1d-dc66-441e-ac22-d9f39059fe99 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:34.614476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e84d07-8e93-4bfe-ab22-e3fe4d16dd3a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:34.614860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed84f1d-dc66-441e-ac22-d9f39059fe99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:34.615680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed84f1d-dc66-441e-ac22-d9f39059fe99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:34.617111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed84f1d-dc66-441e-ac22-d9f39059fe99 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:34.628410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 534/1071] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:34.634402 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed84f1d-dc66-441e-ac22-d9f39059fe99 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:34.658040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf6131-0910-46e5-9345-ba19424d316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:34.659131 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf6131-0910-46e5-9345-ba19424d316a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:34.659411 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf6131-0910-46e5-9345-ba19424d316a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:34.659684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf6131-0910-46e5-9345-ba19424d316a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:34.674212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf6131-0910-46e5-9345-ba19424d316a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:50:34.681643 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-a0bf6131-0910-46e5-9345-ba19424d316a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:50:34.689782 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 538/1072] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:50:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:34.690780 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf6131-0910-46e5-9345-ba19424d316a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:34.735795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed84f1d-dc66-441e-ac22-d9f39059fe99 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:34.768867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebd645-3d15-4f31-b709-9e35b3efbe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:34.769688 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebd645-3d15-4f31-b709-9e35b3efbe5e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:34.769968 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebd645-3d15-4f31-b709-9e35b3efbe5e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:34.770248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebd645-3d15-4f31-b709-9e35b3efbe5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:34.776900 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebd645-3d15-4f31-b709-9e35b3efbe5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:34.778422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebd645-3d15-4f31-b709-9e35b3efbe5e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:34.787205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf6131-0910-46e5-9345-ba19424d316a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:34.792746 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-b2ebd645-3d15-4f31-b709-9e35b3efbe5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:50:34.794155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 535/1073] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:50:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:34.799531 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebd645-3d15-4f31-b709-9e35b3efbe5e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:34.822274 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f338e-268a-4a74-9d7a-db518af04a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:34.822946 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f338e-268a-4a74-9d7a-db518af04a5a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:34.823223 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f338e-268a-4a74-9d7a-db518af04a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:34.823492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f338e-268a-4a74-9d7a-db518af04a5a None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:34.824225 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f338e-268a-4a74-9d7a-db518af04a5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:34.824529 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f338e-268a-4a74-9d7a-db518af04a5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:34.825915 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f338e-268a-4a74-9d7a-db518af04a5a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:34.834316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 539/1074] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:50:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:34.839866 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f338e-268a-4a74-9d7a-db518af04a5a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:34.901340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebd645-3d15-4f31-b709-9e35b3efbe5e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:34.934609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148ba25-ede1-4384-857d-a73b7e8c9808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:34.935170 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148ba25-ede1-4384-857d-a73b7e8c9808 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:34.935452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148ba25-ede1-4384-857d-a73b7e8c9808 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:34.935739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148ba25-ede1-4384-857d-a73b7e8c9808 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:34.936745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148ba25-ede1-4384-857d-a73b7e8c9808 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:34.937067 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148ba25-ede1-4384-857d-a73b7e8c9808 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:34.938555 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148ba25-ede1-4384-857d-a73b7e8c9808 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:34.939826 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f338e-268a-4a74-9d7a-db518af04a5a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:34.950734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 536/1075] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:50:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:34.956295 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148ba25-ede1-4384-857d-a73b7e8c9808 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:34.974032 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df94b5-5173-4fca-b7ec-16517a476ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:34.974934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df94b5-5173-4fca-b7ec-16517a476ddb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:34.975212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df94b5-5173-4fca-b7ec-16517a476ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:34.975481 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df94b5-5173-4fca-b7ec-16517a476ddb None admin] PATH_INFO: `/v3/users/4c4b55005fa04010b093c02682065222` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:34.976669 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df94b5-5173-4fca-b7ec-16517a476ddb None admin] RBAC: Authorizing `identity:get_user(user_id=4c4b55005fa04010b093c02682065222)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:34.978114 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df94b5-5173-4fca-b7ec-16517a476ddb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:34.984270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 540/1076] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:50:34 2022] GET /identity/v3/users/4c4b55005fa04010b093c02682065222 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:34.985233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df94b5-5173-4fca-b7ec-16517a476ddb None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:35.051132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148ba25-ede1-4384-857d-a73b7e8c9808 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:35.080406 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df94b5-5173-4fca-b7ec-16517a476ddb None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:35.083450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca1b84-ab72-4d2c-b48c-395aa1a21e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:35.084956 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca1b84-ab72-4d2c-b48c-395aa1a21e71 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:35.085292 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca1b84-ab72-4d2c-b48c-395aa1a21e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:35.085567 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca1b84-ab72-4d2c-b48c-395aa1a21e71 None admin] PATH_INFO: `/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/650c5809116e4bcd808044236c06dcc2/roles/2a2949c54fe047d5970c08741cf8fffe` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:35.087778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca1b84-ab72-4d2c-b48c-395aa1a21e71 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4306a6b12434cc495650e4f3b9afbde, user_id=650c5809116e4bcd808044236c06dcc2, role_id=2a2949c54fe047d5970c08741cf8fffe)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:35.089267 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca1b84-ab72-4d2c-b48c-395aa1a21e71 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:35.112960 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7db8b-c148-4664-9728-41ba0e2b9120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:35.113841 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7db8b-c148-4664-9728-41ba0e2b9120 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:35.114117 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7db8b-c148-4664-9728-41ba0e2b9120 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:35.114388 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7db8b-c148-4664-9728-41ba0e2b9120 None admin] PATH_INFO: `/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:35.115634 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7db8b-c148-4664-9728-41ba0e2b9120 None admin] RBAC: Authorizing `identity:get_project(project_id=ea8db386dc9844f29cf44b1c6f0ce86f)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:35.117042 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7db8b-c148-4664-9728-41ba0e2b9120 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:35.118816 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 541/1077] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:50:34 2022] GET /identity/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:35.119925 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cdf9f-bfcc-451f-bc05-8712345448ab None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:35.120206 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cdf9f-bfcc-451f-bc05-8712345448ab None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:35.120477 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cdf9f-bfcc-451f-bc05-8712345448ab None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:35.121706 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 542/1078] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:35.124719 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cdf9f-bfcc-451f-bc05-8712345448ab None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:35.187409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 537/1079] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:50:34 2022] PUT /identity/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/650c5809116e4bcd808044236c06dcc2/roles/2a2949c54fe047d5970c08741cf8fffe => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:50:35.188729 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be475da2-4d79-4478-8dd4-bf757b1f1550 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:35.189020 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be475da2-4d79-4478-8dd4-bf757b1f1550 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:35.189343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be475da2-4d79-4478-8dd4-bf757b1f1550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:35.207132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-be475da2-4d79-4478-8dd4-bf757b1f1550 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:35.208365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-be475da2-4d79-4478-8dd4-bf757b1f1550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:35.225630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cdf9f-bfcc-451f-bc05-8712345448ab None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:35.263108 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535666eb-6114-412a-a4d1-b0e45aa65cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:35.263967 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535666eb-6114-412a-a4d1-b0e45aa65cd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:35.264163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535666eb-6114-412a-a4d1-b0e45aa65cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:35.264404 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535666eb-6114-412a-a4d1-b0e45aa65cd1 None admin] PATH_INFO: `/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f/users/4c4b55005fa04010b093c02682065222/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:35.266553 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535666eb-6114-412a-a4d1-b0e45aa65cd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea8db386dc9844f29cf44b1c6f0ce86f, user_id=4c4b55005fa04010b093c02682065222, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:35.268018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535666eb-6114-412a-a4d1-b0e45aa65cd1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:35.280361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 538/1080] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:35.303735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be475da2-4d79-4478-8dd4-bf757b1f1550 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:35.330756 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 543/1081] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:50:35 2022] PUT /identity/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f/users/4c4b55005fa04010b093c02682065222/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:50:35.412901 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be475da2-4d79-4478-8dd4-bf757b1f1550 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:35.450338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab366f7-8317-43c2-a52e-6781f3f7ae30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:35.450921 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab366f7-8317-43c2-a52e-6781f3f7ae30 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:35.451200 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab366f7-8317-43c2-a52e-6781f3f7ae30 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:35.451472 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab366f7-8317-43c2-a52e-6781f3f7ae30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:35.522559 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab366f7-8317-43c2-a52e-6781f3f7ae30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:35.524046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab366f7-8317-43c2-a52e-6781f3f7ae30 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:35.621862 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 539/1082] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:50:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 06 10:50:35.629197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535666eb-6114-412a-a4d1-b0e45aa65cd1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:35.731049 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535666eb-6114-412a-a4d1-b0e45aa65cd1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:35.763235 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d78fd-e899-4990-908b-8a90fd3db71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:35.768693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d78fd-e899-4990-908b-8a90fd3db71a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:35.768693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d78fd-e899-4990-908b-8a90fd3db71a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:35.768693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d78fd-e899-4990-908b-8a90fd3db71a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:35.774351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d78fd-e899-4990-908b-8a90fd3db71a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:35.775825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d78fd-e899-4990-908b-8a90fd3db71a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:35.792855 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-467d78fd-e899-4990-908b-8a90fd3db71a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:35.794242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 544/1083] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:35.799972 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab366f7-8317-43c2-a52e-6781f3f7ae30 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:35.895820 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab366f7-8317-43c2-a52e-6781f3f7ae30 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:35.928809 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f133c5-f44f-42b7-97e5-218b09c58c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:35.929495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f133c5-f44f-42b7-97e5-218b09c58c2b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:35.929777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f133c5-f44f-42b7-97e5-218b09c58c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:35.930051 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f133c5-f44f-42b7-97e5-218b09c58c2b None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:35.930768 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f133c5-f44f-42b7-97e5-218b09c58c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:35.931071 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f133c5-f44f-42b7-97e5-218b09c58c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:35.932466 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f133c5-f44f-42b7-97e5-218b09c58c2b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:35.943645 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 540/1084] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:37.550511 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954844a-12ba-4a6f-a5e4-d2c2a835eb82 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:37.551143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954844a-12ba-4a6f-a5e4-d2c2a835eb82 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:37.551143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954844a-12ba-4a6f-a5e4-d2c2a835eb82 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:37.552918 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 545/1085] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:37.558015 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed5c3b-a036-4239-b2de-ade79a794b4e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:37.558481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed5c3b-a036-4239-b2de-ade79a794b4e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:37.558581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed5c3b-a036-4239-b2de-ade79a794b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:37.575620 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-34ed5c3b-a036-4239-b2de-ade79a794b4e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:37.576801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-34ed5c3b-a036-4239-b2de-ade79a794b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:37.639786 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 541/1086] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:37.664222 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954844a-12ba-4a6f-a5e4-d2c2a835eb82 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:37.673745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0cf8d-e207-4c66-88c9-301319fe1234 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:37.673942 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0cf8d-e207-4c66-88c9-301319fe1234 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:37.674218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0cf8d-e207-4c66-88c9-301319fe1234 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:37.675844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 542/1087] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:37.680960 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1559d-2edf-4c80-b33f-9c213963a850 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:37.681269 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1559d-2edf-4c80-b33f-9c213963a850 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:37.681547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1559d-2edf-4c80-b33f-9c213963a850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:37.698117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f3e1559d-2edf-4c80-b33f-9c213963a850 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:37.699283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f3e1559d-2edf-4c80-b33f-9c213963a850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:37.764096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 543/1088] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:37.766610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954844a-12ba-4a6f-a5e4-d2c2a835eb82 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:37.787785 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1559d-2edf-4c80-b33f-9c213963a850 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:37.799570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14a36e-6828-479f-86aa-182217c16c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:37.800376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14a36e-6828-479f-86aa-182217c16c93 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:37.800713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14a36e-6828-479f-86aa-182217c16c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:37.800935 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14a36e-6828-479f-86aa-182217c16c93 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:37.811204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14a36e-6828-479f-86aa-182217c16c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:50:37.819613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-6a14a36e-6828-479f-86aa-182217c16c93 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 10:50:37.821085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 546/1089] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Apr 6 10:50:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:37.827052 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14a36e-6828-479f-86aa-182217c16c93 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:37.880080 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1559d-2edf-4c80-b33f-9c213963a850 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:37.911460 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf1b0d-811d-42a2-9d19-ecb60ae99c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:37.912815 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf1b0d-811d-42a2-9d19-ecb60ae99c76 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:37.913120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf1b0d-811d-42a2-9d19-ecb60ae99c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:37.913394 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf1b0d-811d-42a2-9d19-ecb60ae99c76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:37.919288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14a36e-6828-479f-86aa-182217c16c93 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:37.922890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf1b0d-811d-42a2-9d19-ecb60ae99c76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:50:37.929764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-34cf1b0d-811d-42a2-9d19-ecb60ae99c76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:50:37.930946 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 544/1090] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:50:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:37.936896 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf1b0d-811d-42a2-9d19-ecb60ae99c76 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:37.951672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5bfcc-1af7-4f7a-9e17-b9b7f8dabde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:37.952337 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5bfcc-1af7-4f7a-9e17-b9b7f8dabde3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:37.952614 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5bfcc-1af7-4f7a-9e17-b9b7f8dabde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:37.952886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5bfcc-1af7-4f7a-9e17-b9b7f8dabde3 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:37.953645 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5bfcc-1af7-4f7a-9e17-b9b7f8dabde3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:37.953950 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5bfcc-1af7-4f7a-9e17-b9b7f8dabde3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:37.955304 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5bfcc-1af7-4f7a-9e17-b9b7f8dabde3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:37.966496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 547/1091] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Apr 6 10:50:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:37.968601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5bfcc-1af7-4f7a-9e17-b9b7f8dabde3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:38.033752 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf1b0d-811d-42a2-9d19-ecb60ae99c76 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:38.059964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5bfcc-1af7-4f7a-9e17-b9b7f8dabde3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:38.065988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64480b-b522-414c-8cef-b5a58af3dbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:38.066651 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64480b-b522-414c-8cef-b5a58af3dbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:38.066927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64480b-b522-414c-8cef-b5a58af3dbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:38.067199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64480b-b522-414c-8cef-b5a58af3dbc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:38.067938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64480b-b522-414c-8cef-b5a58af3dbc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:38.068242 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64480b-b522-414c-8cef-b5a58af3dbc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:38.069681 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64480b-b522-414c-8cef-b5a58af3dbc7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:38.077327 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 545/1092] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:50:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:38.082951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64480b-b522-414c-8cef-b5a58af3dbc7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:38.092066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db37daf-f96a-4fcb-8c29-94339a535353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:38.092859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db37daf-f96a-4fcb-8c29-94339a535353 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:38.093185 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db37daf-f96a-4fcb-8c29-94339a535353 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:38.093466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db37daf-f96a-4fcb-8c29-94339a535353 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:38.104098 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db37daf-f96a-4fcb-8c29-94339a535353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:38.105566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db37daf-f96a-4fcb-8c29-94339a535353 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:38.121945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-5db37daf-f96a-4fcb-8c29-94339a535353 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:38.127616 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 548/1093] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:38.128626 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db37daf-f96a-4fcb-8c29-94339a535353 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:38.176089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64480b-b522-414c-8cef-b5a58af3dbc7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:38.207477 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e6b4f-1f29-46c0-9a80-fdb8f3ca04f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:38.208333 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e6b4f-1f29-46c0-9a80-fdb8f3ca04f0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:38.208637 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e6b4f-1f29-46c0-9a80-fdb8f3ca04f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:38.209460 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e6b4f-1f29-46c0-9a80-fdb8f3ca04f0 None admin] PATH_INFO: `/v3/users/4c4b55005fa04010b093c02682065222` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:38.210637 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e6b4f-1f29-46c0-9a80-fdb8f3ca04f0 None admin] RBAC: Authorizing `identity:get_user(user_id=4c4b55005fa04010b093c02682065222)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:38.212090 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e6b4f-1f29-46c0-9a80-fdb8f3ca04f0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:38.213733 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 546/1094] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:50:38 2022] GET /identity/v3/users/4c4b55005fa04010b093c02682065222 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:38.219268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e6b4f-1f29-46c0-9a80-fdb8f3ca04f0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:38.222036 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db37daf-f96a-4fcb-8c29-94339a535353 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:38.253405 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644a26a-adb8-49af-a7fc-29327c4158f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:38.254063 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644a26a-adb8-49af-a7fc-29327c4158f8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:38.254347 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644a26a-adb8-49af-a7fc-29327c4158f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:38.254621 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644a26a-adb8-49af-a7fc-29327c4158f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:38.255346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644a26a-adb8-49af-a7fc-29327c4158f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:38.256140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644a26a-adb8-49af-a7fc-29327c4158f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:38.257531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644a26a-adb8-49af-a7fc-29327c4158f8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:38.268920 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 549/1095] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:38.274278 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644a26a-adb8-49af-a7fc-29327c4158f8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:38.311030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e6b4f-1f29-46c0-9a80-fdb8f3ca04f0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:38.342420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafce40-d515-414d-bf11-4a7ef3502d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:38.343057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafce40-d515-414d-bf11-4a7ef3502d5e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:38.343334 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafce40-d515-414d-bf11-4a7ef3502d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:38.343604 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafce40-d515-414d-bf11-4a7ef3502d5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:38.365444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644a26a-adb8-49af-a7fc-29327c4158f8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:38.397143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63727ea8-f01b-4d04-b5d4-62044674b2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:38.398027 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63727ea8-f01b-4d04-b5d4-62044674b2ae None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:38.398318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63727ea8-f01b-4d04-b5d4-62044674b2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:38.398594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63727ea8-f01b-4d04-b5d4-62044674b2ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:38.405934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafce40-d515-414d-bf11-4a7ef3502d5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:38.406079 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63727ea8-f01b-4d04-b5d4-62044674b2ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:38.407468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafce40-d515-414d-bf11-4a7ef3502d5e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:38.408247 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63727ea8-f01b-4d04-b5d4-62044674b2ae None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:38.422791 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-63727ea8-f01b-4d04-b5d4-62044674b2ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 10:50:38.423985 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 550/1096] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Apr 6 10:50:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:38.430160 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63727ea8-f01b-4d04-b5d4-62044674b2ae None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:38.500234 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 547/1097] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:50:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 06 10:50:38.505994 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafce40-d515-414d-bf11-4a7ef3502d5e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:38.524316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63727ea8-f01b-4d04-b5d4-62044674b2ae None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:38.556555 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36892f2e-ed61-4cdd-889f-718446104e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:38.557300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36892f2e-ed61-4cdd-889f-718446104e36 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:38.557587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36892f2e-ed61-4cdd-889f-718446104e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:38.557863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36892f2e-ed61-4cdd-889f-718446104e36 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:38.558699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36892f2e-ed61-4cdd-889f-718446104e36 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:38.559009 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36892f2e-ed61-4cdd-889f-718446104e36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:38.560423 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36892f2e-ed61-4cdd-889f-718446104e36 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:38.581160 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 551/1098] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Apr 6 10:50:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:38.582988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36892f2e-ed61-4cdd-889f-718446104e36 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:38.598457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafce40-d515-414d-bf11-4a7ef3502d5e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:38.632457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c79b7-c9c5-4064-9ff9-605de8f58cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:38.633360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c79b7-c9c5-4064-9ff9-605de8f58cde None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:38.633643 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c79b7-c9c5-4064-9ff9-605de8f58cde None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:38.633923 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c79b7-c9c5-4064-9ff9-605de8f58cde None admin] PATH_INFO: `/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:38.635201 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c79b7-c9c5-4064-9ff9-605de8f58cde None admin] RBAC: Authorizing `identity:get_project(project_id=ea8db386dc9844f29cf44b1c6f0ce86f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:38.636676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c79b7-c9c5-4064-9ff9-605de8f58cde None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:38.638606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 548/1099] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:50:38 2022] GET /identity/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:38.644438 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c79b7-c9c5-4064-9ff9-605de8f58cde None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:38.681399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36892f2e-ed61-4cdd-889f-718446104e36 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:38.712894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c3f83-7e14-4d98-bd17-26c851399e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:38.713554 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c3f83-7e14-4d98-bd17-26c851399e36 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:38.713833 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c3f83-7e14-4d98-bd17-26c851399e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:38.714103 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c3f83-7e14-4d98-bd17-26c851399e36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:38.738518 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c79b7-c9c5-4064-9ff9-605de8f58cde None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:38.770855 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddedfd-a364-4852-88d0-c26972cd1490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:38.771536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddedfd-a364-4852-88d0-c26972cd1490 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:38.771818 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddedfd-a364-4852-88d0-c26972cd1490 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:38.772094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddedfd-a364-4852-88d0-c26972cd1490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:38.772914 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddedfd-a364-4852-88d0-c26972cd1490 None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=ea8db386dc9844f29cf44b1c6f0ce86f, user.id=4c4b55005fa04010b093c02682065222) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:38.773257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddedfd-a364-4852-88d0-c26972cd1490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:38.774728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddedfd-a364-4852-88d0-c26972cd1490 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:38.776837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c3f83-7e14-4d98-bd17-26c851399e36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:38.778280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c3f83-7e14-4d98-bd17-26c851399e36 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:38.780391 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 549/1100] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:50:38 2022] GET /identity/v3/role_assignments?user.id=4c4b55005fa04010b093c02682065222&scope.project.id=ea8db386dc9844f29cf44b1c6f0ce86f&role.id=090ba4d1ae32495289276665920d4a2c => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:50:38.881204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 552/1101] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:50:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:50:38.888266 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddedfd-a364-4852-88d0-c26972cd1490 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:38.989348 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddedfd-a364-4852-88d0-c26972cd1490 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:39.022590 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9557504-ae81-41ed-ab08-fd06a8a7249b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:39.023380 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9557504-ae81-41ed-ab08-fd06a8a7249b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:39.023659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9557504-ae81-41ed-ab08-fd06a8a7249b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:39.023930 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9557504-ae81-41ed-ab08-fd06a8a7249b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:39.033494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9557504-ae81-41ed-ab08-fd06a8a7249b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:39.034967 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9557504-ae81-41ed-ab08-fd06a8a7249b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:39.051592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-a9557504-ae81-41ed-ab08-fd06a8a7249b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:50:39.052809 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 550/1102] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:39.058642 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c3f83-7e14-4d98-bd17-26c851399e36 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:39.155379 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c3f83-7e14-4d98-bd17-26c851399e36 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:39.187735 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5be29-8875-4576-affb-09a4725b1cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:39.188396 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5be29-8875-4576-affb-09a4725b1cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:39.188681 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5be29-8875-4576-affb-09a4725b1cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:39.188958 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5be29-8875-4576-affb-09a4725b1cf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:39.189704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5be29-8875-4576-affb-09a4725b1cf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:39.190022 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5be29-8875-4576-affb-09a4725b1cf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:39.191357 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5be29-8875-4576-affb-09a4725b1cf9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:39.202157 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 553/1103] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:39.207748 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9557504-ae81-41ed-ab08-fd06a8a7249b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:39.301912 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9557504-ae81-41ed-ab08-fd06a8a7249b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:39.335000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc7767-1ec5-4069-8e9a-3a738933be41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:39.335772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7767-1ec5-4069-8e9a-3a738933be41 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:39.336046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7767-1ec5-4069-8e9a-3a738933be41 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:39.336310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7767-1ec5-4069-8e9a-3a738933be41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:39.342643 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc7767-1ec5-4069-8e9a-3a738933be41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:39.344113 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc7767-1ec5-4069-8e9a-3a738933be41 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:39.357046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-6cdc7767-1ec5-4069-8e9a-3a738933be41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:50:39.358212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 551/1104] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:50:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:50:39.363907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5be29-8875-4576-affb-09a4725b1cf9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:39.456695 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5be29-8875-4576-affb-09a4725b1cf9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:39.488540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b47b6-9dce-4b23-a4c6-5b9436b32cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:39.489230 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b47b6-9dce-4b23-a4c6-5b9436b32cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:39.489513 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b47b6-9dce-4b23-a4c6-5b9436b32cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:39.489785 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b47b6-9dce-4b23-a4c6-5b9436b32cf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:39.490658 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b47b6-9dce-4b23-a4c6-5b9436b32cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:39.490962 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b47b6-9dce-4b23-a4c6-5b9436b32cf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:39.492380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b47b6-9dce-4b23-a4c6-5b9436b32cf9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:39.504720 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 554/1105] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:50:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:39.511165 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc7767-1ec5-4069-8e9a-3a738933be41 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:39.604993 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc7767-1ec5-4069-8e9a-3a738933be41 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:39.636265 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4e79d-2df1-4f28-9c09-b1a3efb19a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:39.636904 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4e79d-2df1-4f28-9c09-b1a3efb19a7a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:39.637202 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4e79d-2df1-4f28-9c09-b1a3efb19a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:39.637471 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4e79d-2df1-4f28-9c09-b1a3efb19a7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:39.638284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4e79d-2df1-4f28-9c09-b1a3efb19a7a None admin] RBAC: Adding query filter params (role.id=2a2949c54fe047d5970c08741cf8fffe, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=650c5809116e4bcd808044236c06dcc2) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:39.638586 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4e79d-2df1-4f28-9c09-b1a3efb19a7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:39.640046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4e79d-2df1-4f28-9c09-b1a3efb19a7a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:39.645628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 552/1106] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:50:39 2022] GET /identity/v3/role_assignments?user.id=650c5809116e4bcd808044236c06dcc2&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=2a2949c54fe047d5970c08741cf8fffe => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:41.105472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59710158-580a-4cdb-a7ce-cd7608a5aea3 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:41.105997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59710158-580a-4cdb-a7ce-cd7608a5aea3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:41.106085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59710158-580a-4cdb-a7ce-cd7608a5aea3 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:41.107458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 555/1107] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:41.112792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc77c0-a3a4-446a-8ff9-6781ae58668c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:41.113237 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc77c0-a3a4-446a-8ff9-6781ae58668c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:41.113339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc77c0-a3a4-446a-8ff9-6781ae58668c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:41.129701 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-19dc77c0-a3a4-446a-8ff9-6781ae58668c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:41.131372 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-19dc77c0-a3a4-446a-8ff9-6781ae58668c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:41.193574 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 553/1108] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:41.219698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59710158-580a-4cdb-a7ce-cd7608a5aea3 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:41.438909 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59710158-580a-4cdb-a7ce-cd7608a5aea3 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:41.470959 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab859a5-9b83-44c9-add2-35bf8203f42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:41.471746 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab859a5-9b83-44c9-add2-35bf8203f42b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:41.472027 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab859a5-9b83-44c9-add2-35bf8203f42b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:41.472301 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab859a5-9b83-44c9-add2-35bf8203f42b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:41.473674 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab859a5-9b83-44c9-add2-35bf8203f42b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:41.475112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab859a5-9b83-44c9-add2-35bf8203f42b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:41.476726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 556/1109] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:41.482414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc77c0-a3a4-446a-8ff9-6781ae58668c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:41.573200 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc77c0-a3a4-446a-8ff9-6781ae58668c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:41.603950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f040df5-2e77-4c5e-a910-d0a01fb489c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:41.604595 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040df5-2e77-4c5e-a910-d0a01fb489c1 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:41.604875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040df5-2e77-4c5e-a910-d0a01fb489c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:41.605173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040df5-2e77-4c5e-a910-d0a01fb489c1 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:41.605859 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f040df5-2e77-4c5e-a910-d0a01fb489c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:41.607298 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f040df5-2e77-4c5e-a910-d0a01fb489c1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:41.709200 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 554/1110] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:50:41 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:50:44.043106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d348-8b70-4e00-b3da-428b8c0f153a None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:44.043623 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d348-8b70-4e00-b3da-428b8c0f153a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:44.043730 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d348-8b70-4e00-b3da-428b8c0f153a None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:44.045023 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 557/1111] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:44.050306 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d365a78-ea43-4069-8f23-865a216bd890 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:44.050673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d365a78-ea43-4069-8f23-865a216bd890 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:44.050857 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d365a78-ea43-4069-8f23-865a216bd890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:44.067681 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1d365a78-ea43-4069-8f23-865a216bd890 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:44.068907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1d365a78-ea43-4069-8f23-865a216bd890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:44.130543 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 555/1112] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:44.154862 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d348-8b70-4e00-b3da-428b8c0f153a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:44.250119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d348-8b70-4e00-b3da-428b8c0f153a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:44.281259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f08f7-7168-4986-8824-5502f756b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:44.282092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f08f7-7168-4986-8824-5502f756b557 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:44.282367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f08f7-7168-4986-8824-5502f756b557 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:44.282633 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f08f7-7168-4986-8824-5502f756b557 None admin] PATH_INFO: `/v3/roles/ed823413bca240af87bbf99994bcd0f8` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:44.284069 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f08f7-7168-4986-8824-5502f756b557 None admin] RBAC: Authorizing `identity:get_role(role_id=ed823413bca240af87bbf99994bcd0f8)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:44.285424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f08f7-7168-4986-8824-5502f756b557 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:44.287351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 558/1113] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:50:44 2022] GET /identity/v3/roles/ed823413bca240af87bbf99994bcd0f8 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:44.293067 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d365a78-ea43-4069-8f23-865a216bd890 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:44.383425 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d365a78-ea43-4069-8f23-865a216bd890 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:44.415171 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba99901-9ce1-49d5-8148-5ffcd0efb9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:44.416020 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba99901-9ce1-49d5-8148-5ffcd0efb9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:44.416301 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba99901-9ce1-49d5-8148-5ffcd0efb9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:44.416573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba99901-9ce1-49d5-8148-5ffcd0efb9a3 None admin] PATH_INFO: `/v3/users/d41979a4f8a24d6b8cc7404901b473db` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:44.429342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba99901-9ce1-49d5-8148-5ffcd0efb9a3 None admin] RBAC: Authorizing `identity:get_user(user_id=d41979a4f8a24d6b8cc7404901b473db)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:44.430811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba99901-9ce1-49d5-8148-5ffcd0efb9a3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:44.432420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 556/1114] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:50:44 2022] GET /identity/v3/users/d41979a4f8a24d6b8cc7404901b473db => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:44.438179 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f08f7-7168-4986-8824-5502f756b557 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:44.530556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f08f7-7168-4986-8824-5502f756b557 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:44.565642 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6ae4d-3dd4-4afd-b93c-4c72b59caeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:44.566290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6ae4d-3dd4-4afd-b93c-4c72b59caeec None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:44.566569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6ae4d-3dd4-4afd-b93c-4c72b59caeec None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:44.566836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6ae4d-3dd4-4afd-b93c-4c72b59caeec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:44.633885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6ae4d-3dd4-4afd-b93c-4c72b59caeec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:44.635235 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6ae4d-3dd4-4afd-b93c-4c72b59caeec None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:44.729191 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 559/1115] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:50:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:50:44.735132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba99901-9ce1-49d5-8148-5ffcd0efb9a3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:44.828952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba99901-9ce1-49d5-8148-5ffcd0efb9a3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:44.860287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b9b21-6692-4f49-a4ac-6435d2425a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:44.861154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9b21-6692-4f49-a4ac-6435d2425a97 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:44.861434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9b21-6692-4f49-a4ac-6435d2425a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:44.861703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9b21-6692-4f49-a4ac-6435d2425a97 None admin] PATH_INFO: `/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:44.862855 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b9b21-6692-4f49-a4ac-6435d2425a97 None admin] RBAC: Authorizing `identity:get_project(project_id=ea8db386dc9844f29cf44b1c6f0ce86f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:44.864313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b9b21-6692-4f49-a4ac-6435d2425a97 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:44.866036 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 557/1116] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:50:44 2022] GET /identity/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:44.872084 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6ae4d-3dd4-4afd-b93c-4c72b59caeec None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:44.964953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6ae4d-3dd4-4afd-b93c-4c72b59caeec None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:44.995361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd94f-b026-4060-8f78-27aa96004b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:44.995999 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd94f-b026-4060-8f78-27aa96004b4e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:44.996277 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd94f-b026-4060-8f78-27aa96004b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:44.996548 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd94f-b026-4060-8f78-27aa96004b4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:44.997393 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd94f-b026-4060-8f78-27aa96004b4e None admin] RBAC: Adding query filter params (role.id=ed823413bca240af87bbf99994bcd0f8, scope.project.id=ea8db386dc9844f29cf44b1c6f0ce86f, user.id=d41979a4f8a24d6b8cc7404901b473db) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:44.997702 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd94f-b026-4060-8f78-27aa96004b4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:44.999111 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd94f-b026-4060-8f78-27aa96004b4e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:45.004291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 560/1117] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:50:44 2022] GET /identity/v3/role_assignments?user.id=d41979a4f8a24d6b8cc7404901b473db&scope.project.id=ea8db386dc9844f29cf44b1c6f0ce86f&role.id=ed823413bca240af87bbf99994bcd0f8 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:47.264250 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0252e9a-217f-49de-946b-795a94ba1ea6 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:47.264780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0252e9a-217f-49de-946b-795a94ba1ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:47.264869 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0252e9a-217f-49de-946b-795a94ba1ea6 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:47.266198 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 558/1118] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:47.273164 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d08f08-ef43-47de-a54b-c0dc51ee128e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:47.273563 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d08f08-ef43-47de-a54b-c0dc51ee128e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:47.273726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d08f08-ef43-47de-a54b-c0dc51ee128e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:47.289943 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-94d08f08-ef43-47de-a54b-c0dc51ee128e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:47.291133 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-94d08f08-ef43-47de-a54b-c0dc51ee128e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:47.354380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 561/1119] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:47.376517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0252e9a-217f-49de-946b-795a94ba1ea6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:47.471543 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0252e9a-217f-49de-946b-795a94ba1ea6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:47.503238 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e29698-20c2-4e55-8b72-8b92d1aaa0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:47.504071 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e29698-20c2-4e55-8b72-8b92d1aaa0fb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:47.504354 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e29698-20c2-4e55-8b72-8b92d1aaa0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:47.504632 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e29698-20c2-4e55-8b72-8b92d1aaa0fb None admin] PATH_INFO: `/v3/roles/ed823413bca240af87bbf99994bcd0f8` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:47.506138 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e29698-20c2-4e55-8b72-8b92d1aaa0fb None admin] RBAC: Authorizing `identity:get_role(role_id=ed823413bca240af87bbf99994bcd0f8)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:47.507544 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e29698-20c2-4e55-8b72-8b92d1aaa0fb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:47.508875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 559/1120] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:50:47 2022] GET /identity/v3/roles/ed823413bca240af87bbf99994bcd0f8 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:47.514484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d08f08-ef43-47de-a54b-c0dc51ee128e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:47.608716 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d08f08-ef43-47de-a54b-c0dc51ee128e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:47.639681 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e389adf-d547-4391-b66f-50ba54664a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:47.640535 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e389adf-d547-4391-b66f-50ba54664a2e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:47.640818 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e389adf-d547-4391-b66f-50ba54664a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:47.641118 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e389adf-d547-4391-b66f-50ba54664a2e None admin] PATH_INFO: `/v3/users/d41979a4f8a24d6b8cc7404901b473db` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:47.642283 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e389adf-d547-4391-b66f-50ba54664a2e None admin] RBAC: Authorizing `identity:get_user(user_id=d41979a4f8a24d6b8cc7404901b473db)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:47.643696 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e389adf-d547-4391-b66f-50ba54664a2e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:47.645317 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 562/1121] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:50:47 2022] GET /identity/v3/users/d41979a4f8a24d6b8cc7404901b473db => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:47.651292 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e29698-20c2-4e55-8b72-8b92d1aaa0fb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:47.744738 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e29698-20c2-4e55-8b72-8b92d1aaa0fb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:47.777187 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b47a0-65d2-4865-8cf9-8911dc888365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:47.777981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b47a0-65d2-4865-8cf9-8911dc888365 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:47.778264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b47a0-65d2-4865-8cf9-8911dc888365 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:47.778540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b47a0-65d2-4865-8cf9-8911dc888365 None admin] PATH_INFO: `/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:47.779710 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b47a0-65d2-4865-8cf9-8911dc888365 None admin] RBAC: Authorizing `identity:get_project(project_id=ea8db386dc9844f29cf44b1c6f0ce86f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:47.781197 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b47a0-65d2-4865-8cf9-8911dc888365 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:47.782884 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 560/1122] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:50:47 2022] GET /identity/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:47.790121 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e389adf-d547-4391-b66f-50ba54664a2e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:47.882822 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e389adf-d547-4391-b66f-50ba54664a2e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:47.914195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8eb917-c75c-4dab-9de5-e849ed3358ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:47.915067 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eb917-c75c-4dab-9de5-e849ed3358ad None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:47.915349 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eb917-c75c-4dab-9de5-e849ed3358ad None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:47.915624 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eb917-c75c-4dab-9de5-e849ed3358ad None admin] PATH_INFO: `/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f/users/d41979a4f8a24d6b8cc7404901b473db/roles/ed823413bca240af87bbf99994bcd0f8` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:47.917823 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8eb917-c75c-4dab-9de5-e849ed3358ad None admin] RBAC: Authorizing `identity:create_grant(project_id=ea8db386dc9844f29cf44b1c6f0ce86f, user_id=d41979a4f8a24d6b8cc7404901b473db, role_id=ed823413bca240af87bbf99994bcd0f8)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:47.919237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8eb917-c75c-4dab-9de5-e849ed3358ad None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:47.991790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 563/1123] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:50:47 2022] PUT /identity/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f/users/d41979a4f8a24d6b8cc7404901b473db/roles/ed823413bca240af87bbf99994bcd0f8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:50:50.251357 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc0da0-604f-44a5-861d-1aaa102cc2af None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:50.251919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc0da0-604f-44a5-861d-1aaa102cc2af None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:50.251919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc0da0-604f-44a5-861d-1aaa102cc2af None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:50.253298 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 561/1124] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:50.258394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0314-9bc6-4d8c-9106-37f775c6a057 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:50.258778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0314-9bc6-4d8c-9106-37f775c6a057 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:50.258952 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0314-9bc6-4d8c-9106-37f775c6a057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:50.276423 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-cc7e0314-9bc6-4d8c-9106-37f775c6a057 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:50.278329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-cc7e0314-9bc6-4d8c-9106-37f775c6a057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:50.341201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 564/1125] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:50.365944 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc0da0-604f-44a5-861d-1aaa102cc2af None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:50.461415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc0da0-604f-44a5-861d-1aaa102cc2af None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:50.493315 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fb4ce-7b2d-42dc-b0f6-c74de93ed526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:50.494158 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fb4ce-7b2d-42dc-b0f6-c74de93ed526 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:50.494441 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fb4ce-7b2d-42dc-b0f6-c74de93ed526 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:50.494716 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fb4ce-7b2d-42dc-b0f6-c74de93ed526 None admin] PATH_INFO: `/v3/roles/ed823413bca240af87bbf99994bcd0f8` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:50.496179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fb4ce-7b2d-42dc-b0f6-c74de93ed526 None admin] RBAC: Authorizing `identity:get_role(role_id=ed823413bca240af87bbf99994bcd0f8)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:50.497618 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fb4ce-7b2d-42dc-b0f6-c74de93ed526 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:50.498955 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 562/1126] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:50:50 2022] GET /identity/v3/roles/ed823413bca240af87bbf99994bcd0f8 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:50.504618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e0314-9bc6-4d8c-9106-37f775c6a057 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:50.596036 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e0314-9bc6-4d8c-9106-37f775c6a057 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:50.627742 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c135f0-e569-48b6-b9bc-866879b706e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:50.628594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c135f0-e569-48b6-b9bc-866879b706e3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:50.628878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c135f0-e569-48b6-b9bc-866879b706e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:50.629176 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c135f0-e569-48b6-b9bc-866879b706e3 None admin] PATH_INFO: `/v3/users/d41979a4f8a24d6b8cc7404901b473db` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:50.630885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c135f0-e569-48b6-b9bc-866879b706e3 None admin] RBAC: Authorizing `identity:get_user(user_id=d41979a4f8a24d6b8cc7404901b473db)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:50.632294 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c135f0-e569-48b6-b9bc-866879b706e3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:50.633909 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 565/1127] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:50:50 2022] GET /identity/v3/users/d41979a4f8a24d6b8cc7404901b473db => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:50.639457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fb4ce-7b2d-42dc-b0f6-c74de93ed526 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:50.732586 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fb4ce-7b2d-42dc-b0f6-c74de93ed526 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:50.768561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeed2e2-4523-46b2-aea2-b50ad00f6ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:50.768561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed2e2-4523-46b2-aea2-b50ad00f6ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:50.768561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed2e2-4523-46b2-aea2-b50ad00f6ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:50.768561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed2e2-4523-46b2-aea2-b50ad00f6ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:50.829513 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeed2e2-4523-46b2-aea2-b50ad00f6ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:50.831023 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeed2e2-4523-46b2-aea2-b50ad00f6ac5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:50.922077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 563/1128] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:50:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:50:50.927917 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c135f0-e569-48b6-b9bc-866879b706e3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:51.022878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c135f0-e569-48b6-b9bc-866879b706e3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:51.053823 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5e481-0df8-4458-acc4-b790c507940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:51.054657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5e481-0df8-4458-acc4-b790c507940f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:51.054931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5e481-0df8-4458-acc4-b790c507940f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:51.055198 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5e481-0df8-4458-acc4-b790c507940f None admin] PATH_INFO: `/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:51.056338 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5e481-0df8-4458-acc4-b790c507940f None admin] RBAC: Authorizing `identity:get_project(project_id=ea8db386dc9844f29cf44b1c6f0ce86f)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:51.057774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5e481-0df8-4458-acc4-b790c507940f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:51.059464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 566/1129] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:50:50 2022] GET /identity/v3/projects/ea8db386dc9844f29cf44b1c6f0ce86f => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:51.065685 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeed2e2-4523-46b2-aea2-b50ad00f6ac5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:51.155689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeed2e2-4523-46b2-aea2-b50ad00f6ac5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:51.197855 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c726fc-7612-441c-9494-864cc7acf493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:51.198800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c726fc-7612-441c-9494-864cc7acf493 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:51.199215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c726fc-7612-441c-9494-864cc7acf493 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:51.199620 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c726fc-7612-441c-9494-864cc7acf493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:51.200904 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c726fc-7612-441c-9494-864cc7acf493 None admin] RBAC: Adding query filter params (role.id=ed823413bca240af87bbf99994bcd0f8, scope.project.id=ea8db386dc9844f29cf44b1c6f0ce86f, user.id=d41979a4f8a24d6b8cc7404901b473db) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:51.201409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c726fc-7612-441c-9494-864cc7acf493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:51.203703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c726fc-7612-441c-9494-864cc7acf493 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:51.212184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 564/1130] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:50:51 2022] GET /identity/v3/role_assignments?user.id=d41979a4f8a24d6b8cc7404901b473db&scope.project.id=ea8db386dc9844f29cf44b1c6f0ce86f&role.id=ed823413bca240af87bbf99994bcd0f8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:53.500657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133dd57-bb31-4e8a-9edc-87685dc0c907 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:53.501224 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133dd57-bb31-4e8a-9edc-87685dc0c907 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:53.501224 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133dd57-bb31-4e8a-9edc-87685dc0c907 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:53.502641 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 567/1131] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:53.508619 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc86ee-880a-4876-b8f2-c1779c2ea6c0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:53.509018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc86ee-880a-4876-b8f2-c1779c2ea6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:53.509203 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc86ee-880a-4876-b8f2-c1779c2ea6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:53.525218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8edc86ee-880a-4876-b8f2-c1779c2ea6c0 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:53.526399 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8edc86ee-880a-4876-b8f2-c1779c2ea6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:53.588272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 565/1132] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:53.612858 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133dd57-bb31-4e8a-9edc-87685dc0c907 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:53.707980 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133dd57-bb31-4e8a-9edc-87685dc0c907 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:53.738837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc36596-c89c-4974-8a53-1c8b8959f52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:53.739637 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc36596-c89c-4974-8a53-1c8b8959f52d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:53.740409 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc36596-c89c-4974-8a53-1c8b8959f52d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:53.740677 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc36596-c89c-4974-8a53-1c8b8959f52d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:53.741844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc36596-c89c-4974-8a53-1c8b8959f52d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:53.743242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc36596-c89c-4974-8a53-1c8b8959f52d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:53.744818 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 568/1133] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:53.750539 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc86ee-880a-4876-b8f2-c1779c2ea6c0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:53.840466 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc86ee-880a-4876-b8f2-c1779c2ea6c0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:53.872095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3448fb-78fe-478b-9c90-c897413d3c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:53.872732 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3448fb-78fe-478b-9c90-c897413d3c48 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:53.873009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3448fb-78fe-478b-9c90-c897413d3c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:53.873309 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3448fb-78fe-478b-9c90-c897413d3c48 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:53.873998 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3448fb-78fe-478b-9c90-c897413d3c48 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:53.875437 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3448fb-78fe-478b-9c90-c897413d3c48 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:53.955063 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 566/1134] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Apr 6 10:50:53 2022] POST /identity/v3/projects => generated 311 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:50:56.250027 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81faaa-84c6-4bc9-893f-5704dff5254f None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:56.250579 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81faaa-84c6-4bc9-893f-5704dff5254f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:56.250579 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81faaa-84c6-4bc9-893f-5704dff5254f None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:56.251927 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 569/1135] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:56.257559 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0fcee-ef23-4966-95de-17c1941f776e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:56.257932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0fcee-ef23-4966-95de-17c1941f776e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:56.258109 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0fcee-ef23-4966-95de-17c1941f776e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:56.274754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0bc0fcee-ef23-4966-95de-17c1941f776e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:56.275917 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0bc0fcee-ef23-4966-95de-17c1941f776e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:56.338313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 567/1136] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:50:56.363494 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81faaa-84c6-4bc9-893f-5704dff5254f None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:56.457182 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81faaa-84c6-4bc9-893f-5704dff5254f None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:56.498843 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27982e5e-cc3a-4b42-84f1-bab027096406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:56.499625 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27982e5e-cc3a-4b42-84f1-bab027096406 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:56.499900 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27982e5e-cc3a-4b42-84f1-bab027096406 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:56.500216 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27982e5e-cc3a-4b42-84f1-bab027096406 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:56.501351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27982e5e-cc3a-4b42-84f1-bab027096406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:56.502771 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27982e5e-cc3a-4b42-84f1-bab027096406 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:56.504368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 570/1137] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:50:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:56.511027 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0fcee-ef23-4966-95de-17c1941f776e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:56.603528 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0fcee-ef23-4966-95de-17c1941f776e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:56.635554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a275bb-c2c0-4036-9b91-b42822b758a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:56.636210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a275bb-c2c0-4036-9b91-b42822b758a7 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:56.636492 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a275bb-c2c0-4036-9b91-b42822b758a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:56.636770 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a275bb-c2c0-4036-9b91-b42822b758a7 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:56.637496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a275bb-c2c0-4036-9b91-b42822b758a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:56.638966 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a275bb-c2c0-4036-9b91-b42822b758a7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:56.743232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 568/1138] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:50:56 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:50:59.070207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a61a-0942-440a-badb-d9385a77b357 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:59.070762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a61a-0942-440a-badb-d9385a77b357 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:59.070762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a61a-0942-440a-badb-d9385a77b357 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:59.072116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 571/1139] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:50:59.077160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a699d58-d390-4656-846e-261504398773 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:59.077531 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a699d58-d390-4656-846e-261504398773 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:59.077712 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a699d58-d390-4656-846e-261504398773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:59.095063 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9a699d58-d390-4656-846e-261504398773 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:50:59.096241 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9a699d58-d390-4656-846e-261504398773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:50:59.157961 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 569/1140] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:50:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:50:59.182027 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40a61a-0942-440a-badb-d9385a77b357 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:59.277232 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40a61a-0942-440a-badb-d9385a77b357 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:59.308449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3569a-38e9-4b4f-a615-975046acd75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:59.309258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3569a-38e9-4b4f-a615-975046acd75d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:59.309539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3569a-38e9-4b4f-a615-975046acd75d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:59.309814 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3569a-38e9-4b4f-a615-975046acd75d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:59.320080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3569a-38e9-4b4f-a615-975046acd75d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:50:59.326975 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-59a3569a-38e9-4b4f-a615-975046acd75d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:50:59.328081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 572/1141] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:50:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:50:59.333888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a699d58-d390-4656-846e-261504398773 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:59.425263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a699d58-d390-4656-846e-261504398773 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:59.457575 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b753f-f368-41ad-b1d7-3f80a480b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:59.458243 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b753f-f368-41ad-b1d7-3f80a480b0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:59.458524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b753f-f368-41ad-b1d7-3f80a480b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:59.458796 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b753f-f368-41ad-b1d7-3f80a480b0c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:59.459525 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b753f-f368-41ad-b1d7-3f80a480b0c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:50:59.459828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b753f-f368-41ad-b1d7-3f80a480b0c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:59.461244 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b753f-f368-41ad-b1d7-3f80a480b0c7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:59.468726 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 570/1142] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:50:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:59.474212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3569a-38e9-4b4f-a615-975046acd75d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:59.566514 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3569a-38e9-4b4f-a615-975046acd75d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:59.597650 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c61af-bdd4-4b2d-965b-a7294a9dde6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:59.598442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c61af-bdd4-4b2d-965b-a7294a9dde6a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:59.598722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c61af-bdd4-4b2d-965b-a7294a9dde6a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:59.598993 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c61af-bdd4-4b2d-965b-a7294a9dde6a None admin] PATH_INFO: `/v3/users/141577f3a34a4b26ab647f244911478d` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:59.611218 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c61af-bdd4-4b2d-965b-a7294a9dde6a None admin] RBAC: Authorizing `identity:get_user(user_id=141577f3a34a4b26ab647f244911478d)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:59.612640 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c61af-bdd4-4b2d-965b-a7294a9dde6a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:59.614292 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 573/1143] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:50:59 2022] GET /identity/v3/users/141577f3a34a4b26ab647f244911478d => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:50:59.620299 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b753f-f368-41ad-b1d7-3f80a480b0c7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:59.713756 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b753f-f368-41ad-b1d7-3f80a480b0c7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:50:59.745213 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8661a5-d5c9-4445-a5a1-3307b973d44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:50:59.745848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8661a5-d5c9-4445-a5a1-3307b973d44b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:50:59.746128 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8661a5-d5c9-4445-a5a1-3307b973d44b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:50:59.746403 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8661a5-d5c9-4445-a5a1-3307b973d44b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:50:59.808263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8661a5-d5c9-4445-a5a1-3307b973d44b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:50:59.809746 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8661a5-d5c9-4445-a5a1-3307b973d44b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:50:59.898745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 571/1144] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:50:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:50:59.904579 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c61af-bdd4-4b2d-965b-a7294a9dde6a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:50:59.997889 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c61af-bdd4-4b2d-965b-a7294a9dde6a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:00.029047 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce3865-1c11-4427-a610-6aaaed061a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:00.029912 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce3865-1c11-4427-a610-6aaaed061a22 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:00.030191 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce3865-1c11-4427-a610-6aaaed061a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:00.030462 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce3865-1c11-4427-a610-6aaaed061a22 None admin] PATH_INFO: `/v3/projects/6f24569abfe348c89892ed2f383d6483` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:00.031622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce3865-1c11-4427-a610-6aaaed061a22 None admin] RBAC: Authorizing `identity:get_project(project_id=6f24569abfe348c89892ed2f383d6483)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:00.033028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce3865-1c11-4427-a610-6aaaed061a22 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:00.034712 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 574/1145] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:50:59 2022] GET /identity/v3/projects/6f24569abfe348c89892ed2f383d6483 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:00.041297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8661a5-d5c9-4445-a5a1-3307b973d44b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:00.134347 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8661a5-d5c9-4445-a5a1-3307b973d44b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:00.166485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b682893-d3cd-41a6-ac2f-d3e3a78ec35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:00.167090 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b682893-d3cd-41a6-ac2f-d3e3a78ec35d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:00.167374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b682893-d3cd-41a6-ac2f-d3e3a78ec35d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:00.167648 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b682893-d3cd-41a6-ac2f-d3e3a78ec35d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:00.168466 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b682893-d3cd-41a6-ac2f-d3e3a78ec35d None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=6f24569abfe348c89892ed2f383d6483, user.id=141577f3a34a4b26ab647f244911478d) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:51:00.168778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b682893-d3cd-41a6-ac2f-d3e3a78ec35d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:00.170271 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b682893-d3cd-41a6-ac2f-d3e3a78ec35d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:00.175417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 572/1146] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:51:00 2022] GET /identity/v3/role_assignments?user.id=141577f3a34a4b26ab647f244911478d&scope.project.id=6f24569abfe348c89892ed2f383d6483&role.id=090ba4d1ae32495289276665920d4a2c => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:02.433862 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49ca98-2ce8-4adb-a2fb-e051da593eae None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:02.434278 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49ca98-2ce8-4adb-a2fb-e051da593eae None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:02.434470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49ca98-2ce8-4adb-a2fb-e051da593eae None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:02.435759 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 575/1147] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:51:02.441145 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2cbb5-d6c5-48f6-baeb-0b5711c69e7c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:02.441524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2cbb5-d6c5-48f6-baeb-0b5711c69e7c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:02.441683 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2cbb5-d6c5-48f6-baeb-0b5711c69e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:02.458785 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-41d2cbb5-d6c5-48f6-baeb-0b5711c69e7c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:51:02.459942 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-41d2cbb5-d6c5-48f6-baeb-0b5711c69e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:51:02.528771 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 573/1148] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:51:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:51:02.551843 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49ca98-2ce8-4adb-a2fb-e051da593eae None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:02.646524 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49ca98-2ce8-4adb-a2fb-e051da593eae None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:02.679349 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6857170-930a-4a0a-85c3-ea2c8489f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:02.680134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6857170-930a-4a0a-85c3-ea2c8489f4df None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:02.680416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6857170-930a-4a0a-85c3-ea2c8489f4df None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:02.680692 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6857170-930a-4a0a-85c3-ea2c8489f4df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:02.690732 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6857170-930a-4a0a-85c3-ea2c8489f4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:51:02.698276 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-f6857170-930a-4a0a-85c3-ea2c8489f4df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:51:02.699459 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 576/1149] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:51:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:51:02.706823 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2cbb5-d6c5-48f6-baeb-0b5711c69e7c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:02.799504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2cbb5-d6c5-48f6-baeb-0b5711c69e7c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:02.831240 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b27fd4-53ea-4854-bd29-517213e66da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:02.831893 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b27fd4-53ea-4854-bd29-517213e66da3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:02.832173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b27fd4-53ea-4854-bd29-517213e66da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:02.832448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b27fd4-53ea-4854-bd29-517213e66da3 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:02.833348 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b27fd4-53ea-4854-bd29-517213e66da3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:51:02.833644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b27fd4-53ea-4854-bd29-517213e66da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:02.835577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b27fd4-53ea-4854-bd29-517213e66da3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:02.843167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 574/1150] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:51:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:02.848928 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6857170-930a-4a0a-85c3-ea2c8489f4df None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:02.942556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6857170-930a-4a0a-85c3-ea2c8489f4df None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:02.973009 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fc258-8f62-4de4-b8d4-6fb7e89535a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:02.973898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fc258-8f62-4de4-b8d4-6fb7e89535a2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:02.974181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fc258-8f62-4de4-b8d4-6fb7e89535a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:02.974457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fc258-8f62-4de4-b8d4-6fb7e89535a2 None admin] PATH_INFO: `/v3/users/141577f3a34a4b26ab647f244911478d` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:02.976121 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fc258-8f62-4de4-b8d4-6fb7e89535a2 None admin] RBAC: Authorizing `identity:get_user(user_id=141577f3a34a4b26ab647f244911478d)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:02.977575 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fc258-8f62-4de4-b8d4-6fb7e89535a2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:02.979186 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 577/1151] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:51:02 2022] GET /identity/v3/users/141577f3a34a4b26ab647f244911478d => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:02.984776 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b27fd4-53ea-4854-bd29-517213e66da3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:03.078997 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b27fd4-53ea-4854-bd29-517213e66da3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:03.111123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e8e21-42a1-480a-8a67-ea22129d50ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:03.111975 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e8e21-42a1-480a-8a67-ea22129d50ff None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:03.112255 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e8e21-42a1-480a-8a67-ea22129d50ff None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:03.112530 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e8e21-42a1-480a-8a67-ea22129d50ff None admin] PATH_INFO: `/v3/projects/6f24569abfe348c89892ed2f383d6483` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:03.113689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e8e21-42a1-480a-8a67-ea22129d50ff None admin] RBAC: Authorizing `identity:get_project(project_id=6f24569abfe348c89892ed2f383d6483)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:03.115159 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e8e21-42a1-480a-8a67-ea22129d50ff None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:03.116862 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 575/1152] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:51:02 2022] GET /identity/v3/projects/6f24569abfe348c89892ed2f383d6483 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:03.122846 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fc258-8f62-4de4-b8d4-6fb7e89535a2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:03.215789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fc258-8f62-4de4-b8d4-6fb7e89535a2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:03.247201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0150a19-a29a-4c3a-974c-779355888433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:03.248073 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0150a19-a29a-4c3a-974c-779355888433 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:03.248360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0150a19-a29a-4c3a-974c-779355888433 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:03.248636 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0150a19-a29a-4c3a-974c-779355888433 None admin] PATH_INFO: `/v3/projects/6f24569abfe348c89892ed2f383d6483/users/141577f3a34a4b26ab647f244911478d/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:03.250678 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0150a19-a29a-4c3a-974c-779355888433 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f24569abfe348c89892ed2f383d6483, user_id=141577f3a34a4b26ab647f244911478d, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:03.252084 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0150a19-a29a-4c3a-974c-779355888433 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:03.336623 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 578/1153] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:51:03 2022] PUT /identity/v3/projects/6f24569abfe348c89892ed2f383d6483/users/141577f3a34a4b26ab647f244911478d/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:51:05.657454 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17351c7b-1fb0-484d-837b-36d1f3d4af90 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:05.657996 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17351c7b-1fb0-484d-837b-36d1f3d4af90 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:05.657996 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17351c7b-1fb0-484d-837b-36d1f3d4af90 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:05.659356 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 576/1154] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:51:05.664505 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c2a20-e80f-4347-aa9b-2e392c15549d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:05.664921 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c2a20-e80f-4347-aa9b-2e392c15549d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:05.665075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c2a20-e80f-4347-aa9b-2e392c15549d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:05.681364 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-1f7c2a20-e80f-4347-aa9b-2e392c15549d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:51:05.682677 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1f7c2a20-e80f-4347-aa9b-2e392c15549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:51:05.748577 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 579/1155] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:51:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:51:05.773448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17351c7b-1fb0-484d-837b-36d1f3d4af90 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:05.872203 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17351c7b-1fb0-484d-837b-36d1f3d4af90 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:05.904063 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925109fd-25c3-4980-8e99-872b918d1a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:05.904843 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925109fd-25c3-4980-8e99-872b918d1a84 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:05.905149 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925109fd-25c3-4980-8e99-872b918d1a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:05.905428 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925109fd-25c3-4980-8e99-872b918d1a84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:05.915522 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925109fd-25c3-4980-8e99-872b918d1a84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:51:05.922350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-925109fd-25c3-4980-8e99-872b918d1a84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:51:05.923526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 577/1156] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:51:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:51:05.929549 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c2a20-e80f-4347-aa9b-2e392c15549d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:06.022566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c2a20-e80f-4347-aa9b-2e392c15549d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:06.054105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aefe79-ce5f-4f31-a511-dd5fe464cdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:06.054829 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aefe79-ce5f-4f31-a511-dd5fe464cdea None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:06.055093 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aefe79-ce5f-4f31-a511-dd5fe464cdea None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:06.055369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aefe79-ce5f-4f31-a511-dd5fe464cdea None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:06.056109 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aefe79-ce5f-4f31-a511-dd5fe464cdea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:51:06.056417 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aefe79-ce5f-4f31-a511-dd5fe464cdea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:06.057877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aefe79-ce5f-4f31-a511-dd5fe464cdea None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:06.066026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 580/1157] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:51:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:06.072313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925109fd-25c3-4980-8e99-872b918d1a84 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:06.165243 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925109fd-25c3-4980-8e99-872b918d1a84 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:06.198156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d4a5c-c61c-45bd-ae7c-3a6eccdafebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:06.198954 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d4a5c-c61c-45bd-ae7c-3a6eccdafebe None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:06.199233 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d4a5c-c61c-45bd-ae7c-3a6eccdafebe None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:06.199503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d4a5c-c61c-45bd-ae7c-3a6eccdafebe None admin] PATH_INFO: `/v3/users/141577f3a34a4b26ab647f244911478d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:06.200662 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d4a5c-c61c-45bd-ae7c-3a6eccdafebe None admin] RBAC: Authorizing `identity:get_user(user_id=141577f3a34a4b26ab647f244911478d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:06.202178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d4a5c-c61c-45bd-ae7c-3a6eccdafebe None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:06.203801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 578/1158] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:51:06 2022] GET /identity/v3/users/141577f3a34a4b26ab647f244911478d => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:06.209336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aefe79-ce5f-4f31-a511-dd5fe464cdea None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:06.300666 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aefe79-ce5f-4f31-a511-dd5fe464cdea None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:06.332144 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3d7ab-e782-4f99-a04b-b0c81d70bee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:06.332772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3d7ab-e782-4f99-a04b-b0c81d70bee1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:06.333048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3d7ab-e782-4f99-a04b-b0c81d70bee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:06.333339 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3d7ab-e782-4f99-a04b-b0c81d70bee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:06.394141 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3d7ab-e782-4f99-a04b-b0c81d70bee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:06.395545 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3d7ab-e782-4f99-a04b-b0c81d70bee1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:06.486846 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 581/1159] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:51:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:51:06.493194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d4a5c-c61c-45bd-ae7c-3a6eccdafebe None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:06.584687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d4a5c-c61c-45bd-ae7c-3a6eccdafebe None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:06.616722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08900c-5a6a-48f4-92ff-a41a3d0d9ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:06.617583 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08900c-5a6a-48f4-92ff-a41a3d0d9ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:06.617870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08900c-5a6a-48f4-92ff-a41a3d0d9ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:06.618143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08900c-5a6a-48f4-92ff-a41a3d0d9ef5 None admin] PATH_INFO: `/v3/projects/6f24569abfe348c89892ed2f383d6483` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:06.619299 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08900c-5a6a-48f4-92ff-a41a3d0d9ef5 None admin] RBAC: Authorizing `identity:get_project(project_id=6f24569abfe348c89892ed2f383d6483)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:06.620770 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08900c-5a6a-48f4-92ff-a41a3d0d9ef5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:06.622454 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 579/1160] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:51:06 2022] GET /identity/v3/projects/6f24569abfe348c89892ed2f383d6483 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:06.628211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3d7ab-e782-4f99-a04b-b0c81d70bee1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:06.724056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3d7ab-e782-4f99-a04b-b0c81d70bee1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:06.756359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3254e6-5c6f-4d0e-90e9-64fbb5f4eb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:06.756973 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3254e6-5c6f-4d0e-90e9-64fbb5f4eb87 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:06.757284 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3254e6-5c6f-4d0e-90e9-64fbb5f4eb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:06.757557 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3254e6-5c6f-4d0e-90e9-64fbb5f4eb87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:06.758371 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3254e6-5c6f-4d0e-90e9-64fbb5f4eb87 None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=6f24569abfe348c89892ed2f383d6483, user.id=141577f3a34a4b26ab647f244911478d) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:51:06.758680 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3254e6-5c6f-4d0e-90e9-64fbb5f4eb87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:06.760100 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3254e6-5c6f-4d0e-90e9-64fbb5f4eb87 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:06.765671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 582/1161] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:51:06 2022] GET /identity/v3/role_assignments?user.id=141577f3a34a4b26ab647f244911478d&scope.project.id=6f24569abfe348c89892ed2f383d6483&role.id=090ba4d1ae32495289276665920d4a2c => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:09.054143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013941e-c9af-4c89-bc63-bf5259b04f5c None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:09.054724 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013941e-c9af-4c89-bc63-bf5259b04f5c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:09.054724 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013941e-c9af-4c89-bc63-bf5259b04f5c None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:09.056050 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 580/1162] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:51:09.061557 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17919ad-6679-4ccb-b0d0-031d2ddde55c None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:09.061977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17919ad-6679-4ccb-b0d0-031d2ddde55c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:09.062116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17919ad-6679-4ccb-b0d0-031d2ddde55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:09.078308 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-b17919ad-6679-4ccb-b0d0-031d2ddde55c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:51:09.079488 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b17919ad-6679-4ccb-b0d0-031d2ddde55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:51:09.142009 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 583/1163] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:51:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:51:09.165118 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013941e-c9af-4c89-bc63-bf5259b04f5c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:09.260207 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013941e-c9af-4c89-bc63-bf5259b04f5c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:09.414558 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c31843-942b-41e4-bb7c-612b8ab142d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:09.415116 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c31843-942b-41e4-bb7c-612b8ab142d7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:09.415394 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c31843-942b-41e4-bb7c-612b8ab142d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:09.415669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c31843-942b-41e4-bb7c-612b8ab142d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:09.478311 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c31843-942b-41e4-bb7c-612b8ab142d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:09.479774 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c31843-942b-41e4-bb7c-612b8ab142d7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:09.569652 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 581/1164] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:51:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:51:09.576939 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17919ad-6679-4ccb-b0d0-031d2ddde55c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:09.669695 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17919ad-6679-4ccb-b0d0-031d2ddde55c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:09.701803 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e45a8-4431-4ee7-ae32-b81f66bdd8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:09.702596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e45a8-4431-4ee7-ae32-b81f66bdd8cb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:09.702882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e45a8-4431-4ee7-ae32-b81f66bdd8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:09.703158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e45a8-4431-4ee7-ae32-b81f66bdd8cb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:09.710163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e45a8-4431-4ee7-ae32-b81f66bdd8cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:09.711585 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e45a8-4431-4ee7-ae32-b81f66bdd8cb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:09.724562 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-448e45a8-4431-4ee7-ae32-b81f66bdd8cb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 06 10:51:09.725771 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 584/1165] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Apr 6 10:51:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:51:09.731734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c31843-942b-41e4-bb7c-612b8ab142d7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:09.824110 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c31843-942b-41e4-bb7c-612b8ab142d7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:09.854613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efed12e-397f-41c7-aff8-70eecd30fdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:09.855249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efed12e-397f-41c7-aff8-70eecd30fdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:09.855524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efed12e-397f-41c7-aff8-70eecd30fdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:09.855792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efed12e-397f-41c7-aff8-70eecd30fdb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:09.856496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efed12e-397f-41c7-aff8-70eecd30fdb1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:51:09.856793 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efed12e-397f-41c7-aff8-70eecd30fdb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:09.858214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efed12e-397f-41c7-aff8-70eecd30fdb1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:09.864882 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 582/1166] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Apr 6 10:51:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:12.158324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237639da-4eff-4440-bb87-91fb8bf122cf None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:12.158882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237639da-4eff-4440-bb87-91fb8bf122cf None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:12.158882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237639da-4eff-4440-bb87-91fb8bf122cf None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:12.160249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 585/1167] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:51:12.165594 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b15b77-8f8b-4f0f-ae04-a1d661a345de None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:12.166010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b15b77-8f8b-4f0f-ae04-a1d661a345de None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:12.166152 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b15b77-8f8b-4f0f-ae04-a1d661a345de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:12.182677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-73b15b77-8f8b-4f0f-ae04-a1d661a345de None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:51:12.183845 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-73b15b77-8f8b-4f0f-ae04-a1d661a345de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:51:12.245599 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 583/1168] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:51:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:51:12.270172 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237639da-4eff-4440-bb87-91fb8bf122cf None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:12.367499 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237639da-4eff-4440-bb87-91fb8bf122cf None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:12.398544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7797c-a025-49cb-80bd-518e93b36641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:12.399188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7797c-a025-49cb-80bd-518e93b36641 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:12.399467 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7797c-a025-49cb-80bd-518e93b36641 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:12.399737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7797c-a025-49cb-80bd-518e93b36641 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:12.400482 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7797c-a025-49cb-80bd-518e93b36641 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:12.401871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7797c-a025-49cb-80bd-518e93b36641 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:12.485964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 586/1169] 10.222.0.62 () {60 vars in 1138 bytes} [Wed Apr 6 10:51:12 2022] POST /identity/v3/domains => generated 267 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:51:14.780207 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27c66e-82ea-404f-b7f7-e70cbe6ffdf3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:14.780745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27c66e-82ea-404f-b7f7-e70cbe6ffdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:14.780745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27c66e-82ea-404f-b7f7-e70cbe6ffdf3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:14.782187 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 584/1170] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:51:14.787483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03ca2e-2094-4fc7-b62a-49e1dbf46f65 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:14.787898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03ca2e-2094-4fc7-b62a-49e1dbf46f65 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:14.788042 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03ca2e-2094-4fc7-b62a-49e1dbf46f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:14.804229 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-cd03ca2e-2094-4fc7-b62a-49e1dbf46f65 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:51:14.805439 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-cd03ca2e-2094-4fc7-b62a-49e1dbf46f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:51:14.867615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 587/1171] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:51:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:51:14.892209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27c66e-82ea-404f-b7f7-e70cbe6ffdf3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:14.985765 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27c66e-82ea-404f-b7f7-e70cbe6ffdf3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:15.017496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288c9b4-5ade-4ca8-a7b6-a448709340c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:15.018338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288c9b4-5ade-4ca8-a7b6-a448709340c0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:15.018619 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288c9b4-5ade-4ca8-a7b6-a448709340c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:15.018895 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288c9b4-5ade-4ca8-a7b6-a448709340c0 None admin] PATH_INFO: `/v3/domains/ee779213b62d4e38af17cdc648625675` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:15.028664 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288c9b4-5ade-4ca8-a7b6-a448709340c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ee779213b62d4e38af17cdc648625675)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:15.030165 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288c9b4-5ade-4ca8-a7b6-a448709340c0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:15.031750 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 585/1172] 10.222.0.62 () {56 vars in 1183 bytes} [Wed Apr 6 10:51:14 2022] GET /identity/v3/domains/ee779213b62d4e38af17cdc648625675 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:15.037490 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03ca2e-2094-4fc7-b62a-49e1dbf46f65 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:15.128816 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03ca2e-2094-4fc7-b62a-49e1dbf46f65 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:15.160062 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051f554-650a-4383-8601-4885743b4fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:15.160703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051f554-650a-4383-8601-4885743b4fb9 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:15.160982 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051f554-650a-4383-8601-4885743b4fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:15.161281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051f554-650a-4383-8601-4885743b4fb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:15.161989 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051f554-650a-4383-8601-4885743b4fb9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:15.163392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051f554-650a-4383-8601-4885743b4fb9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:15.263828 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 588/1173] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Apr 6 10:51:15 2022] POST /identity/v3/projects => generated 361 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:51:17.538591 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9078f-748f-4fec-ba4c-4b0419651d0e None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:17.539156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9078f-748f-4fec-ba4c-4b0419651d0e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:17.539156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9078f-748f-4fec-ba4c-4b0419651d0e None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:17.540490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 586/1174] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:51:17.545754 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd68c0b-4f5c-41b2-8c12-4261602341a9 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:17.546134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd68c0b-4f5c-41b2-8c12-4261602341a9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:17.546358 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd68c0b-4f5c-41b2-8c12-4261602341a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:17.563268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-cfd68c0b-4f5c-41b2-8c12-4261602341a9 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:51:17.564449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-cfd68c0b-4f5c-41b2-8c12-4261602341a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:51:17.626195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 589/1175] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:51:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:51:17.652345 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9078f-748f-4fec-ba4c-4b0419651d0e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:17.747894 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9078f-748f-4fec-ba4c-4b0419651d0e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:17.778483 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7c61b-9e7a-4de2-b357-b6461d937a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:17.779322 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7c61b-9e7a-4de2-b357-b6461d937a64 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:17.779602 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7c61b-9e7a-4de2-b357-b6461d937a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:17.779876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7c61b-9e7a-4de2-b357-b6461d937a64 None admin] PATH_INFO: `/v3/domains/ee779213b62d4e38af17cdc648625675` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:17.781029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7c61b-9e7a-4de2-b357-b6461d937a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ee779213b62d4e38af17cdc648625675)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:17.782508 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7c61b-9e7a-4de2-b357-b6461d937a64 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:17.784085 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 587/1176] 10.222.0.62 () {56 vars in 1183 bytes} [Wed Apr 6 10:51:17 2022] GET /identity/v3/domains/ee779213b62d4e38af17cdc648625675 => generated 267 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:17.790362 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd68c0b-4f5c-41b2-8c12-4261602341a9 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:17.881680 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd68c0b-4f5c-41b2-8c12-4261602341a9 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:17.912933 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a0724-78d8-407f-89ca-b4188cbdc67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:17.913618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a0724-78d8-407f-89ca-b4188cbdc67c None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:17.913898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a0724-78d8-407f-89ca-b4188cbdc67c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:17.914169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a0724-78d8-407f-89ca-b4188cbdc67c None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:17.914879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a0724-78d8-407f-89ca-b4188cbdc67c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:17.916294 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a0724-78d8-407f-89ca-b4188cbdc67c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:18.021551 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 590/1177] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:51:17 2022] POST /identity/v3/users => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:51:20.333932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa597bd-222b-4b65-a60a-85a6e7ebdffc None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:20.334971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa597bd-222b-4b65-a60a-85a6e7ebdffc None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:20.334971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa597bd-222b-4b65-a60a-85a6e7ebdffc None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:20.336330 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 588/1178] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:51:20.341551 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da05b19-79e4-4b3b-adba-8bab530a4308 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:20.341972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da05b19-79e4-4b3b-adba-8bab530a4308 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:20.342111 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da05b19-79e4-4b3b-adba-8bab530a4308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:20.358849 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5da05b19-79e4-4b3b-adba-8bab530a4308 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:51:20.360056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5da05b19-79e4-4b3b-adba-8bab530a4308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:51:20.421803 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 591/1179] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:51:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:51:20.446209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa597bd-222b-4b65-a60a-85a6e7ebdffc None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:20.541596 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa597bd-222b-4b65-a60a-85a6e7ebdffc None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:20.572146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01017660-0287-4081-b9ab-7db615cf9dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:20.572915 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01017660-0287-4081-b9ab-7db615cf9dab None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:20.573220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01017660-0287-4081-b9ab-7db615cf9dab None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:20.573490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01017660-0287-4081-b9ab-7db615cf9dab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:20.583288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01017660-0287-4081-b9ab-7db615cf9dab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:51:20.590574 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-01017660-0287-4081-b9ab-7db615cf9dab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:51:20.591659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 589/1180] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:51:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:51:20.597736 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da05b19-79e4-4b3b-adba-8bab530a4308 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:20.689414 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da05b19-79e4-4b3b-adba-8bab530a4308 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:20.721858 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a6856-99ae-4212-aee2-4a93857757ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:20.722515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a6856-99ae-4212-aee2-4a93857757ae None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:20.722795 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a6856-99ae-4212-aee2-4a93857757ae None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:20.723067 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a6856-99ae-4212-aee2-4a93857757ae None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:20.723799 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a6856-99ae-4212-aee2-4a93857757ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:51:20.724101 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a6856-99ae-4212-aee2-4a93857757ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:20.725518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a6856-99ae-4212-aee2-4a93857757ae None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:20.733061 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 592/1181] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:51:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:20.738719 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01017660-0287-4081-b9ab-7db615cf9dab None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:20.892744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01017660-0287-4081-b9ab-7db615cf9dab None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:20.923511 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead92132-f3d4-45e8-a367-31f8f31004cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:20.924355 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead92132-f3d4-45e8-a367-31f8f31004cd None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:20.924632 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead92132-f3d4-45e8-a367-31f8f31004cd None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:20.924901 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead92132-f3d4-45e8-a367-31f8f31004cd None admin] PATH_INFO: `/v3/users/e0668a19a270470bb44f4991710fa2e7` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:20.937278 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead92132-f3d4-45e8-a367-31f8f31004cd None admin] RBAC: Authorizing `identity:get_user(user_id=e0668a19a270470bb44f4991710fa2e7)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:20.938724 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead92132-f3d4-45e8-a367-31f8f31004cd None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:20.940323 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 590/1182] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:51:20 2022] GET /identity/v3/users/e0668a19a270470bb44f4991710fa2e7 => generated 311 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:20.946525 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a6856-99ae-4212-aee2-4a93857757ae None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:21.039939 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a6856-99ae-4212-aee2-4a93857757ae None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:21.072208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3564ff9-c055-49aa-a465-1821dee1f62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:21.072848 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3564ff9-c055-49aa-a465-1821dee1f62b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:21.073158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3564ff9-c055-49aa-a465-1821dee1f62b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:21.073436 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3564ff9-c055-49aa-a465-1821dee1f62b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:21.136241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3564ff9-c055-49aa-a465-1821dee1f62b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:21.137715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3564ff9-c055-49aa-a465-1821dee1f62b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:21.227338 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 593/1183] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:51:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:51:21.233182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead92132-f3d4-45e8-a367-31f8f31004cd None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:21.325175 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead92132-f3d4-45e8-a367-31f8f31004cd None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:21.356261 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e70ea-9801-4b74-8082-d01b839340f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:21.357233 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e70ea-9801-4b74-8082-d01b839340f3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:21.357523 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e70ea-9801-4b74-8082-d01b839340f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:21.357795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e70ea-9801-4b74-8082-d01b839340f3 None admin] PATH_INFO: `/v3/projects/d408dd1ee2c84181b2c0cf3104724bd2` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:21.358958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e70ea-9801-4b74-8082-d01b839340f3 None admin] RBAC: Authorizing `identity:get_project(project_id=d408dd1ee2c84181b2c0cf3104724bd2)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:21.360414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e70ea-9801-4b74-8082-d01b839340f3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:21.362174 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 591/1184] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:51:21 2022] GET /identity/v3/projects/d408dd1ee2c84181b2c0cf3104724bd2 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:21.368653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3564ff9-c055-49aa-a465-1821dee1f62b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:21.461486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3564ff9-c055-49aa-a465-1821dee1f62b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:21.493598 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e32930-b284-4814-a854-eb96f0e751f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:21.494189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e32930-b284-4814-a854-eb96f0e751f8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:21.494474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e32930-b284-4814-a854-eb96f0e751f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:21.494753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e32930-b284-4814-a854-eb96f0e751f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:21.495570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e32930-b284-4814-a854-eb96f0e751f8 None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=d408dd1ee2c84181b2c0cf3104724bd2, user.id=e0668a19a270470bb44f4991710fa2e7) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:51:21.495882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e32930-b284-4814-a854-eb96f0e751f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:21.497310 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e32930-b284-4814-a854-eb96f0e751f8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:21.502515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 594/1185] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:51:21 2022] GET /identity/v3/role_assignments?user.id=e0668a19a270470bb44f4991710fa2e7&scope.project.id=d408dd1ee2c84181b2c0cf3104724bd2&role.id=090ba4d1ae32495289276665920d4a2c => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:23.796070 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f51991-7cd3-4a4a-90f3-e7e048f32585 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:23.796703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f51991-7cd3-4a4a-90f3-e7e048f32585 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:23.796703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f51991-7cd3-4a4a-90f3-e7e048f32585 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:23.798175 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 592/1186] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:51:23.804110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd09b7e-ea23-4a2b-9ff7-a18311e8fdaf None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:23.804547 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd09b7e-ea23-4a2b-9ff7-a18311e8fdaf None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:23.804654 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd09b7e-ea23-4a2b-9ff7-a18311e8fdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:23.821402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-6cd09b7e-ea23-4a2b-9ff7-a18311e8fdaf None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:51:23.822683 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6cd09b7e-ea23-4a2b-9ff7-a18311e8fdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:51:23.885714 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 595/1187] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:51:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:51:23.907988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f51991-7cd3-4a4a-90f3-e7e048f32585 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:24.002223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f51991-7cd3-4a4a-90f3-e7e048f32585 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:24.033672 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ae758-cdd6-460e-87bc-5a19460f80f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:24.034485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ae758-cdd6-460e-87bc-5a19460f80f3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:24.034758 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ae758-cdd6-460e-87bc-5a19460f80f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:24.035024 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ae758-cdd6-460e-87bc-5a19460f80f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:24.046040 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ae758-cdd6-460e-87bc-5a19460f80f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:51:24.055526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-417ae758-cdd6-460e-87bc-5a19460f80f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:51:24.056754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 593/1188] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:51:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:51:24.064530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd09b7e-ea23-4a2b-9ff7-a18311e8fdaf None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:24.157400 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd09b7e-ea23-4a2b-9ff7-a18311e8fdaf None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:24.189169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffaa7cf-0d79-4924-ad2f-5a36125fea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:24.189824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaa7cf-0d79-4924-ad2f-5a36125fea35 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:24.190134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaa7cf-0d79-4924-ad2f-5a36125fea35 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:24.190405 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaa7cf-0d79-4924-ad2f-5a36125fea35 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:24.191135 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffaa7cf-0d79-4924-ad2f-5a36125fea35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:51:24.191437 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffaa7cf-0d79-4924-ad2f-5a36125fea35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:24.192780 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffaa7cf-0d79-4924-ad2f-5a36125fea35 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:24.200363 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 596/1189] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:51:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:24.206147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ae758-cdd6-460e-87bc-5a19460f80f3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:24.298442 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ae758-cdd6-460e-87bc-5a19460f80f3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:24.328906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cc130-3c59-4659-b3fb-56a9a166d570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:24.329770 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc130-3c59-4659-b3fb-56a9a166d570 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:24.330047 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc130-3c59-4659-b3fb-56a9a166d570 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:24.330314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc130-3c59-4659-b3fb-56a9a166d570 None admin] PATH_INFO: `/v3/users/e0668a19a270470bb44f4991710fa2e7` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:24.331463 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cc130-3c59-4659-b3fb-56a9a166d570 None admin] RBAC: Authorizing `identity:get_user(user_id=e0668a19a270470bb44f4991710fa2e7)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:24.332905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cc130-3c59-4659-b3fb-56a9a166d570 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:24.335025 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 594/1190] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:51:24 2022] GET /identity/v3/users/e0668a19a270470bb44f4991710fa2e7 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:51:24.340927 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffaa7cf-0d79-4924-ad2f-5a36125fea35 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:24.434310 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffaa7cf-0d79-4924-ad2f-5a36125fea35 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:24.466118 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3bb12-70b1-4d2a-ba37-a1ab022782d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:24.466952 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3bb12-70b1-4d2a-ba37-a1ab022782d9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:24.467230 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3bb12-70b1-4d2a-ba37-a1ab022782d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:24.467502 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3bb12-70b1-4d2a-ba37-a1ab022782d9 None admin] PATH_INFO: `/v3/projects/d408dd1ee2c84181b2c0cf3104724bd2` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:24.468653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3bb12-70b1-4d2a-ba37-a1ab022782d9 None admin] RBAC: Authorizing `identity:get_project(project_id=d408dd1ee2c84181b2c0cf3104724bd2)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:24.470089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3bb12-70b1-4d2a-ba37-a1ab022782d9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:24.471745 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 597/1191] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:51:24 2022] GET /identity/v3/projects/d408dd1ee2c84181b2c0cf3104724bd2 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:24.477504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cc130-3c59-4659-b3fb-56a9a166d570 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:24.570213 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cc130-3c59-4659-b3fb-56a9a166d570 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:24.601397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98420134-86b5-432e-8696-94e29e159e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:24.602251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98420134-86b5-432e-8696-94e29e159e8c None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:24.602529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98420134-86b5-432e-8696-94e29e159e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:24.602800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98420134-86b5-432e-8696-94e29e159e8c None admin] PATH_INFO: `/v3/projects/d408dd1ee2c84181b2c0cf3104724bd2/users/e0668a19a270470bb44f4991710fa2e7/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:24.604728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98420134-86b5-432e-8696-94e29e159e8c None admin] RBAC: Authorizing `identity:create_grant(project_id=d408dd1ee2c84181b2c0cf3104724bd2, user_id=e0668a19a270470bb44f4991710fa2e7, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:24.606211 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98420134-86b5-432e-8696-94e29e159e8c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:24.678959 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 595/1192] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:51:24 2022] PUT /identity/v3/projects/d408dd1ee2c84181b2c0cf3104724bd2/users/e0668a19a270470bb44f4991710fa2e7/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:51:26.925088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971612e4-e1d2-4952-b27b-8738261a590d None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:26.925608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971612e4-e1d2-4952-b27b-8738261a590d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:26.925608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971612e4-e1d2-4952-b27b-8738261a590d None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:26.926941 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 598/1193] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:51:26.932561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bf1f5-11ae-448f-972b-5bf665ccf55e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:26.932961 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bf1f5-11ae-448f-972b-5bf665ccf55e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:26.933147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bf1f5-11ae-448f-972b-5bf665ccf55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:26.949422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-030bf1f5-11ae-448f-972b-5bf665ccf55e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:51:26.950612 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-030bf1f5-11ae-448f-972b-5bf665ccf55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:51:27.011785 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 596/1194] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:51:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:51:27.036154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971612e4-e1d2-4952-b27b-8738261a590d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:27.132497 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971612e4-e1d2-4952-b27b-8738261a590d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:27.163711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce7f40-9543-4ea4-aabf-989c07e32649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:27.164483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce7f40-9543-4ea4-aabf-989c07e32649 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:27.164761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce7f40-9543-4ea4-aabf-989c07e32649 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:27.165031 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce7f40-9543-4ea4-aabf-989c07e32649 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:27.174596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce7f40-9543-4ea4-aabf-989c07e32649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:51:27.182052 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-6bce7f40-9543-4ea4-aabf-989c07e32649 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:51:27.183175 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 599/1195] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:51:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:51:27.189464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bf1f5-11ae-448f-972b-5bf665ccf55e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:27.281262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bf1f5-11ae-448f-972b-5bf665ccf55e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:27.312621 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5215c22-3d22-4cf9-a6a1-597044c0ecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:27.313360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5215c22-3d22-4cf9-a6a1-597044c0ecc0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:27.313640 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5215c22-3d22-4cf9-a6a1-597044c0ecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:27.313914 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5215c22-3d22-4cf9-a6a1-597044c0ecc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:27.314643 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5215c22-3d22-4cf9-a6a1-597044c0ecc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:51:27.314947 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5215c22-3d22-4cf9-a6a1-597044c0ecc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:27.316345 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5215c22-3d22-4cf9-a6a1-597044c0ecc0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:27.324440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 597/1196] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:51:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:27.330078 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce7f40-9543-4ea4-aabf-989c07e32649 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:27.425015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce7f40-9543-4ea4-aabf-989c07e32649 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:27.457403 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a65568-b5ae-491e-b60a-4913476021fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:27.458211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a65568-b5ae-491e-b60a-4913476021fb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:27.458494 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a65568-b5ae-491e-b60a-4913476021fb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:27.458769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a65568-b5ae-491e-b60a-4913476021fb None admin] PATH_INFO: `/v3/users/e0668a19a270470bb44f4991710fa2e7` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:27.459954 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a65568-b5ae-491e-b60a-4913476021fb None admin] RBAC: Authorizing `identity:get_user(user_id=e0668a19a270470bb44f4991710fa2e7)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:27.461417 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a65568-b5ae-491e-b60a-4913476021fb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:27.463145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 600/1197] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Apr 6 10:51:27 2022] GET /identity/v3/users/e0668a19a270470bb44f4991710fa2e7 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:27.468895 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5215c22-3d22-4cf9-a6a1-597044c0ecc0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:27.560659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5215c22-3d22-4cf9-a6a1-597044c0ecc0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:27.592335 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3c45d-0198-4907-8eb1-280afe73d950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:27.592958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3c45d-0198-4907-8eb1-280afe73d950 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:27.593261 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3c45d-0198-4907-8eb1-280afe73d950 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:27.593532 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3c45d-0198-4907-8eb1-280afe73d950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:27.654895 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3c45d-0198-4907-8eb1-280afe73d950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:27.656367 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3c45d-0198-4907-8eb1-280afe73d950 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:27.753611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 598/1198] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:51:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:51:27.761461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a65568-b5ae-491e-b60a-4913476021fb None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:27.855776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a65568-b5ae-491e-b60a-4913476021fb None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:27.888402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5cd91-538f-409f-8039-30be94bb48da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:27.889284 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5cd91-538f-409f-8039-30be94bb48da None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:27.889570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5cd91-538f-409f-8039-30be94bb48da None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:27.889847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5cd91-538f-409f-8039-30be94bb48da None admin] PATH_INFO: `/v3/projects/d408dd1ee2c84181b2c0cf3104724bd2` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:27.891055 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5cd91-538f-409f-8039-30be94bb48da None admin] RBAC: Authorizing `identity:get_project(project_id=d408dd1ee2c84181b2c0cf3104724bd2)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:27.892474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5cd91-538f-409f-8039-30be94bb48da None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:27.894187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 601/1199] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Apr 6 10:51:27 2022] GET /identity/v3/projects/d408dd1ee2c84181b2c0cf3104724bd2 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:51:27.900714 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3c45d-0198-4907-8eb1-280afe73d950 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:51:27.991438 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3c45d-0198-4907-8eb1-280afe73d950 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:51:28.023126 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5882d-0bb7-4bfb-b4d0-1d9855a68a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:51:28.023729 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5882d-0bb7-4bfb-b4d0-1d9855a68a3c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:51:28.024003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5882d-0bb7-4bfb-b4d0-1d9855a68a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:51:28.024271 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5882d-0bb7-4bfb-b4d0-1d9855a68a3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:51:28.025588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5882d-0bb7-4bfb-b4d0-1d9855a68a3c None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=d408dd1ee2c84181b2c0cf3104724bd2, user.id=e0668a19a270470bb44f4991710fa2e7) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:51:28.026053 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5882d-0bb7-4bfb-b4d0-1d9855a68a3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:51:28.028266 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5882d-0bb7-4bfb-b4d0-1d9855a68a3c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:51:28.035339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 599/1200] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:51:27 2022] GET /identity/v3/role_assignments?user.id=e0668a19a270470bb44f4991710fa2e7&scope.project.id=d408dd1ee2c84181b2c0cf3104724bd2&role.id=090ba4d1ae32495289276665920d4a2c => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:45.903790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deea75-5074-493e-9e19-d37a3a5cabb6 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:45.904359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deea75-5074-493e-9e19-d37a3a5cabb6 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:45.904359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deea75-5074-493e-9e19-d37a3a5cabb6 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:45.905687 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 602/1201] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:52:45.910963 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891f91b-15a9-4098-a6ba-fe97c3c0cfb6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:45.911404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891f91b-15a9-4098-a6ba-fe97c3c0cfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:45.911504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891f91b-15a9-4098-a6ba-fe97c3c0cfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:45.927943 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9891f91b-15a9-4098-a6ba-fe97c3c0cfb6 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:52:45.929084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9891f91b-15a9-4098-a6ba-fe97c3c0cfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:52:45.992046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 600/1202] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:52:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:52:46.018202 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1deea75-5074-493e-9e19-d37a3a5cabb6 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:46.114571 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1deea75-5074-493e-9e19-d37a3a5cabb6 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:46.147606 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0482a87-2161-42e0-9f77-39004395586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:46.148392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0482a87-2161-42e0-9f77-39004395586f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:46.148669 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0482a87-2161-42e0-9f77-39004395586f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:46.148935 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0482a87-2161-42e0-9f77-39004395586f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:46.159228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0482a87-2161-42e0-9f77-39004395586f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:46.160654 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0482a87-2161-42e0-9f77-39004395586f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:46.177942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-e0482a87-2161-42e0-9f77-39004395586f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:52:46.179242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 603/1203] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:46.185596 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891f91b-15a9-4098-a6ba-fe97c3c0cfb6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:46.277634 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891f91b-15a9-4098-a6ba-fe97c3c0cfb6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:46.309129 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c002499-a5f2-4d77-926f-10dca9e15ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:46.309822 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002499-a5f2-4d77-926f-10dca9e15ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:46.310359 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002499-a5f2-4d77-926f-10dca9e15ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:46.310628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002499-a5f2-4d77-926f-10dca9e15ee9 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:46.311340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c002499-a5f2-4d77-926f-10dca9e15ee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:46.311641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c002499-a5f2-4d77-926f-10dca9e15ee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:46.313032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c002499-a5f2-4d77-926f-10dca9e15ee9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:46.324735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 601/1204] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:46.330393 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0482a87-2161-42e0-9f77-39004395586f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:46.423405 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0482a87-2161-42e0-9f77-39004395586f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:46.456182 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90700a-2f76-4e38-9952-aa066a7cffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:46.456778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90700a-2f76-4e38-9952-aa066a7cffbf None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:46.457074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90700a-2f76-4e38-9952-aa066a7cffbf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:46.457354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90700a-2f76-4e38-9952-aa066a7cffbf None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:46.458034 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90700a-2f76-4e38-9952-aa066a7cffbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:46.459477 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90700a-2f76-4e38-9952-aa066a7cffbf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:46.546463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 604/1205] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Apr 6 10:52:46 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:52:48.878040 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d82dab-f783-45de-8fde-9722aa941ca8 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:48.878574 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d82dab-f783-45de-8fde-9722aa941ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:48.878574 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d82dab-f783-45de-8fde-9722aa941ca8 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:48.879913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 602/1206] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:52:48.885668 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bdbf-57e9-4fb9-b613-3bb7bf6ba08e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:48.889203 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bdbf-57e9-4fb9-b613-3bb7bf6ba08e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:48.889203 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bdbf-57e9-4fb9-b613-3bb7bf6ba08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:48.902893 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a204bdbf-57e9-4fb9-b613-3bb7bf6ba08e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:52:48.904258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a204bdbf-57e9-4fb9-b613-3bb7bf6ba08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:52:48.969134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 605/1207] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:52:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:52:48.994461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d82dab-f783-45de-8fde-9722aa941ca8 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:49.090149 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d82dab-f783-45de-8fde-9722aa941ca8 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:49.122892 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1549908-995d-455e-8cbf-1c125d1609d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:49.123673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1549908-995d-455e-8cbf-1c125d1609d1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:49.123951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1549908-995d-455e-8cbf-1c125d1609d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:49.124223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1549908-995d-455e-8cbf-1c125d1609d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:49.133983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1549908-995d-455e-8cbf-1c125d1609d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:52:49.140899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-e1549908-995d-455e-8cbf-1c125d1609d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:52:49.142770 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 603/1208] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:52:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:49.148089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204bdbf-57e9-4fb9-b613-3bb7bf6ba08e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:49.260499 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204bdbf-57e9-4fb9-b613-3bb7bf6ba08e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:49.296340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e9db4-e7f0-4b54-aebd-162f5943e9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:49.297068 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e9db4-e7f0-4b54-aebd-162f5943e9bc None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:49.297386 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e9db4-e7f0-4b54-aebd-162f5943e9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:49.297662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e9db4-e7f0-4b54-aebd-162f5943e9bc None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:49.298407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e9db4-e7f0-4b54-aebd-162f5943e9bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:49.298718 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e9db4-e7f0-4b54-aebd-162f5943e9bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:49.300082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e9db4-e7f0-4b54-aebd-162f5943e9bc None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:49.308520 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 606/1209] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:52:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:49.314503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1549908-995d-455e-8cbf-1c125d1609d1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:49.408595 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1549908-995d-455e-8cbf-1c125d1609d1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:49.440112 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad7d02-3cae-497a-a670-3bb22e0b6af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:49.440930 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad7d02-3cae-497a-a670-3bb22e0b6af6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:49.441237 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad7d02-3cae-497a-a670-3bb22e0b6af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:49.441513 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad7d02-3cae-497a-a670-3bb22e0b6af6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:49.451472 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad7d02-3cae-497a-a670-3bb22e0b6af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:49.452938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad7d02-3cae-497a-a670-3bb22e0b6af6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:49.469255 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-4bad7d02-3cae-497a-a670-3bb22e0b6af6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:52:49.471837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 604/1210] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:49.476261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e9db4-e7f0-4b54-aebd-162f5943e9bc None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:49.573148 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e9db4-e7f0-4b54-aebd-162f5943e9bc None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:49.606659 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6be02f-885a-4fac-b37c-e5e88b6ce3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:49.607323 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6be02f-885a-4fac-b37c-e5e88b6ce3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:49.607609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6be02f-885a-4fac-b37c-e5e88b6ce3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:49.607887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6be02f-885a-4fac-b37c-e5e88b6ce3c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:49.608659 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6be02f-885a-4fac-b37c-e5e88b6ce3c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:49.609001 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6be02f-885a-4fac-b37c-e5e88b6ce3c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:49.612588 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6be02f-885a-4fac-b37c-e5e88b6ce3c2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:49.621882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 607/1211] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:49.627577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad7d02-3cae-497a-a670-3bb22e0b6af6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:49.723222 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad7d02-3cae-497a-a670-3bb22e0b6af6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:49.754446 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56df943-0a3a-49aa-b9eb-e35d57e111af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:49.755230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56df943-0a3a-49aa-b9eb-e35d57e111af None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:49.755504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56df943-0a3a-49aa-b9eb-e35d57e111af None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:49.755772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56df943-0a3a-49aa-b9eb-e35d57e111af None admin] PATH_INFO: `/v3/users/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:49.764284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56df943-0a3a-49aa-b9eb-e35d57e111af None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:49.765779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56df943-0a3a-49aa-b9eb-e35d57e111af None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:49.779351 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-f56df943-0a3a-49aa-b9eb-e35d57e111af None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 10:52:49.784736 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 605/1212] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:52:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:49.786431 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6be02f-885a-4fac-b37c-e5e88b6ce3c2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:49.881635 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6be02f-885a-4fac-b37c-e5e88b6ce3c2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:49.913361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878f229-e76b-48f4-a7f6-d68f9a0be657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:49.914041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878f229-e76b-48f4-a7f6-d68f9a0be657 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:49.914308 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878f229-e76b-48f4-a7f6-d68f9a0be657 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:49.914583 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878f229-e76b-48f4-a7f6-d68f9a0be657 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:49.915406 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878f229-e76b-48f4-a7f6-d68f9a0be657 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:49.916202 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878f229-e76b-48f4-a7f6-d68f9a0be657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:49.917654 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878f229-e76b-48f4-a7f6-d68f9a0be657 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:49.935352 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 608/1213] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Apr 6 10:52:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:49.941239 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56df943-0a3a-49aa-b9eb-e35d57e111af None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:50.033976 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56df943-0a3a-49aa-b9eb-e35d57e111af None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:50.065976 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d414-ab2f-4c4f-b273-819b9cd2e308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:50.066599 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d414-ab2f-4c4f-b273-819b9cd2e308 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:50.066876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d414-ab2f-4c4f-b273-819b9cd2e308 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:50.067147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d414-ab2f-4c4f-b273-819b9cd2e308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:50.129947 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311d414-ab2f-4c4f-b273-819b9cd2e308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:50.131403 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311d414-ab2f-4c4f-b273-819b9cd2e308 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:50.222365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 606/1214] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:52:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:52:50.228833 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878f229-e76b-48f4-a7f6-d68f9a0be657 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:50.327047 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878f229-e76b-48f4-a7f6-d68f9a0be657 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:50.359765 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8bcc6-83cc-4e0c-bc4c-409ceb50bd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:50.360639 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8bcc6-83cc-4e0c-bc4c-409ceb50bd33 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:50.360922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8bcc6-83cc-4e0c-bc4c-409ceb50bd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:50.361222 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8bcc6-83cc-4e0c-bc4c-409ceb50bd33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:50.371035 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8bcc6-83cc-4e0c-bc4c-409ceb50bd33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:50.372582 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8bcc6-83cc-4e0c-bc4c-409ceb50bd33 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:50.389289 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-22e8bcc6-83cc-4e0c-bc4c-409ceb50bd33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:52:50.390498 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 609/1215] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:50.396182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d414-ab2f-4c4f-b273-819b9cd2e308 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:50.491412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d414-ab2f-4c4f-b273-819b9cd2e308 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:50.523587 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2ee06-1d26-439a-a025-29a7ad597630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:50.524231 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ee06-1d26-439a-a025-29a7ad597630 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:50.524510 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ee06-1d26-439a-a025-29a7ad597630 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:50.524781 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ee06-1d26-439a-a025-29a7ad597630 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:50.526121 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2ee06-1d26-439a-a025-29a7ad597630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:50.526423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2ee06-1d26-439a-a025-29a7ad597630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:50.527862 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2ee06-1d26-439a-a025-29a7ad597630 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:50.538316 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 607/1216] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:50.544006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8bcc6-83cc-4e0c-bc4c-409ceb50bd33 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:50.638871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8bcc6-83cc-4e0c-bc4c-409ceb50bd33 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:50.671605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a318a1f-0e84-476e-a321-b51bf4e23b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:50.672399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a318a1f-0e84-476e-a321-b51bf4e23b7c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:50.672684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a318a1f-0e84-476e-a321-b51bf4e23b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:50.672963 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a318a1f-0e84-476e-a321-b51bf4e23b7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:50.679590 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a318a1f-0e84-476e-a321-b51bf4e23b7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:50.681016 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a318a1f-0e84-476e-a321-b51bf4e23b7c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:50.694167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-8a318a1f-0e84-476e-a321-b51bf4e23b7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:52:50.696642 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 610/1217] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:52:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:50.701677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2ee06-1d26-439a-a025-29a7ad597630 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:50.796693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2ee06-1d26-439a-a025-29a7ad597630 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:50.828197 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95ec87-2cf1-4b9d-a6ec-f17a6c7584e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:50.828846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ec87-2cf1-4b9d-a6ec-f17a6c7584e8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:50.829152 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ec87-2cf1-4b9d-a6ec-f17a6c7584e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:50.829427 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ec87-2cf1-4b9d-a6ec-f17a6c7584e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:50.830196 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95ec87-2cf1-4b9d-a6ec-f17a6c7584e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:50.830536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95ec87-2cf1-4b9d-a6ec-f17a6c7584e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:50.831996 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95ec87-2cf1-4b9d-a6ec-f17a6c7584e8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:50.843872 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 608/1218] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:52:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:50.850055 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a318a1f-0e84-476e-a321-b51bf4e23b7c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:50.944575 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a318a1f-0e84-476e-a321-b51bf4e23b7c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:50.976244 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078077e-c124-4b77-bae8-b0fa6c542319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:50.976894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078077e-c124-4b77-bae8-b0fa6c542319 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:50.977295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078077e-c124-4b77-bae8-b0fa6c542319 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:50.977577 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078077e-c124-4b77-bae8-b0fa6c542319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:50.978425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078077e-c124-4b77-bae8-b0fa6c542319 None admin] RBAC: Adding query filter params (role.id=07e6d0f9bf5345c99ce158cd3e62c1c5, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=1bd095449a5b44c6b1c9aca712edc11b) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:50.978737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078077e-c124-4b77-bae8-b0fa6c542319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:50.980151 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078077e-c124-4b77-bae8-b0fa6c542319 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:50.985503 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 611/1219] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:52:50 2022] GET /identity/v3/role_assignments?user.id=1bd095449a5b44c6b1c9aca712edc11b&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:53.260136 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d18239-8690-419e-81e4-c203d94aefb9 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:53.260671 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d18239-8690-419e-81e4-c203d94aefb9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:53.260825 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d18239-8690-419e-81e4-c203d94aefb9 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:53.262210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 609/1220] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:52:53.267513 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd772068-e133-4d59-819d-21644e860dd7 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:53.267947 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd772068-e133-4d59-819d-21644e860dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:53.268074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd772068-e133-4d59-819d-21644e860dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:53.284951 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-cd772068-e133-4d59-819d-21644e860dd7 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:52:53.286169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-cd772068-e133-4d59-819d-21644e860dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:52:53.350948 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 612/1221] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:52:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:52:53.374195 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d18239-8690-419e-81e4-c203d94aefb9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:53.471216 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d18239-8690-419e-81e4-c203d94aefb9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:53.503328 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd80fe-64eb-4f66-90a0-12b27708ab86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:53.504100 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd80fe-64eb-4f66-90a0-12b27708ab86 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:53.504423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd80fe-64eb-4f66-90a0-12b27708ab86 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:53.504695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd80fe-64eb-4f66-90a0-12b27708ab86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:53.514646 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd80fe-64eb-4f66-90a0-12b27708ab86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:52:53.521452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-42bd80fe-64eb-4f66-90a0-12b27708ab86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:52:53.522603 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 610/1222] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:52:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:53.530844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd772068-e133-4d59-819d-21644e860dd7 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:53.628776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd772068-e133-4d59-819d-21644e860dd7 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:53.662387 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6514924-3a6f-4876-a4dc-22bf7db5e73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:53.663054 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6514924-3a6f-4876-a4dc-22bf7db5e73f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:53.663338 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6514924-3a6f-4876-a4dc-22bf7db5e73f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:53.663608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6514924-3a6f-4876-a4dc-22bf7db5e73f None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:53.664346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6514924-3a6f-4876-a4dc-22bf7db5e73f None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:53.664880 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6514924-3a6f-4876-a4dc-22bf7db5e73f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:53.666298 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6514924-3a6f-4876-a4dc-22bf7db5e73f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:53.674354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 613/1223] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:52:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:53.680102 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd80fe-64eb-4f66-90a0-12b27708ab86 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:53.776503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd80fe-64eb-4f66-90a0-12b27708ab86 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:53.807522 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec0f8f-9ba5-4696-96e7-4e372eeb7cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:53.808308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0f8f-9ba5-4696-96e7-4e372eeb7cef None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:53.808587 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0f8f-9ba5-4696-96e7-4e372eeb7cef None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:53.808864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0f8f-9ba5-4696-96e7-4e372eeb7cef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:53.819246 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec0f8f-9ba5-4696-96e7-4e372eeb7cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:53.820711 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec0f8f-9ba5-4696-96e7-4e372eeb7cef None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:53.836742 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-8dec0f8f-9ba5-4696-96e7-4e372eeb7cef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:52:53.838553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 611/1224] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:53.844412 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6514924-3a6f-4876-a4dc-22bf7db5e73f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:53.940643 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6514924-3a6f-4876-a4dc-22bf7db5e73f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:53.972513 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6801e-48bc-4f60-9039-9064f1170a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:53.974281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6801e-48bc-4f60-9039-9064f1170a76 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:53.974281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6801e-48bc-4f60-9039-9064f1170a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:53.974281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6801e-48bc-4f60-9039-9064f1170a76 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:53.974531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6801e-48bc-4f60-9039-9064f1170a76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:53.974747 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6801e-48bc-4f60-9039-9064f1170a76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:53.976099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6801e-48bc-4f60-9039-9064f1170a76 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:53.987428 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 614/1225] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:53.993077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec0f8f-9ba5-4696-96e7-4e372eeb7cef None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:54.087468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec0f8f-9ba5-4696-96e7-4e372eeb7cef None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:54.118279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9902261-9127-4d33-8c83-18bfe0a0985c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:54.119557 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9902261-9127-4d33-8c83-18bfe0a0985c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:54.119831 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9902261-9127-4d33-8c83-18bfe0a0985c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:54.120100 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9902261-9127-4d33-8c83-18bfe0a0985c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:54.127210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9902261-9127-4d33-8c83-18bfe0a0985c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:54.128705 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9902261-9127-4d33-8c83-18bfe0a0985c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:54.142369 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-c9902261-9127-4d33-8c83-18bfe0a0985c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 10:52:54.143514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 612/1226] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:52:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:54.149278 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6801e-48bc-4f60-9039-9064f1170a76 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:54.241812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6801e-48bc-4f60-9039-9064f1170a76 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:54.274463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6d34d-514d-4431-9845-1f18ccaccc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:54.275171 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d34d-514d-4431-9845-1f18ccaccc93 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:54.275451 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d34d-514d-4431-9845-1f18ccaccc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:54.275724 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d34d-514d-4431-9845-1f18ccaccc93 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:54.276548 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6d34d-514d-4431-9845-1f18ccaccc93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:54.276856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6d34d-514d-4431-9845-1f18ccaccc93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:54.278306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6d34d-514d-4431-9845-1f18ccaccc93 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:54.295169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 615/1227] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Apr 6 10:52:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:52:54.300815 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9902261-9127-4d33-8c83-18bfe0a0985c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:54.398469 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9902261-9127-4d33-8c83-18bfe0a0985c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:54.430090 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f8075-891f-4492-bf81-565d3332f859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:54.430868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f8075-891f-4492-bf81-565d3332f859 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:54.431147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f8075-891f-4492-bf81-565d3332f859 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:54.432030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f8075-891f-4492-bf81-565d3332f859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:54.442215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f8075-891f-4492-bf81-565d3332f859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:54.443682 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f8075-891f-4492-bf81-565d3332f859 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:54.460427 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-bb1f8075-891f-4492-bf81-565d3332f859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:52:54.461720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 613/1228] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:54.468082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6d34d-514d-4431-9845-1f18ccaccc93 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:54.561657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6d34d-514d-4431-9845-1f18ccaccc93 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:54.594212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c227b9-46c8-49f2-b192-7142a21536eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:54.594869 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c227b9-46c8-49f2-b192-7142a21536eb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:54.595154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c227b9-46c8-49f2-b192-7142a21536eb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:54.595432 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c227b9-46c8-49f2-b192-7142a21536eb None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:54.596148 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c227b9-46c8-49f2-b192-7142a21536eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:54.596450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c227b9-46c8-49f2-b192-7142a21536eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:54.597829 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c227b9-46c8-49f2-b192-7142a21536eb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:54.608662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 616/1229] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:54.614296 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f8075-891f-4492-bf81-565d3332f859 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:54.712992 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f8075-891f-4492-bf81-565d3332f859 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:54.745169 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fff4f-4204-4c9d-a708-15c51d4c22bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:54.745956 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fff4f-4204-4c9d-a708-15c51d4c22bf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:54.746240 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fff4f-4204-4c9d-a708-15c51d4c22bf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:54.746514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fff4f-4204-4c9d-a708-15c51d4c22bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:54.752891 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fff4f-4204-4c9d-a708-15c51d4c22bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:54.754395 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fff4f-4204-4c9d-a708-15c51d4c22bf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:54.768981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-5a1fff4f-4204-4c9d-a708-15c51d4c22bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:52:54.770160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 614/1230] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:52:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:54.776050 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c227b9-46c8-49f2-b192-7142a21536eb None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:54.869905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c227b9-46c8-49f2-b192-7142a21536eb None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:54.901229 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafb885-91ce-40c9-94a2-3b78dac60e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:54.901880 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafb885-91ce-40c9-94a2-3b78dac60e7f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:54.902158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafb885-91ce-40c9-94a2-3b78dac60e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:54.902451 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafb885-91ce-40c9-94a2-3b78dac60e7f None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:54.903221 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafb885-91ce-40c9-94a2-3b78dac60e7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:54.903525 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafb885-91ce-40c9-94a2-3b78dac60e7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:54.905085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafb885-91ce-40c9-94a2-3b78dac60e7f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:54.917006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 617/1231] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:52:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:54.922841 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fff4f-4204-4c9d-a708-15c51d4c22bf None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:55.028459 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fff4f-4204-4c9d-a708-15c51d4c22bf None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:55.060911 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d1858-16d2-4c81-8369-b9006ab70fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:55.061833 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d1858-16d2-4c81-8369-b9006ab70fda None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:55.062115 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d1858-16d2-4c81-8369-b9006ab70fda None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:55.062386 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d1858-16d2-4c81-8369-b9006ab70fda None admin] PATH_INFO: `/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/1bd095449a5b44c6b1c9aca712edc11b/roles/07e6d0f9bf5345c99ce158cd3e62c1c5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:55.075814 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d1858-16d2-4c81-8369-b9006ab70fda None admin] RBAC: Authorizing `identity:create_grant(project_id=a4306a6b12434cc495650e4f3b9afbde, user_id=1bd095449a5b44c6b1c9aca712edc11b, role_id=07e6d0f9bf5345c99ce158cd3e62c1c5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:55.077311 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d1858-16d2-4c81-8369-b9006ab70fda None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:55.161847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 615/1232] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:52:54 2022] PUT /identity/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/1bd095449a5b44c6b1c9aca712edc11b/roles/07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:52:57.427796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db01ed0-e2f2-42ad-ac2e-39000df7def0 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:57.428346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db01ed0-e2f2-42ad-ac2e-39000df7def0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:57.428346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db01ed0-e2f2-42ad-ac2e-39000df7def0 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:57.429753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 618/1233] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:52:57.435886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce64ffa-01b9-4dcc-ae8c-4f5b0be249e1 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:57.436307 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce64ffa-01b9-4dcc-ae8c-4f5b0be249e1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:57.439167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce64ffa-01b9-4dcc-ae8c-4f5b0be249e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:57.452114 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6ce64ffa-01b9-4dcc-ae8c-4f5b0be249e1 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:52:57.453337 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6ce64ffa-01b9-4dcc-ae8c-4f5b0be249e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:52:57.515973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 616/1234] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:52:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 10:52:57.540467 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db01ed0-e2f2-42ad-ac2e-39000df7def0 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:57.638591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db01ed0-e2f2-42ad-ac2e-39000df7def0 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:57.673940 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67473c6d-2f4e-467a-abf0-ff8d7f6c6170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:57.674753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67473c6d-2f4e-467a-abf0-ff8d7f6c6170 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:57.675031 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67473c6d-2f4e-467a-abf0-ff8d7f6c6170 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:57.675317 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67473c6d-2f4e-467a-abf0-ff8d7f6c6170 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:57.685643 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67473c6d-2f4e-467a-abf0-ff8d7f6c6170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:52:57.692587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-67473c6d-2f4e-467a-abf0-ff8d7f6c6170 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:52:57.693928 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 619/1235] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Apr 6 10:52:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:57.699881 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce64ffa-01b9-4dcc-ae8c-4f5b0be249e1 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:57.795606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce64ffa-01b9-4dcc-ae8c-4f5b0be249e1 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:57.826813 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504bd37-c691-4380-877f-fdbf47cc33cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:57.827469 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504bd37-c691-4380-877f-fdbf47cc33cf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:57.827746 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504bd37-c691-4380-877f-fdbf47cc33cf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:57.828014 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504bd37-c691-4380-877f-fdbf47cc33cf None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:57.828733 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504bd37-c691-4380-877f-fdbf47cc33cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:57.829031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504bd37-c691-4380-877f-fdbf47cc33cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:57.830456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504bd37-c691-4380-877f-fdbf47cc33cf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:57.838661 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 617/1236] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Apr 6 10:52:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:57.844897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67473c6d-2f4e-467a-abf0-ff8d7f6c6170 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:57.940095 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67473c6d-2f4e-467a-abf0-ff8d7f6c6170 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:57.971944 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f849bc-beff-45f8-9e8a-b80fac1628a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:57.972727 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f849bc-beff-45f8-9e8a-b80fac1628a5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:57.973011 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f849bc-beff-45f8-9e8a-b80fac1628a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:57.973321 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f849bc-beff-45f8-9e8a-b80fac1628a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:57.984051 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f849bc-beff-45f8-9e8a-b80fac1628a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:57.985517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f849bc-beff-45f8-9e8a-b80fac1628a5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:58.001676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-93f849bc-beff-45f8-9e8a-b80fac1628a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:52:58.002906 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 620/1237] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:58.008925 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504bd37-c691-4380-877f-fdbf47cc33cf None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:58.103100 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504bd37-c691-4380-877f-fdbf47cc33cf None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:58.135443 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abec1ac-f5e2-4179-96e9-31704e8a3a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:58.136091 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abec1ac-f5e2-4179-96e9-31704e8a3a76 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:58.136371 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abec1ac-f5e2-4179-96e9-31704e8a3a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:58.136644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abec1ac-f5e2-4179-96e9-31704e8a3a76 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:58.137385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abec1ac-f5e2-4179-96e9-31704e8a3a76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:58.137689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abec1ac-f5e2-4179-96e9-31704e8a3a76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:58.139092 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abec1ac-f5e2-4179-96e9-31704e8a3a76 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:58.149641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 618/1238] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:58.155473 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f849bc-beff-45f8-9e8a-b80fac1628a5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:58.249576 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f849bc-beff-45f8-9e8a-b80fac1628a5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:58.280495 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27639cfb-6c92-4ab6-bd5c-fc04ff4b0a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:58.281462 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27639cfb-6c92-4ab6-bd5c-fc04ff4b0a64 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:58.281743 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27639cfb-6c92-4ab6-bd5c-fc04ff4b0a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:58.282010 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27639cfb-6c92-4ab6-bd5c-fc04ff4b0a64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:58.289158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27639cfb-6c92-4ab6-bd5c-fc04ff4b0a64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:58.290568 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27639cfb-6c92-4ab6-bd5c-fc04ff4b0a64 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:58.309401 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-27639cfb-6c92-4ab6-bd5c-fc04ff4b0a64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 10:52:58.311037 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 621/1239] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:52:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:58.316859 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abec1ac-f5e2-4179-96e9-31704e8a3a76 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:58.410850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abec1ac-f5e2-4179-96e9-31704e8a3a76 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:58.443246 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9183a2-4c1d-476e-b0c9-d0938153d544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:58.443906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9183a2-4c1d-476e-b0c9-d0938153d544 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:58.444199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9183a2-4c1d-476e-b0c9-d0938153d544 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:58.444455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9183a2-4c1d-476e-b0c9-d0938153d544 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:58.445307 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9183a2-4c1d-476e-b0c9-d0938153d544 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:58.445611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9183a2-4c1d-476e-b0c9-d0938153d544 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:58.447069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9183a2-4c1d-476e-b0c9-d0938153d544 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:58.464689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 619/1240] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Apr 6 10:52:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:58.470442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27639cfb-6c92-4ab6-bd5c-fc04ff4b0a64 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:58.564954 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27639cfb-6c92-4ab6-bd5c-fc04ff4b0a64 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:58.596619 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54583120-6ff7-4fba-bdd9-1dd86c7382e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:58.597313 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54583120-6ff7-4fba-bdd9-1dd86c7382e1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:58.597596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54583120-6ff7-4fba-bdd9-1dd86c7382e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:58.597870 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54583120-6ff7-4fba-bdd9-1dd86c7382e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:58.661932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54583120-6ff7-4fba-bdd9-1dd86c7382e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:58.739590 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54583120-6ff7-4fba-bdd9-1dd86c7382e1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:58.757468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 622/1241] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:52:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:52:58.763958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9183a2-4c1d-476e-b0c9-d0938153d544 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:58.859648 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9183a2-4c1d-476e-b0c9-d0938153d544 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:58.891126 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3e6df-ef27-489e-8bfa-814f4426e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:58.891904 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3e6df-ef27-489e-8bfa-814f4426e890 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:58.892184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3e6df-ef27-489e-8bfa-814f4426e890 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:58.892458 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3e6df-ef27-489e-8bfa-814f4426e890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:58.902542 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3e6df-ef27-489e-8bfa-814f4426e890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:58.904177 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3e6df-ef27-489e-8bfa-814f4426e890 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:58.920117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-aac3e6df-ef27-489e-8bfa-814f4426e890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:52:58.921308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 620/1242] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:58.927160 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54583120-6ff7-4fba-bdd9-1dd86c7382e1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:59.022372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54583120-6ff7-4fba-bdd9-1dd86c7382e1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:59.054565 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a939624-ba7a-49bd-83e1-6fd71c64db1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:59.058487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a939624-ba7a-49bd-83e1-6fd71c64db1f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:59.058487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a939624-ba7a-49bd-83e1-6fd71c64db1f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:59.058487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a939624-ba7a-49bd-83e1-6fd71c64db1f None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:59.058487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a939624-ba7a-49bd-83e1-6fd71c64db1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:59.058487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a939624-ba7a-49bd-83e1-6fd71c64db1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:59.058487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a939624-ba7a-49bd-83e1-6fd71c64db1f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:59.069607 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 623/1243] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:59.075835 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3e6df-ef27-489e-8bfa-814f4426e890 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:59.171084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3e6df-ef27-489e-8bfa-814f4426e890 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:59.202716 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfdcd4-4e2e-482d-8592-9e32d3fd9b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:59.203488 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfdcd4-4e2e-482d-8592-9e32d3fd9b74 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:59.203766 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfdcd4-4e2e-482d-8592-9e32d3fd9b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:59.204035 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfdcd4-4e2e-482d-8592-9e32d3fd9b74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:59.210416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfdcd4-4e2e-482d-8592-9e32d3fd9b74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:59.213324 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfdcd4-4e2e-482d-8592-9e32d3fd9b74 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:59.225027 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-6fbfdcd4-4e2e-482d-8592-9e32d3fd9b74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:52:59.226192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 621/1244] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:52:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:52:59.232627 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a939624-ba7a-49bd-83e1-6fd71c64db1f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:59.329166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a939624-ba7a-49bd-83e1-6fd71c64db1f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:59.362929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a6293-667a-424a-86ae-f91a13f08533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:59.363587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a6293-667a-424a-86ae-f91a13f08533 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:59.363891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a6293-667a-424a-86ae-f91a13f08533 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:59.364147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a6293-667a-424a-86ae-f91a13f08533 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:59.364929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a6293-667a-424a-86ae-f91a13f08533 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:59.365268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a6293-667a-424a-86ae-f91a13f08533 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:59.366684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a6293-667a-424a-86ae-f91a13f08533 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:59.378853 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 624/1245] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:52:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:52:59.385288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfdcd4-4e2e-482d-8592-9e32d3fd9b74 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:52:59.482262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfdcd4-4e2e-482d-8592-9e32d3fd9b74 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:52:59.514797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec64ea5-17ae-4c17-99b8-91e66d1a14c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:52:59.515439 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec64ea5-17ae-4c17-99b8-91e66d1a14c2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:52:59.515720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec64ea5-17ae-4c17-99b8-91e66d1a14c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:52:59.515996 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec64ea5-17ae-4c17-99b8-91e66d1a14c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:52:59.516819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec64ea5-17ae-4c17-99b8-91e66d1a14c2 None admin] RBAC: Adding query filter params (role.id=07e6d0f9bf5345c99ce158cd3e62c1c5, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=1bd095449a5b44c6b1c9aca712edc11b) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:52:59.517155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec64ea5-17ae-4c17-99b8-91e66d1a14c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:52:59.518612 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec64ea5-17ae-4c17-99b8-91e66d1a14c2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:52:59.524243 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 622/1246] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:52:59 2022] GET /identity/v3/role_assignments?user.id=1bd095449a5b44c6b1c9aca712edc11b&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=07e6d0f9bf5345c99ce158cd3e62c1c5 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:53:01.886796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a57207-150a-42ca-ba6b-72e24addbab0 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:01.887319 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a57207-150a-42ca-ba6b-72e24addbab0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:01.887319 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a57207-150a-42ca-ba6b-72e24addbab0 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:01.888748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 625/1247] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:53:01.893843 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c35608-9ebe-49b1-bb31-4de73bb0908c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:01.894246 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c35608-9ebe-49b1-bb31-4de73bb0908c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:01.894395 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c35608-9ebe-49b1-bb31-4de73bb0908c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:01.911027 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c7c35608-9ebe-49b1-bb31-4de73bb0908c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:53:01.912230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c7c35608-9ebe-49b1-bb31-4de73bb0908c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:53:01.975930 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 623/1248] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:53:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:53:02.001169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a57207-150a-42ca-ba6b-72e24addbab0 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:02.097321 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a57207-150a-42ca-ba6b-72e24addbab0 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:02.129342 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ba97d-1663-4637-b99d-14913d4003fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:02.130131 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ba97d-1663-4637-b99d-14913d4003fa None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:02.130412 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ba97d-1663-4637-b99d-14913d4003fa None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:02.130684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ba97d-1663-4637-b99d-14913d4003fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:02.140246 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ba97d-1663-4637-b99d-14913d4003fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:53:02.147132 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-4b8ba97d-1663-4637-b99d-14913d4003fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:53:02.148307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 626/1249] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:02.154940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c35608-9ebe-49b1-bb31-4de73bb0908c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:02.250378 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c35608-9ebe-49b1-bb31-4de73bb0908c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:02.282055 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217854e-b99d-4ddf-a8e3-d888e8f9b3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:02.282714 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217854e-b99d-4ddf-a8e3-d888e8f9b3da None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:02.282997 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217854e-b99d-4ddf-a8e3-d888e8f9b3da None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:02.283273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217854e-b99d-4ddf-a8e3-d888e8f9b3da None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:02.284004 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217854e-b99d-4ddf-a8e3-d888e8f9b3da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:02.284308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217854e-b99d-4ddf-a8e3-d888e8f9b3da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:02.285765 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217854e-b99d-4ddf-a8e3-d888e8f9b3da None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:02.294143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 624/1250] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:53:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:02.299901 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ba97d-1663-4637-b99d-14913d4003fa None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:02.393357 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ba97d-1663-4637-b99d-14913d4003fa None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:02.426087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462ce51-f20a-45e9-a88b-68461b6fe3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:02.426874 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462ce51-f20a-45e9-a88b-68461b6fe3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:02.427248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462ce51-f20a-45e9-a88b-68461b6fe3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:02.427530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462ce51-f20a-45e9-a88b-68461b6fe3c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:02.437959 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462ce51-f20a-45e9-a88b-68461b6fe3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:02.439398 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462ce51-f20a-45e9-a88b-68461b6fe3c1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:02.455573 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-d462ce51-f20a-45e9-a88b-68461b6fe3c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:53:02.456805 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 627/1251] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:02.462598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217854e-b99d-4ddf-a8e3-d888e8f9b3da None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:02.558891 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217854e-b99d-4ddf-a8e3-d888e8f9b3da None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:02.591334 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60001dcd-add8-44c9-bfcc-f5323f6e1929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:02.591990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60001dcd-add8-44c9-bfcc-f5323f6e1929 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:02.592268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60001dcd-add8-44c9-bfcc-f5323f6e1929 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:02.592539 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60001dcd-add8-44c9-bfcc-f5323f6e1929 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:02.593280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60001dcd-add8-44c9-bfcc-f5323f6e1929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:02.593585 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60001dcd-add8-44c9-bfcc-f5323f6e1929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:02.595018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60001dcd-add8-44c9-bfcc-f5323f6e1929 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:02.606102 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 625/1252] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:02.611846 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462ce51-f20a-45e9-a88b-68461b6fe3c1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:02.707360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462ce51-f20a-45e9-a88b-68461b6fe3c1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:02.739634 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04be16-3376-4eca-972c-f54c6cf98cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:02.740428 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04be16-3376-4eca-972c-f54c6cf98cdf None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:02.740713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04be16-3376-4eca-972c-f54c6cf98cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:02.740988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04be16-3376-4eca-972c-f54c6cf98cdf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:02.749177 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04be16-3376-4eca-972c-f54c6cf98cdf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:02.750605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04be16-3376-4eca-972c-f54c6cf98cdf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:02.764376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-8f04be16-3376-4eca-972c-f54c6cf98cdf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 10:53:02.765563 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 628/1253] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:53:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:02.771451 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60001dcd-add8-44c9-bfcc-f5323f6e1929 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:02.870422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60001dcd-add8-44c9-bfcc-f5323f6e1929 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:02.902551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a59b5c-b40e-4a36-b616-379191a73bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:02.904974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59b5c-b40e-4a36-b616-379191a73bad None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:02.904974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59b5c-b40e-4a36-b616-379191a73bad None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:02.904974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59b5c-b40e-4a36-b616-379191a73bad None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:02.904974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a59b5c-b40e-4a36-b616-379191a73bad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:02.904974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a59b5c-b40e-4a36-b616-379191a73bad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:02.906346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a59b5c-b40e-4a36-b616-379191a73bad None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:02.922721 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 626/1254] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Apr 6 10:53:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:02.928583 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04be16-3376-4eca-972c-f54c6cf98cdf None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:03.024140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04be16-3376-4eca-972c-f54c6cf98cdf None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:03.056363 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd267a-4c1c-4214-b906-fe5fa8ef9135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:03.057010 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd267a-4c1c-4214-b906-fe5fa8ef9135 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:03.057325 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd267a-4c1c-4214-b906-fe5fa8ef9135 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:03.058082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd267a-4c1c-4214-b906-fe5fa8ef9135 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:03.121401 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd267a-4c1c-4214-b906-fe5fa8ef9135 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:03.122766 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd267a-4c1c-4214-b906-fe5fa8ef9135 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:03.213738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 629/1255] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:53:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:53:03.219618 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a59b5c-b40e-4a36-b616-379191a73bad None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:03.312448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a59b5c-b40e-4a36-b616-379191a73bad None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:03.343292 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44217ea-b862-441e-baf3-82531d0f1b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:03.344062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44217ea-b862-441e-baf3-82531d0f1b4a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:03.344334 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44217ea-b862-441e-baf3-82531d0f1b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:03.344600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44217ea-b862-441e-baf3-82531d0f1b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:03.354154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44217ea-b862-441e-baf3-82531d0f1b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:03.364006 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44217ea-b862-441e-baf3-82531d0f1b4a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:03.372724 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-b44217ea-b862-441e-baf3-82531d0f1b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:53:03.373825 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 627/1256] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:03.379724 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd267a-4c1c-4214-b906-fe5fa8ef9135 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:03.473511 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd267a-4c1c-4214-b906-fe5fa8ef9135 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:03.507452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a845-e6e5-421a-821f-3c64b0c11619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:03.508115 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a845-e6e5-421a-821f-3c64b0c11619 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:03.508396 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a845-e6e5-421a-821f-3c64b0c11619 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:03.508671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a845-e6e5-421a-821f-3c64b0c11619 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:03.509421 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55a845-e6e5-421a-821f-3c64b0c11619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:03.509729 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55a845-e6e5-421a-821f-3c64b0c11619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:03.511170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55a845-e6e5-421a-821f-3c64b0c11619 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:03.521983 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 630/1257] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:03.527664 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44217ea-b862-441e-baf3-82531d0f1b4a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:03.622837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44217ea-b862-441e-baf3-82531d0f1b4a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:03.654520 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9116753-febc-442f-9bb5-df55c7c5f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:03.655304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9116753-febc-442f-9bb5-df55c7c5f523 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:03.655578 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9116753-febc-442f-9bb5-df55c7c5f523 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:03.655847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9116753-febc-442f-9bb5-df55c7c5f523 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:03.662346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9116753-febc-442f-9bb5-df55c7c5f523 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:03.663815 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9116753-febc-442f-9bb5-df55c7c5f523 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:03.677011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-a9116753-febc-442f-9bb5-df55c7c5f523 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:53:03.678199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 628/1258] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:53:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:03.684085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a845-e6e5-421a-821f-3c64b0c11619 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:03.779329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a845-e6e5-421a-821f-3c64b0c11619 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:03.812374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f47108-1d13-45c0-abab-ae19facd4585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:03.813026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f47108-1d13-45c0-abab-ae19facd4585 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:03.813334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f47108-1d13-45c0-abab-ae19facd4585 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:03.813609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f47108-1d13-45c0-abab-ae19facd4585 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:03.814384 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f47108-1d13-45c0-abab-ae19facd4585 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:03.814691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f47108-1d13-45c0-abab-ae19facd4585 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:03.816141 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f47108-1d13-45c0-abab-ae19facd4585 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:03.827978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 631/1259] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:53:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:03.833977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9116753-febc-442f-9bb5-df55c7c5f523 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:03.931730 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9116753-febc-442f-9bb5-df55c7c5f523 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:03.963177 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b5e77-5cbb-419f-b9c8-581fe552e8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:03.964314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b5e77-5cbb-419f-b9c8-581fe552e8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:03.964588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b5e77-5cbb-419f-b9c8-581fe552e8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:03.964858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b5e77-5cbb-419f-b9c8-581fe552e8c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:03.965697 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b5e77-5cbb-419f-b9c8-581fe552e8c9 None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=1bd095449a5b44c6b1c9aca712edc11b) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:03.966004 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b5e77-5cbb-419f-b9c8-581fe552e8c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:03.967581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b5e77-5cbb-419f-b9c8-581fe552e8c9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:03.972622 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 629/1260] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:53:03 2022] GET /identity/v3/role_assignments?user.id=1bd095449a5b44c6b1c9aca712edc11b&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=090ba4d1ae32495289276665920d4a2c => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:06.225257 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2777c-6bd1-4d86-80e9-d8c04ce9412e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:06.225819 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2777c-6bd1-4d86-80e9-d8c04ce9412e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:06.225819 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2777c-6bd1-4d86-80e9-d8c04ce9412e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:06.227202 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 632/1261] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:53:06.232930 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a170167-f797-41c7-9317-2ee0e992038e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:06.233359 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a170167-f797-41c7-9317-2ee0e992038e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:06.233530 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a170167-f797-41c7-9317-2ee0e992038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:06.250202 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7a170167-f797-41c7-9317-2ee0e992038e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:53:06.251378 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7a170167-f797-41c7-9317-2ee0e992038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:53:06.313669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 630/1262] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:53:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:53:06.335831 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2777c-6bd1-4d86-80e9-d8c04ce9412e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:06.432397 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2777c-6bd1-4d86-80e9-d8c04ce9412e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:06.465501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a0b90-fc17-4ef5-9224-0a20897a0a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:06.466279 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a0b90-fc17-4ef5-9224-0a20897a0a18 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:06.466555 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a0b90-fc17-4ef5-9224-0a20897a0a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:06.466820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a0b90-fc17-4ef5-9224-0a20897a0a18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:06.479813 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a0b90-fc17-4ef5-9224-0a20897a0a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:53:06.483649 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-157a0b90-fc17-4ef5-9224-0a20897a0a18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:53:06.484808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 633/1263] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:53:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:06.492172 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a170167-f797-41c7-9317-2ee0e992038e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:06.585793 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a170167-f797-41c7-9317-2ee0e992038e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:06.617881 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4b43e-6c2b-4d5d-a402-4ee8914bef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:06.618526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4b43e-6c2b-4d5d-a402-4ee8914bef8d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:06.618800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4b43e-6c2b-4d5d-a402-4ee8914bef8d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:06.619069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4b43e-6c2b-4d5d-a402-4ee8914bef8d None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:06.619797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4b43e-6c2b-4d5d-a402-4ee8914bef8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:06.620140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4b43e-6c2b-4d5d-a402-4ee8914bef8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:06.621566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4b43e-6c2b-4d5d-a402-4ee8914bef8d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:06.629329 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 631/1264] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:53:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:53:06.635192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a0b90-fc17-4ef5-9224-0a20897a0a18 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:06.733401 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a0b90-fc17-4ef5-9224-0a20897a0a18 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:06.764857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a236-3ff8-402b-b988-dbd582acb697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:06.765670 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a236-3ff8-402b-b988-dbd582acb697 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:06.765950 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a236-3ff8-402b-b988-dbd582acb697 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:06.766222 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a236-3ff8-402b-b988-dbd582acb697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:06.776875 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6a236-3ff8-402b-b988-dbd582acb697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:06.778334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6a236-3ff8-402b-b988-dbd582acb697 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:06.794976 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-fbd6a236-3ff8-402b-b988-dbd582acb697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:53:06.796559 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 634/1265] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:06.802405 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4b43e-6c2b-4d5d-a402-4ee8914bef8d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:06.896178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4b43e-6c2b-4d5d-a402-4ee8914bef8d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:06.930798 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582237b0-6b44-4150-8309-639e9419e30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:06.931782 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582237b0-6b44-4150-8309-639e9419e30c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:06.932150 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582237b0-6b44-4150-8309-639e9419e30c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:06.932457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582237b0-6b44-4150-8309-639e9419e30c None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:06.933207 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582237b0-6b44-4150-8309-639e9419e30c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:06.933518 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582237b0-6b44-4150-8309-639e9419e30c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:06.935179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582237b0-6b44-4150-8309-639e9419e30c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:06.946296 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 632/1266] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:06.952101 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a236-3ff8-402b-b988-dbd582acb697 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:07.048131 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a236-3ff8-402b-b988-dbd582acb697 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:07.080237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bb523-b226-4c54-a601-ea8d19cf92f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:07.081028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bb523-b226-4c54-a601-ea8d19cf92f3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:07.081341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bb523-b226-4c54-a601-ea8d19cf92f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:07.081617 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bb523-b226-4c54-a601-ea8d19cf92f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:07.089601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bb523-b226-4c54-a601-ea8d19cf92f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:07.091029 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bb523-b226-4c54-a601-ea8d19cf92f3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:07.104363 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-c31bb523-b226-4c54-a601-ea8d19cf92f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 10:53:07.105619 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 635/1267] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:53:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:07.111551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582237b0-6b44-4150-8309-639e9419e30c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:07.205241 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582237b0-6b44-4150-8309-639e9419e30c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:07.237077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bbaf9-790f-40bd-a016-0f403a38412c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:07.237737 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bbaf9-790f-40bd-a016-0f403a38412c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:07.238099 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bbaf9-790f-40bd-a016-0f403a38412c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:07.238288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bbaf9-790f-40bd-a016-0f403a38412c None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:07.239108 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bbaf9-790f-40bd-a016-0f403a38412c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:07.239414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bbaf9-790f-40bd-a016-0f403a38412c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:07.240871 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bbaf9-790f-40bd-a016-0f403a38412c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:07.257235 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 633/1268] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Apr 6 10:53:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:53:07.263419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bb523-b226-4c54-a601-ea8d19cf92f3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:07.357674 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bb523-b226-4c54-a601-ea8d19cf92f3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:07.389987 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86027299-fccf-4faa-8a7f-2581ee2bf211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:07.390801 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86027299-fccf-4faa-8a7f-2581ee2bf211 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:07.391080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86027299-fccf-4faa-8a7f-2581ee2bf211 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:07.391349 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86027299-fccf-4faa-8a7f-2581ee2bf211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:07.401461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86027299-fccf-4faa-8a7f-2581ee2bf211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:07.402938 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86027299-fccf-4faa-8a7f-2581ee2bf211 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:07.418599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-86027299-fccf-4faa-8a7f-2581ee2bf211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:53:07.419741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 636/1269] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:53:07.425585 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bbaf9-790f-40bd-a016-0f403a38412c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:07.520031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bbaf9-790f-40bd-a016-0f403a38412c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:07.553746 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8a29a-10af-4e43-8163-e44763510f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:07.554401 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8a29a-10af-4e43-8163-e44763510f11 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:07.554683 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8a29a-10af-4e43-8163-e44763510f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:07.554958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8a29a-10af-4e43-8163-e44763510f11 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:07.555676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8a29a-10af-4e43-8163-e44763510f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:07.555981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8a29a-10af-4e43-8163-e44763510f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:07.557897 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8a29a-10af-4e43-8163-e44763510f11 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:07.568896 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 634/1270] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:07.575271 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86027299-fccf-4faa-8a7f-2581ee2bf211 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:07.671244 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86027299-fccf-4faa-8a7f-2581ee2bf211 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:07.704637 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960748c0-8455-4c0f-aa90-981b86ce3158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:07.705455 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960748c0-8455-4c0f-aa90-981b86ce3158 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:07.705736 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960748c0-8455-4c0f-aa90-981b86ce3158 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:07.706006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960748c0-8455-4c0f-aa90-981b86ce3158 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:07.712445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960748c0-8455-4c0f-aa90-981b86ce3158 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:07.713921 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960748c0-8455-4c0f-aa90-981b86ce3158 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:07.728240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-960748c0-8455-4c0f-aa90-981b86ce3158 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:53:07.729929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 637/1271] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:53:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:07.735921 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8a29a-10af-4e43-8163-e44763510f11 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:07.830650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8a29a-10af-4e43-8163-e44763510f11 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:07.862046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4f6bd-43be-4197-97f9-bec5771fc049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:07.862687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4f6bd-43be-4197-97f9-bec5771fc049 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:07.862964 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4f6bd-43be-4197-97f9-bec5771fc049 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:07.863236 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4f6bd-43be-4197-97f9-bec5771fc049 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:07.864007 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4f6bd-43be-4197-97f9-bec5771fc049 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:07.864310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4f6bd-43be-4197-97f9-bec5771fc049 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:07.865791 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4f6bd-43be-4197-97f9-bec5771fc049 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:07.877628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 635/1272] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:53:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:07.883570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960748c0-8455-4c0f-aa90-981b86ce3158 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:07.979897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960748c0-8455-4c0f-aa90-981b86ce3158 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:08.013339 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb5f35-d0b0-4743-aead-a6f520ae654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:08.014224 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb5f35-d0b0-4743-aead-a6f520ae654a None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:08.014502 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb5f35-d0b0-4743-aead-a6f520ae654a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:08.014776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb5f35-d0b0-4743-aead-a6f520ae654a None admin] PATH_INFO: `/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/1bd095449a5b44c6b1c9aca712edc11b/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:08.016711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb5f35-d0b0-4743-aead-a6f520ae654a None admin] RBAC: Authorizing `identity:create_grant(project_id=a4306a6b12434cc495650e4f3b9afbde, user_id=1bd095449a5b44c6b1c9aca712edc11b, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:08.018200 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb5f35-d0b0-4743-aead-a6f520ae654a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:08.077627 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 638/1273] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Apr 6 10:53:07 2022] PUT /identity/v3/projects/a4306a6b12434cc495650e4f3b9afbde/users/1bd095449a5b44c6b1c9aca712edc11b/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:53:10.375881 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146af46-3a93-4c3a-a109-02c3f54f5d36 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:10.376455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146af46-3a93-4c3a-a109-02c3f54f5d36 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:10.376455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146af46-3a93-4c3a-a109-02c3f54f5d36 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:10.377870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 636/1274] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:53:10.383836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9597009-23d6-49ad-b28d-9063f96d16ee None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:10.384234 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9597009-23d6-49ad-b28d-9063f96d16ee None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:10.384395 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9597009-23d6-49ad-b28d-9063f96d16ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:10.400862 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d9597009-23d6-49ad-b28d-9063f96d16ee None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:53:10.402542 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d9597009-23d6-49ad-b28d-9063f96d16ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:53:10.465790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 639/1275] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:53:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:53:10.490802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146af46-3a93-4c3a-a109-02c3f54f5d36 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:10.599245 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146af46-3a93-4c3a-a109-02c3f54f5d36 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:10.635240 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8d46a-9b0e-4a16-b7a2-d8482182205b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:10.636057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8d46a-9b0e-4a16-b7a2-d8482182205b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:10.636336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8d46a-9b0e-4a16-b7a2-d8482182205b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:10.636607 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8d46a-9b0e-4a16-b7a2-d8482182205b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:10.648962 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8d46a-9b0e-4a16-b7a2-d8482182205b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 10:53:10.658848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-c7c8d46a-9b0e-4a16-b7a2-d8482182205b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:53:10.660345 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 637/1276] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Apr 6 10:53:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:10.667834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9597009-23d6-49ad-b28d-9063f96d16ee None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:10.785295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9597009-23d6-49ad-b28d-9063f96d16ee None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:10.820339 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a510b-3fef-4f50-ac7c-68418affbed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:10.821034 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a510b-3fef-4f50-ac7c-68418affbed8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:10.821346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a510b-3fef-4f50-ac7c-68418affbed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:10.821623 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a510b-3fef-4f50-ac7c-68418affbed8 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:10.822389 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a510b-3fef-4f50-ac7c-68418affbed8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:10.822697 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a510b-3fef-4f50-ac7c-68418affbed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:10.824676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a510b-3fef-4f50-ac7c-68418affbed8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:10.833647 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 640/1277] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Apr 6 10:53:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:10.840166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8d46a-9b0e-4a16-b7a2-d8482182205b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:10.943436 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8d46a-9b0e-4a16-b7a2-d8482182205b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:10.987374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da943c-f0dc-4bb8-b46d-7094523d00d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:10.988178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da943c-f0dc-4bb8-b46d-7094523d00d2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:10.988507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da943c-f0dc-4bb8-b46d-7094523d00d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:10.988792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da943c-f0dc-4bb8-b46d-7094523d00d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:11.000988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da943c-f0dc-4bb8-b46d-7094523d00d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:11.002572 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da943c-f0dc-4bb8-b46d-7094523d00d2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:11.019780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-b9da943c-f0dc-4bb8-b46d-7094523d00d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:53:11.021018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 638/1278] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:53:11.027402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a510b-3fef-4f50-ac7c-68418affbed8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:11.126260 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a510b-3fef-4f50-ac7c-68418affbed8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:11.158471 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d0b16-242e-4157-953d-a97da8f3bdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:11.159140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d0b16-242e-4157-953d-a97da8f3bdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:11.159517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d0b16-242e-4157-953d-a97da8f3bdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:11.159963 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d0b16-242e-4157-953d-a97da8f3bdc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:11.160704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d0b16-242e-4157-953d-a97da8f3bdc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:11.161014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d0b16-242e-4157-953d-a97da8f3bdc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:11.162700 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d0b16-242e-4157-953d-a97da8f3bdc1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:11.174884 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 641/1279] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:11.180647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da943c-f0dc-4bb8-b46d-7094523d00d2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:11.277483 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da943c-f0dc-4bb8-b46d-7094523d00d2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:11.310534 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a4345-c401-4c0c-b55d-c4661b5f0073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:11.311334 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4345-c401-4c0c-b55d-c4661b5f0073 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:11.311613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4345-c401-4c0c-b55d-c4661b5f0073 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:11.311884 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4345-c401-4c0c-b55d-c4661b5f0073 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:11.319267 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a4345-c401-4c0c-b55d-c4661b5f0073 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:11.320833 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a4345-c401-4c0c-b55d-c4661b5f0073 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:11.334538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-728a4345-c401-4c0c-b55d-c4661b5f0073 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 10:53:11.335721 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 639/1280] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:53:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:11.341714 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d0b16-242e-4157-953d-a97da8f3bdc1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:11.440628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d0b16-242e-4157-953d-a97da8f3bdc1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:11.474797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a3a8d-361b-4f22-b5cb-7710a6e9cf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:11.475469 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3a8d-361b-4f22-b5cb-7710a6e9cf45 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:11.475750 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3a8d-361b-4f22-b5cb-7710a6e9cf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:11.476028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3a8d-361b-4f22-b5cb-7710a6e9cf45 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:11.476856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a3a8d-361b-4f22-b5cb-7710a6e9cf45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:11.477201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a3a8d-361b-4f22-b5cb-7710a6e9cf45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:11.478639 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a3a8d-361b-4f22-b5cb-7710a6e9cf45 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:11.499986 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 642/1281] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Apr 6 10:53:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:11.505851 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a4345-c401-4c0c-b55d-c4661b5f0073 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:11.611878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a4345-c401-4c0c-b55d-c4661b5f0073 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:11.646535 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff003047-d040-424a-828d-e09059e28fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:11.647190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff003047-d040-424a-828d-e09059e28fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:11.647474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff003047-d040-424a-828d-e09059e28fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:11.647804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff003047-d040-424a-828d-e09059e28fd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:11.711899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff003047-d040-424a-828d-e09059e28fd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:11.713411 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff003047-d040-424a-828d-e09059e28fd0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:11.805622 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 640/1282] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Apr 6 10:53:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 10:53:11.812326 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a3a8d-361b-4f22-b5cb-7710a6e9cf45 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:11.908316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a3a8d-361b-4f22-b5cb-7710a6e9cf45 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:11.940125 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512b2c9-de7d-4e8c-96c1-2afec17cee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:11.943531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512b2c9-de7d-4e8c-96c1-2afec17cee84 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:11.943531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512b2c9-de7d-4e8c-96c1-2afec17cee84 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:11.943531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512b2c9-de7d-4e8c-96c1-2afec17cee84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:11.951647 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512b2c9-de7d-4e8c-96c1-2afec17cee84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:11.953081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512b2c9-de7d-4e8c-96c1-2afec17cee84 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:11.969253 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-4512b2c9-de7d-4e8c-96c1-2afec17cee84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:53:11.970408 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 643/1283] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 10:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:11.976141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff003047-d040-424a-828d-e09059e28fd0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:12.075215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff003047-d040-424a-828d-e09059e28fd0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:12.106452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38452fd6-058f-462a-945f-4f6ec3613afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:12.107105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38452fd6-058f-462a-945f-4f6ec3613afa None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:12.110397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38452fd6-058f-462a-945f-4f6ec3613afa None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:12.110397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38452fd6-058f-462a-945f-4f6ec3613afa None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:12.110397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38452fd6-058f-462a-945f-4f6ec3613afa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:12.110397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38452fd6-058f-462a-945f-4f6ec3613afa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:12.110397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38452fd6-058f-462a-945f-4f6ec3613afa None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:12.121499 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 641/1284] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Apr 6 10:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:12.127229 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512b2c9-de7d-4e8c-96c1-2afec17cee84 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:12.225196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512b2c9-de7d-4e8c-96c1-2afec17cee84 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:12.258226 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3f0f9-d706-49ce-ac92-9ec6d74a083d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:12.259042 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3f0f9-d706-49ce-ac92-9ec6d74a083d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:12.259326 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3f0f9-d706-49ce-ac92-9ec6d74a083d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:12.259599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3f0f9-d706-49ce-ac92-9ec6d74a083d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:12.266072 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3f0f9-d706-49ce-ac92-9ec6d74a083d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:12.267492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3f0f9-d706-49ce-ac92-9ec6d74a083d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:12.280245 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.application [None req-9eb3f0f9-d706-49ce-ac92-9ec6d74a083d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:53:12.281426 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 644/1285] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Apr 6 10:53:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:12.287282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38452fd6-058f-462a-945f-4f6ec3613afa None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:12.394804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38452fd6-058f-462a-945f-4f6ec3613afa None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:12.426529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087e436-4667-4aee-afa7-e3dfdeedde65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:12.427177 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087e436-4667-4aee-afa7-e3dfdeedde65 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:12.427462 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087e436-4667-4aee-afa7-e3dfdeedde65 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:12.427736 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087e436-4667-4aee-afa7-e3dfdeedde65 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:12.428504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087e436-4667-4aee-afa7-e3dfdeedde65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:12.428811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087e436-4667-4aee-afa7-e3dfdeedde65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:12.430311 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087e436-4667-4aee-afa7-e3dfdeedde65 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:12.442467 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 642/1286] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Apr 6 10:53:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:53:12.448536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3f0f9-d706-49ce-ac92-9ec6d74a083d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:12.543559 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3f0f9-d706-49ce-ac92-9ec6d74a083d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:12.576100 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f683f7-9f17-46b8-9434-4cc46bc56ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:12.576748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f683f7-9f17-46b8-9434-4cc46bc56ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:12.577030 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f683f7-9f17-46b8-9434-4cc46bc56ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:12.577339 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f683f7-9f17-46b8-9434-4cc46bc56ba0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:12.578161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f683f7-9f17-46b8-9434-4cc46bc56ba0 None admin] RBAC: Adding query filter params (role.id=090ba4d1ae32495289276665920d4a2c, scope.project.id=a4306a6b12434cc495650e4f3b9afbde, user.id=1bd095449a5b44c6b1c9aca712edc11b) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:12.578473 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f683f7-9f17-46b8-9434-4cc46bc56ba0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:12.579896 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f683f7-9f17-46b8-9434-4cc46bc56ba0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:12.585579 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 645/1287] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Apr 6 10:53:12 2022] GET /identity/v3/role_assignments?user.id=1bd095449a5b44c6b1c9aca712edc11b&scope.project.id=a4306a6b12434cc495650e4f3b9afbde&role.id=090ba4d1ae32495289276665920d4a2c => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:14.899716 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b2b47-ec70-464a-a63e-19f5cf11bbc4 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:14.900265 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b2b47-ec70-464a-a63e-19f5cf11bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:14.900265 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b2b47-ec70-464a-a63e-19f5cf11bbc4 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:14.901723 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 643/1288] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:53:14.906769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c1e6a-880d-422d-ab0e-c1a29d0c2e09 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:14.907151 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c1e6a-880d-422d-ab0e-c1a29d0c2e09 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:14.907316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c1e6a-880d-422d-ab0e-c1a29d0c2e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:14.923859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d89c1e6a-880d-422d-ab0e-c1a29d0c2e09 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:53:14.924964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d89c1e6a-880d-422d-ab0e-c1a29d0c2e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:53:14.988419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 646/1289] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:53:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:53:15.013283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b2b47-ec70-464a-a63e-19f5cf11bbc4 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:15.131591 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b2b47-ec70-464a-a63e-19f5cf11bbc4 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:15.163230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759adb1-80f3-431e-92f1-853dc0ea8d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:15.164007 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759adb1-80f3-431e-92f1-853dc0ea8d31 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:15.164283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759adb1-80f3-431e-92f1-853dc0ea8d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:15.164552 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759adb1-80f3-431e-92f1-853dc0ea8d31 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:15.165219 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759adb1-80f3-431e-92f1-853dc0ea8d31 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:15.166638 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759adb1-80f3-431e-92f1-853dc0ea8d31 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:15.177463 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-5759adb1-80f3-431e-92f1-853dc0ea8d31 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 06 10:53:15.178545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 644/1290] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Apr 6 10:53:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:15.186831 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c1e6a-880d-422d-ab0e-c1a29d0c2e09 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:15.280588 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c1e6a-880d-422d-ab0e-c1a29d0c2e09 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:15.313481 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e00d2-1e99-4f03-8148-084b77327ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:15.314136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e00d2-1e99-4f03-8148-084b77327ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:15.314417 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e00d2-1e99-4f03-8148-084b77327ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:15.314687 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e00d2-1e99-4f03-8148-084b77327ce6 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:15.315377 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e00d2-1e99-4f03-8148-084b77327ce6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:15.315677 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e00d2-1e99-4f03-8148-084b77327ce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:15.317081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e00d2-1e99-4f03-8148-084b77327ce6 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:15.321713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 647/1291] 10.222.0.62 () {56 vars in 1116 bytes} [Wed Apr 6 10:53:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:15.327430 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759adb1-80f3-431e-92f1-853dc0ea8d31 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:15.434844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759adb1-80f3-431e-92f1-853dc0ea8d31 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:15.465750 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e041d98-e42e-4d2f-aeed-7a7a686674b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:15.466410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e041d98-e42e-4d2f-aeed-7a7a686674b3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:15.466691 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e041d98-e42e-4d2f-aeed-7a7a686674b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:15.466970 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e041d98-e42e-4d2f-aeed-7a7a686674b3 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:15.467666 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e041d98-e42e-4d2f-aeed-7a7a686674b3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:15.467973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e041d98-e42e-4d2f-aeed-7a7a686674b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:15.469404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e041d98-e42e-4d2f-aeed-7a7a686674b3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:15.473658 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 645/1292] 10.222.0.62 () {56 vars in 1116 bytes} [Wed Apr 6 10:53:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:17.749615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216188c-803f-40da-a0f8-0a9d75e5bf54 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:17.750115 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216188c-803f-40da-a0f8-0a9d75e5bf54 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:17.750221 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216188c-803f-40da-a0f8-0a9d75e5bf54 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:17.751540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 648/1293] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:53:17.756641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac275e2-3343-4185-872c-5842e7e1ed7f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:17.757086 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac275e2-3343-4185-872c-5842e7e1ed7f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:17.757220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac275e2-3343-4185-872c-5842e7e1ed7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:17.773393 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-aac275e2-3343-4185-872c-5842e7e1ed7f None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:53:17.774566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-aac275e2-3343-4185-872c-5842e7e1ed7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:53:17.837993 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 646/1294] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:53:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:53:17.863017 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216188c-803f-40da-a0f8-0a9d75e5bf54 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:17.959983 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216188c-803f-40da-a0f8-0a9d75e5bf54 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:17.992566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc05465-1465-4786-8b48-a2b98a18b467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:17.993255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc05465-1465-4786-8b48-a2b98a18b467 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:17.993536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc05465-1465-4786-8b48-a2b98a18b467 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:17.993807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc05465-1465-4786-8b48-a2b98a18b467 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:17.994516 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc05465-1465-4786-8b48-a2b98a18b467 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:17.995909 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc05465-1465-4786-8b48-a2b98a18b467 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:18.077169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 649/1295] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Apr 6 10:53:17 2022] POST /identity/v3/services => generated 246 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:53:20.351217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e05aa-0b8e-48ff-a9ba-88128b2b3bb1 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:20.351860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e05aa-0b8e-48ff-a9ba-88128b2b3bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:20.351860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e05aa-0b8e-48ff-a9ba-88128b2b3bb1 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:20.353268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 647/1296] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:53:20.359379 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40833b-508c-4cdc-89ae-43f1062521b0 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:20.359790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40833b-508c-4cdc-89ae-43f1062521b0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:20.360262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40833b-508c-4cdc-89ae-43f1062521b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:20.379301 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5c40833b-508c-4cdc-89ae-43f1062521b0 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:53:20.380544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5c40833b-508c-4cdc-89ae-43f1062521b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:53:20.453907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 650/1297] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:53:20 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:53:20.478611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e05aa-0b8e-48ff-a9ba-88128b2b3bb1 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:20.575292 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e05aa-0b8e-48ff-a9ba-88128b2b3bb1 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:20.607401 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcec0d-40ea-4fd5-9c04-b37a07c31c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:20.608138 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcec0d-40ea-4fd5-9c04-b37a07c31c49 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:20.608416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcec0d-40ea-4fd5-9c04-b37a07c31c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:20.608693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcec0d-40ea-4fd5-9c04-b37a07c31c49 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:20.609385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcec0d-40ea-4fd5-9c04-b37a07c31c49 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:20.610801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcec0d-40ea-4fd5-9c04-b37a07c31c49 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:20.621608 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-fdfcec0d-40ea-4fd5-9c04-b37a07c31c49 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 06 10:53:20.622758 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 648/1298] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Apr 6 10:53:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:20.628997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40833b-508c-4cdc-89ae-43f1062521b0 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:20.724835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40833b-508c-4cdc-89ae-43f1062521b0 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:20.756530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9b766-f934-4514-8442-d517bd81f33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:20.757241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b766-f934-4514-8442-d517bd81f33f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:20.757530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b766-f934-4514-8442-d517bd81f33f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:20.757800 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b766-f934-4514-8442-d517bd81f33f None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:20.758500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9b766-f934-4514-8442-d517bd81f33f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:20.758806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9b766-f934-4514-8442-d517bd81f33f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:20.760691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9b766-f934-4514-8442-d517bd81f33f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:20.765852 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 651/1299] 10.222.0.62 () {56 vars in 1116 bytes} [Wed Apr 6 10:53:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:20.771927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcec0d-40ea-4fd5-9c04-b37a07c31c49 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:20.867231 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcec0d-40ea-4fd5-9c04-b37a07c31c49 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:20.899641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63126ebc-6bc8-4fa8-a638-ec075468ca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:20.900283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63126ebc-6bc8-4fa8-a638-ec075468ca9d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:20.900563 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63126ebc-6bc8-4fa8-a638-ec075468ca9d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:20.900866 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63126ebc-6bc8-4fa8-a638-ec075468ca9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:20.901675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63126ebc-6bc8-4fa8-a638-ec075468ca9d None admin] RBAC: Adding query filter params (interface=public, service_id=854b76737b084eef8f6bf6ced12fe9bc, region_id=RegionOne) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:20.901987 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63126ebc-6bc8-4fa8-a638-ec075468ca9d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:20.903425 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63126ebc-6bc8-4fa8-a638-ec075468ca9d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:20.908237 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 649/1300] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Apr 6 10:53:20 2022] GET /identity/v3/endpoints?service_id=854b76737b084eef8f6bf6ced12fe9bc&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:20.913889 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9b766-f934-4514-8442-d517bd81f33f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:21.008772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9b766-f934-4514-8442-d517bd81f33f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:21.041379 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968edbd-ae9d-498a-aaa1-b0d199ffb932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:21.042036 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968edbd-ae9d-498a-aaa1-b0d199ffb932 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:21.042321 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968edbd-ae9d-498a-aaa1-b0d199ffb932 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:21.042597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968edbd-ae9d-498a-aaa1-b0d199ffb932 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:21.043267 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968edbd-ae9d-498a-aaa1-b0d199ffb932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:21.044621 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968edbd-ae9d-498a-aaa1-b0d199ffb932 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:21.051283 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 652/1301] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Apr 6 10:53:20 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:53:23.342957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d6457-f5ab-471a-9e5d-cb62de392ce0 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:23.343499 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d6457-f5ab-471a-9e5d-cb62de392ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:23.343499 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d6457-f5ab-471a-9e5d-cb62de392ce0 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:23.344951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 650/1302] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:53:23.350165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a220-195b-44e1-86c6-b30eae1d4fab None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:23.354622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a220-195b-44e1-86c6-b30eae1d4fab None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:23.354622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a220-195b-44e1-86c6-b30eae1d4fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:23.367466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-2508a220-195b-44e1-86c6-b30eae1d4fab None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:53:23.368628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2508a220-195b-44e1-86c6-b30eae1d4fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:53:23.431369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 653/1303] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:53:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 10:53:23.455964 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d6457-f5ab-471a-9e5d-cb62de392ce0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:23.554177 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d6457-f5ab-471a-9e5d-cb62de392ce0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:23.586369 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ca93a-97bd-499b-aa97-e6f7874ecf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:23.587164 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ca93a-97bd-499b-aa97-e6f7874ecf19 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:23.587464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ca93a-97bd-499b-aa97-e6f7874ecf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:23.587721 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ca93a-97bd-499b-aa97-e6f7874ecf19 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:23.589024 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ca93a-97bd-499b-aa97-e6f7874ecf19 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:23.590466 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ca93a-97bd-499b-aa97-e6f7874ecf19 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:23.601322 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING keystone.server.flask.application [None req-966ca93a-97bd-499b-aa97-e6f7874ecf19 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 06 10:53:23.602480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 651/1304] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Apr 6 10:53:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:53:23.608661 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a220-195b-44e1-86c6-b30eae1d4fab None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:23.706839 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a220-195b-44e1-86c6-b30eae1d4fab None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:23.739616 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75e6cf-fa3e-4834-88c6-588d7cfb6dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:23.740282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75e6cf-fa3e-4834-88c6-588d7cfb6dca None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:23.740566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75e6cf-fa3e-4834-88c6-588d7cfb6dca None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:23.740842 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75e6cf-fa3e-4834-88c6-588d7cfb6dca None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:23.741569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75e6cf-fa3e-4834-88c6-588d7cfb6dca None admin] RBAC: Adding query filter params (name=placement) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 10:53:23.741874 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75e6cf-fa3e-4834-88c6-588d7cfb6dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:23.743258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75e6cf-fa3e-4834-88c6-588d7cfb6dca None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:23.748259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 654/1305] 10.222.0.62 () {56 vars in 1116 bytes} [Wed Apr 6 10:53:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:53:23.754121 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ca93a-97bd-499b-aa97-e6f7874ecf19 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:53:23.853915 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ca93a-97bd-499b-aa97-e6f7874ecf19 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:53:23.885031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d727c-f8d4-45f8-82fc-54bad71293dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:53:23.886272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d727c-f8d4-45f8-82fc-54bad71293dc None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:53:23.886549 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d727c-f8d4-45f8-82fc-54bad71293dc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:53:23.886822 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d727c-f8d4-45f8-82fc-54bad71293dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:53:23.887602 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d727c-f8d4-45f8-82fc-54bad71293dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:53:23.889002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d727c-f8d4-45f8-82fc-54bad71293dc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:53:23.997410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 652/1306] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Apr 6 10:53:23 2022] POST /identity/v3/endpoints => generated 331 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:59:24.891401 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e17e12-a94e-446c-ab78-df2a4c173715 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:24.891898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e17e12-a94e-446c-ab78-df2a4c173715 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:24.891990 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e17e12-a94e-446c-ab78-df2a4c173715 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:24.898493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9eba-ad64-4748-8bce-ac88e0681887 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:24.898904 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9eba-ad64-4748-8bce-ac88e0681887 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:24.899046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9eba-ad64-4748-8bce-ac88e0681887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:24.902895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 655/1307] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:59:24 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:59:24.970073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6ffc9eba-ad64-4748-8bce-ac88e0681887 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:59:24.971276 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6ffc9eba-ad64-4748-8bce-ac88e0681887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:25.085386 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 653/1308] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:59:25.144500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e743f3-af4c-4722-a7fd-0c84080ccf2b None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:25.144787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e743f3-af4c-4722-a7fd-0c84080ccf2b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:25.145078 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e743f3-af4c-4722-a7fd-0c84080ccf2b None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:25.146600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 656/1309] 10.222.0.62 () {54 vars in 963 bytes} [Wed Apr 6 10:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:59:25.153183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0fc17-a416-4f4e-b9f9-ee4e3f196011 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:25.153621 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0fc17-a416-4f4e-b9f9-ee4e3f196011 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:25.154012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0fc17-a416-4f4e-b9f9-ee4e3f196011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:25.239532 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-37b0fc17-a416-4f4e-b9f9-ee4e3f196011 None None] MFA Rules not processed for user `e078c6efaf054f7489f7164fdafce714`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:59:25.240947 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-37b0fc17-a416-4f4e-b9f9-ee4e3f196011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:25.320800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 654/1310] 10.222.0.62 () {58 vars in 1060 bytes} [Wed Apr 6 10:59:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:59:25.330065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e743f3-af4c-4722-a7fd-0c84080ccf2b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:59:25.335952 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-58e743f3-af4c-4722-a7fd-0c84080ccf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:25.446257 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e743f3-af4c-4722-a7fd-0c84080ccf2b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:59:25.524860 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebae28d-dc12-491e-b0b1-9eb06e5423b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:59:25.526088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebae28d-dc12-491e-b0b1-9eb06e5423b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:25.526606 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebae28d-dc12-491e-b0b1-9eb06e5423b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:25.527313 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebae28d-dc12-491e-b0b1-9eb06e5423b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:25.529855 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5ebae28d-dc12-491e-b0b1-9eb06e5423b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:25.638075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebae28d-dc12-491e-b0b1-9eb06e5423b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:59:25.639552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebae28d-dc12-491e-b0b1-9eb06e5423b5 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:59:25.662109 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 657/1311] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 10:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:59:28.269191 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae5f65-1cef-41a3-9499-9fd7b50c010f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:28.270268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae5f65-1cef-41a3-9499-9fd7b50c010f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:28.272029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae5f65-1cef-41a3-9499-9fd7b50c010f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:28.274091 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 655/1312] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:59:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:59:28.281552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec8a5c-715c-45ef-b3fe-e47caf959b47 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:28.282030 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec8a5c-715c-45ef-b3fe-e47caf959b47 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:28.282123 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec8a5c-715c-45ef-b3fe-e47caf959b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:28.371088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-f3ec8a5c-715c-45ef-b3fe-e47caf959b47 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:59:28.372614 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f3ec8a5c-715c-45ef-b3fe-e47caf959b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:28.475825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 658/1313] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:59:28.514146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae5f65-1cef-41a3-9499-9fd7b50c010f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:59:28.516258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a8ae5f65-1cef-41a3-9499-9fd7b50c010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:28.617446 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae5f65-1cef-41a3-9499-9fd7b50c010f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:59:28.693444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7788f54-f0da-4107-a66f-19fd2c2ad153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:59:28.694374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7788f54-f0da-4107-a66f-19fd2c2ad153 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:28.694873 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7788f54-f0da-4107-a66f-19fd2c2ad153 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:28.695155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7788f54-f0da-4107-a66f-19fd2c2ad153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:28.696783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b7788f54-f0da-4107-a66f-19fd2c2ad153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:28.807330 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7788f54-f0da-4107-a66f-19fd2c2ad153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:59:28.808765 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7788f54-f0da-4107-a66f-19fd2c2ad153 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:59:28.826600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 656/1314] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 10:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:59:31.634337 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e18d9-fc5f-46f4-9cf5-b7d2634d6e72 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:31.634871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e18d9-fc5f-46f4-9cf5-b7d2634d6e72 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:31.634871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e18d9-fc5f-46f4-9cf5-b7d2634d6e72 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:31.636275 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 659/1315] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:59:31.641493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae208e4c-af4f-4745-8cdb-0b6eeb355b35 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:31.641977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae208e4c-af4f-4745-8cdb-0b6eeb355b35 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:31.642093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae208e4c-af4f-4745-8cdb-0b6eeb355b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:31.706276 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ae208e4c-af4f-4745-8cdb-0b6eeb355b35 None None] MFA Rules not processed for user `0577dda6ef974bbbad9fda731e953d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:59:31.707488 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ae208e4c-af4f-4745-8cdb-0b6eeb355b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:31.803843 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 657/1316] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:59:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:59:31.844806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e18d9-fc5f-46f4-9cf5-b7d2634d6e72 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:59:31.846394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9a8e18d9-fc5f-46f4-9cf5-b7d2634d6e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:31.943621 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e18d9-fc5f-46f4-9cf5-b7d2634d6e72 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:59:32.011644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ff81d-fb3c-4bc0-bf15-92397dc5eeef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:59:32.012279 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ff81d-fb3c-4bc0-bf15-92397dc5eeef service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:32.012560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ff81d-fb3c-4bc0-bf15-92397dc5eeef service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:32.012834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ff81d-fb3c-4bc0-bf15-92397dc5eeef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:32.014445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ed8ff81d-fb3c-4bc0-bf15-92397dc5eeef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:32.116487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ff81d-fb3c-4bc0-bf15-92397dc5eeef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:59:32.117930 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ff81d-fb3c-4bc0-bf15-92397dc5eeef service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:59:32.134948 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 660/1317] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 10:59:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:59:35.248562 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd768c-709c-4b87-803f-094534a9a88e None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:35.249106 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd768c-709c-4b87-803f-094534a9a88e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:35.249203 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd768c-709c-4b87-803f-094534a9a88e None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:35.250551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 658/1318] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:59:35.255758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b9441-958d-4b55-a5f0-5bab0c1bb9fc None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:35.256166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b9441-958d-4b55-a5f0-5bab0c1bb9fc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:35.256320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b9441-958d-4b55-a5f0-5bab0c1bb9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:35.322738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7a0b9441-958d-4b55-a5f0-5bab0c1bb9fc None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:59:35.323945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7a0b9441-958d-4b55-a5f0-5bab0c1bb9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:35.415172 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 661/1319] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:59:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:59:35.455676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd768c-709c-4b87-803f-094534a9a88e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:59:35.457196 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-45bd768c-709c-4b87-803f-094534a9a88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:35.553680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd768c-709c-4b87-803f-094534a9a88e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:59:35.621737 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817bac3-5c1b-4564-b0b3-40b899ee2177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:59:35.622454 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817bac3-5c1b-4564-b0b3-40b899ee2177 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:35.622731 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817bac3-5c1b-4564-b0b3-40b899ee2177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:35.623000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817bac3-5c1b-4564-b0b3-40b899ee2177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:35.625151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4817bac3-5c1b-4564-b0b3-40b899ee2177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:35.730442 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817bac3-5c1b-4564-b0b3-40b899ee2177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:59:35.731907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817bac3-5c1b-4564-b0b3-40b899ee2177 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:59:35.749212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 659/1320] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 10:59:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:59:38.966033 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86986000-5d04-495f-84a0-78790c28f22c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:38.966538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86986000-5d04-495f-84a0-78790c28f22c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:38.966538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86986000-5d04-495f-84a0-78790c28f22c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:38.968452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 662/1321] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:59:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:59:38.973569 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bc355-0757-490f-aabf-9c2d7dd13f34 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:38.973971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bc355-0757-490f-aabf-9c2d7dd13f34 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:38.974134 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bc355-0757-490f-aabf-9c2d7dd13f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:39.036241 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-672bc355-0757-490f-aabf-9c2d7dd13f34 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:59:39.037471 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-672bc355-0757-490f-aabf-9c2d7dd13f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:39.129239 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 660/1322] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:59:39.166468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86986000-5d04-495f-84a0-78790c28f22c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:59:39.167991 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-86986000-5d04-495f-84a0-78790c28f22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:39.268310 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86986000-5d04-495f-84a0-78790c28f22c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:59:39.343423 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b7e4a-08ab-4249-8bbd-fcc7b55722e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:59:39.344187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b7e4a-08ab-4249-8bbd-fcc7b55722e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:39.344470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b7e4a-08ab-4249-8bbd-fcc7b55722e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:39.344743 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b7e4a-08ab-4249-8bbd-fcc7b55722e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:39.346411 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d53b7e4a-08ab-4249-8bbd-fcc7b55722e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:39.452425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b7e4a-08ab-4249-8bbd-fcc7b55722e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:59:39.453902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b7e4a-08ab-4249-8bbd-fcc7b55722e3 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:59:39.471241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 663/1323] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 10:59:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:59:41.839937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62642655-42b7-4076-8a6c-80201872dba5 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:41.840493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62642655-42b7-4076-8a6c-80201872dba5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:41.840493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62642655-42b7-4076-8a6c-80201872dba5 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:41.841862 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 661/1324] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:59:41.847792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b167f25-c095-4297-94b2-f870cd339499 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:41.848205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b167f25-c095-4297-94b2-f870cd339499 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:41.848353 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b167f25-c095-4297-94b2-f870cd339499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:41.914351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-6b167f25-c095-4297-94b2-f870cd339499 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:59:41.915538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6b167f25-c095-4297-94b2-f870cd339499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:42.008150 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 664/1325] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:59:42.044409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62642655-42b7-4076-8a6c-80201872dba5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:59:42.046615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-62642655-42b7-4076-8a6c-80201872dba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:42.145383 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62642655-42b7-4076-8a6c-80201872dba5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:59:42.215552 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06778e-7f1c-4b8b-9456-4ab0807aa66a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:59:42.216193 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06778e-7f1c-4b8b-9456-4ab0807aa66a service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:42.216474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06778e-7f1c-4b8b-9456-4ab0807aa66a service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:42.216745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06778e-7f1c-4b8b-9456-4ab0807aa66a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:42.219021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ff06778e-7f1c-4b8b-9456-4ab0807aa66a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:42.321649 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06778e-7f1c-4b8b-9456-4ab0807aa66a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:59:42.323042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06778e-7f1c-4b8b-9456-4ab0807aa66a service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:59:42.340611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 662/1326] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 10:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:59:44.720040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684b043-8143-4046-8922-100bdedd0117 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:44.720571 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684b043-8143-4046-8922-100bdedd0117 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:44.720571 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684b043-8143-4046-8922-100bdedd0117 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:44.722005 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 665/1327] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:59:44.727342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694e830-9c2b-46bc-ba6a-64a1745c3652 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:44.727748 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694e830-9c2b-46bc-ba6a-64a1745c3652 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:44.728011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694e830-9c2b-46bc-ba6a-64a1745c3652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:44.790966 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9694e830-9c2b-46bc-ba6a-64a1745c3652 None None] MFA Rules not processed for user `0577dda6ef974bbbad9fda731e953d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:59:44.792159 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9694e830-9c2b-46bc-ba6a-64a1745c3652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:44.883075 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 663/1328] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:59:44 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:59:44.936575 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1730b1-57e3-482e-adea-d6d4f38a52ea None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:44.936894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1730b1-57e3-482e-adea-d6d4f38a52ea None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:44.937318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1730b1-57e3-482e-adea-d6d4f38a52ea None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:44.938796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 666/1329] 10.222.0.62 () {54 vars in 963 bytes} [Wed Apr 6 10:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:59:44.944907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa040e33-7d58-447f-8751-fc26f13ca827 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:44.945225 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa040e33-7d58-447f-8751-fc26f13ca827 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:44.945503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa040e33-7d58-447f-8751-fc26f13ca827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:45.016665 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-aa040e33-7d58-447f-8751-fc26f13ca827 None None] MFA Rules not processed for user `e078c6efaf054f7489f7164fdafce714`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:59:45.017921 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-aa040e33-7d58-447f-8751-fc26f13ca827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:45.091733 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 664/1330] 10.222.0.62 () {58 vars in 1060 bytes} [Wed Apr 6 10:59:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:59:45.102377 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1730b1-57e3-482e-adea-d6d4f38a52ea None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:59:45.104462 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ba1730b1-57e3-482e-adea-d6d4f38a52ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:45.206729 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1730b1-57e3-482e-adea-d6d4f38a52ea None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:59:45.277040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431f610-eb8a-49b0-9fb1-0319fa4c4794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:59:45.277714 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431f610-eb8a-49b0-9fb1-0319fa4c4794 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:45.278023 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431f610-eb8a-49b0-9fb1-0319fa4c4794 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:45.278299 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431f610-eb8a-49b0-9fb1-0319fa4c4794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:45.279921 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f431f610-eb8a-49b0-9fb1-0319fa4c4794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:45.385738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431f610-eb8a-49b0-9fb1-0319fa4c4794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:59:45.387166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431f610-eb8a-49b0-9fb1-0319fa4c4794 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:59:45.405288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 667/1331] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 10:59:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:59:48.510422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeea14c-700a-4961-af80-6fbe49f79be5 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:48.510940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeea14c-700a-4961-af80-6fbe49f79be5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:48.511032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeea14c-700a-4961-af80-6fbe49f79be5 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:48.512474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 665/1332] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:59:48.518045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be58081-3f1f-4acb-96ae-d53bd28ce11b None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:48.518493 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be58081-3f1f-4acb-96ae-d53bd28ce11b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:48.518594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be58081-3f1f-4acb-96ae-d53bd28ce11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:48.580906 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-9be58081-3f1f-4acb-96ae-d53bd28ce11b None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:59:48.582125 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9be58081-3f1f-4acb-96ae-d53bd28ce11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:48.676256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 668/1333] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:59:48.713278 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeea14c-700a-4961-af80-6fbe49f79be5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:59:48.714886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-abeea14c-700a-4961-af80-6fbe49f79be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:48.815323 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeea14c-700a-4961-af80-6fbe49f79be5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:59:48.883067 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703f19d-b8a8-40fa-bd0a-b6bc5d5bb7b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:59:48.883704 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703f19d-b8a8-40fa-bd0a-b6bc5d5bb7b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:48.883981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703f19d-b8a8-40fa-bd0a-b6bc5d5bb7b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:48.884249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703f19d-b8a8-40fa-bd0a-b6bc5d5bb7b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:48.885873 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7703f19d-b8a8-40fa-bd0a-b6bc5d5bb7b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:48.998526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703f19d-b8a8-40fa-bd0a-b6bc5d5bb7b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:59:49.000700 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703f19d-b8a8-40fa-bd0a-b6bc5d5bb7b7 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:59:49.020430 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 666/1334] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 10:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:59:51.381717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d46a-247f-489d-92f6-26a41a927d61 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:51.382305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d46a-247f-489d-92f6-26a41a927d61 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:51.382305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d46a-247f-489d-92f6-26a41a927d61 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:51.383643 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 669/1335] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:59:51.388733 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242e9cf-6ccc-4cd6-ad8c-800391214dd2 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:51.389139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242e9cf-6ccc-4cd6-ad8c-800391214dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:51.389311 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242e9cf-6ccc-4cd6-ad8c-800391214dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:51.451588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f242e9cf-6ccc-4cd6-ad8c-800391214dd2 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:59:51.452843 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f242e9cf-6ccc-4cd6-ad8c-800391214dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:51.542470 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 667/1336] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:59:51.583392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8d46a-247f-489d-92f6-26a41a927d61 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:59:51.584913 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5dd8d46a-247f-489d-92f6-26a41a927d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:51.684139 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8d46a-247f-489d-92f6-26a41a927d61 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:59:51.772163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd79f9-a6d7-4665-823f-419c0fa820f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:59:51.772800 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd79f9-a6d7-4665-823f-419c0fa820f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:51.773099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd79f9-a6d7-4665-823f-419c0fa820f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:51.773374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd79f9-a6d7-4665-823f-419c0fa820f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:51.774987 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-00dd79f9-a6d7-4665-823f-419c0fa820f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:51.879252 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd79f9-a6d7-4665-823f-419c0fa820f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:59:51.880663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd79f9-a6d7-4665-823f-419c0fa820f3 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:59:51.898516 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 670/1337] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 10:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:59:54.735155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32e543-7957-47e8-a5a4-9b7934c84e5d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:54.735701 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32e543-7957-47e8-a5a4-9b7934c84e5d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:54.735701 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32e543-7957-47e8-a5a4-9b7934c84e5d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:54.737303 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 668/1338] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:59:54.742626 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611a77c-8c62-45ee-9206-471b9cf603bd None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:54.743066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611a77c-8c62-45ee-9206-471b9cf603bd None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:54.743175 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611a77c-8c62-45ee-9206-471b9cf603bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:54.806465 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0611a77c-8c62-45ee-9206-471b9cf603bd None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:59:54.807660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0611a77c-8c62-45ee-9206-471b9cf603bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:54.899739 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 671/1339] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:59:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:59:54.936920 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32e543-7957-47e8-a5a4-9b7934c84e5d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:59:54.939955 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7d32e543-7957-47e8-a5a4-9b7934c84e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:55.045262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32e543-7957-47e8-a5a4-9b7934c84e5d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:59:55.060021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47499cf-5300-47e3-a907-0d0d0e802387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:59:55.060661 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47499cf-5300-47e3-a907-0d0d0e802387 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:55.060945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47499cf-5300-47e3-a907-0d0d0e802387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:55.061291 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47499cf-5300-47e3-a907-0d0d0e802387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:55.063523 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e47499cf-5300-47e3-a907-0d0d0e802387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:55.165029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47499cf-5300-47e3-a907-0d0d0e802387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:59:55.166538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47499cf-5300-47e3-a907-0d0d0e802387 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:59:55.187031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 669/1340] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 10:59:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:59:59.695001 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11dada-5394-4f43-8459-a4d0eb38c749 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:59.700746 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11dada-5394-4f43-8459-a4d0eb38c749 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:59.700746 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11dada-5394-4f43-8459-a4d0eb38c749 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:59.700746 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 672/1341] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 10:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:59:59.702878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f9238-bd0f-4468-9b4e-ee3103e26aa3 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:59.703365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f9238-bd0f-4468-9b4e-ee3103e26aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:59.703467 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f9238-bd0f-4468-9b4e-ee3103e26aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:59.749630 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-863f9238-bd0f-4468-9b4e-ee3103e26aa3 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:59:59.750837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-863f9238-bd0f-4468-9b4e-ee3103e26aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:59.823908 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 670/1342] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 10:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:59:59.863676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11dada-5394-4f43-8459-a4d0eb38c749 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:59:59.865808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-aa11dada-5394-4f43-8459-a4d0eb38c749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:59:59.887652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11dada-5394-4f43-8459-a4d0eb38c749 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:59:59.891672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df563259-9893-4fe6-8c02-b19484646d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:59:59.892297 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df563259-9893-4fe6-8c02-b19484646d33 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:59:59.892574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df563259-9893-4fe6-8c02-b19484646d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:59:59.892843 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df563259-9893-4fe6-8c02-b19484646d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:59:59.901543 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df563259-9893-4fe6-8c02-b19484646d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:59:59.902953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df563259-9893-4fe6-8c02-b19484646d33 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 10:59:59.912699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 673/1343] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 10:59:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:03.152132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b04b6-9552-4147-99c8-aa0acf9891d6 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:03.152652 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b04b6-9552-4147-99c8-aa0acf9891d6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:03.152730 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b04b6-9552-4147-99c8-aa0acf9891d6 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:03.154119 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 671/1344] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:03.159509 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39554d-74a5-4473-a104-82a5c7a2c5bc None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:03.159937 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39554d-74a5-4473-a104-82a5c7a2c5bc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:03.160106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39554d-74a5-4473-a104-82a5c7a2c5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:03.187887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-bb39554d-74a5-4473-a104-82a5c7a2c5bc None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:03.188985 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-bb39554d-74a5-4473-a104-82a5c7a2c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:03.196834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 674/1345] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:03.235352 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b04b6-9552-4147-99c8-aa0acf9891d6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:03.245928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b04b6-9552-4147-99c8-aa0acf9891d6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:03.250067 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a621953-872e-4015-a327-272c30863ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:03.250694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a621953-872e-4015-a327-272c30863ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:03.250970 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a621953-872e-4015-a327-272c30863ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:03.251239 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a621953-872e-4015-a327-272c30863ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:03.260168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a621953-872e-4015-a327-272c30863ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:03.261672 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a621953-872e-4015-a327-272c30863ec4 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:03.271801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 672/1346] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:07.912027 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c4dcf-b02d-4ffb-ad7c-6e907bae1b92 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:07.912533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c4dcf-b02d-4ffb-ad7c-6e907bae1b92 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:07.912533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c4dcf-b02d-4ffb-ad7c-6e907bae1b92 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:07.913903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 675/1347] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:07.919114 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d2ecb-1778-481a-a7cc-4b524f47a7ca None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:07.919538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d2ecb-1778-481a-a7cc-4b524f47a7ca None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:07.919773 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d2ecb-1778-481a-a7cc-4b524f47a7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:07.938979 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e01d2ecb-1778-481a-a7cc-4b524f47a7ca None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:07.940163 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e01d2ecb-1778-481a-a7cc-4b524f47a7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:07.948085 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 673/1348] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:00:07.987478 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c4dcf-b02d-4ffb-ad7c-6e907bae1b92 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:07.998919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c4dcf-b02d-4ffb-ad7c-6e907bae1b92 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:08.002528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368c20a-9338-4b6e-8425-1589cf30a435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:08.003180 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368c20a-9338-4b6e-8425-1589cf30a435 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:08.003466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368c20a-9338-4b6e-8425-1589cf30a435 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:08.003741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368c20a-9338-4b6e-8425-1589cf30a435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:08.013259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368c20a-9338-4b6e-8425-1589cf30a435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:08.015185 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368c20a-9338-4b6e-8425-1589cf30a435 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:08.024491 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 676/1349] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:13.401613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e89ff-9f08-417b-b860-5370c798a253 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:13.402685 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e89ff-9f08-417b-b860-5370c798a253 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:13.403166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e89ff-9f08-417b-b860-5370c798a253 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:13.405669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 674/1350] 10.222.0.62 () {54 vars in 921 bytes} [Wed Apr 6 11:00:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:13.410943 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061c53a-74e7-4cfa-94b0-aa0aae455e7b None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:13.411775 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061c53a-74e7-4cfa-94b0-aa0aae455e7b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:13.412257 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061c53a-74e7-4cfa-94b0-aa0aae455e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:13.496986 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-2061c53a-74e7-4cfa-94b0-aa0aae455e7b None None] MFA Rules not processed for user `1bd095449a5b44c6b1c9aca712edc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:13.498659 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2061c53a-74e7-4cfa-94b0-aa0aae455e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:13.588171 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 677/1351] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Apr 6 11:00:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:00:17.972222 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad21c-d79f-41bb-b4f0-09deaef7e64f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:17.973244 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad21c-d79f-41bb-b4f0-09deaef7e64f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:17.973652 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad21c-d79f-41bb-b4f0-09deaef7e64f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:17.975114 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 675/1352] 10.222.0.62 () {54 vars in 921 bytes} [Wed Apr 6 11:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:17.980171 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e7c13-5d86-4e43-9327-47d1a0be2c84 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:17.980593 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e7c13-5d86-4e43-9327-47d1a0be2c84 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:17.980737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e7c13-5d86-4e43-9327-47d1a0be2c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:17.999918 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-859e7c13-5d86-4e43-9327-47d1a0be2c84 None None] MFA Rules not processed for user `1bd095449a5b44c6b1c9aca712edc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:18.001124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-859e7c13-5d86-4e43-9327-47d1a0be2c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:18.009888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 678/1353] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Apr 6 11:00:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:19.428266 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3d042-36e1-4ddd-908d-3749f9cc5434 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:19.428783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3d042-36e1-4ddd-908d-3749f9cc5434 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:19.428783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3d042-36e1-4ddd-908d-3749f9cc5434 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:19.430514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 676/1354] 10.222.0.62 () {54 vars in 921 bytes} [Wed Apr 6 11:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:19.436402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9fea2-d204-41ec-99b9-be7236996fce None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:19.436823 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9fea2-d204-41ec-99b9-be7236996fce None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:19.436968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9fea2-d204-41ec-99b9-be7236996fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:19.454942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-6bd9fea2-d204-41ec-99b9-be7236996fce None None] MFA Rules not processed for user `1bd095449a5b44c6b1c9aca712edc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:19.456140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6bd9fea2-d204-41ec-99b9-be7236996fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:19.464890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 679/1355] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Apr 6 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:00:23.263237 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7e763-1de3-44b8-b29d-b64c72c9a484 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:23.263822 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7e763-1de3-44b8-b29d-b64c72c9a484 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:23.264043 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7e763-1de3-44b8-b29d-b64c72c9a484 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:23.265688 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 677/1356] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:23.270610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435bc4-ba26-47c8-b172-2e8818c4e101 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:23.271044 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435bc4-ba26-47c8-b172-2e8818c4e101 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:23.271142 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435bc4-ba26-47c8-b172-2e8818c4e101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:23.289970 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5d435bc4-ba26-47c8-b172-2e8818c4e101 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:23.291138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5d435bc4-ba26-47c8-b172-2e8818c4e101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:23.299847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 680/1357] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:23.348587 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e621150-b38e-412e-ac99-4694b2a09935 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:23.348878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e621150-b38e-412e-ac99-4694b2a09935 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:23.349202 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e621150-b38e-412e-ac99-4694b2a09935 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:23.350547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 678/1358] 10.222.0.62 () {54 vars in 960 bytes} [Wed Apr 6 11:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:23.355710 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e119b-2d41-4b20-9305-95c76f387619 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:23.355997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e119b-2d41-4b20-9305-95c76f387619 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:23.356272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e119b-2d41-4b20-9305-95c76f387619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:23.403456 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-258e119b-2d41-4b20-9305-95c76f387619 None None] MFA Rules not processed for user `650c5809116e4bcd808044236c06dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:23.404819 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-258e119b-2d41-4b20-9305-95c76f387619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:23.487090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 681/1359] 10.222.0.62 () {58 vars in 1057 bytes} [Wed Apr 6 11:00:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:23.494814 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e621150-b38e-412e-ac99-4694b2a09935 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:23.513675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e621150-b38e-412e-ac99-4694b2a09935 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:23.520693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2356281-b7e6-4a23-9478-fc2ae6713a0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:23.521624 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2356281-b7e6-4a23-9478-fc2ae6713a0a service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:23.522898 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2356281-b7e6-4a23-9478-fc2ae6713a0a service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:23.522898 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2356281-b7e6-4a23-9478-fc2ae6713a0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:23.532464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2356281-b7e6-4a23-9478-fc2ae6713a0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:23.534242 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2356281-b7e6-4a23-9478-fc2ae6713a0a service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:23.546602 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 679/1360] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:26.101528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f26b9c-5dc9-4703-9965-e15d7c926006 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:26.102106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f26b9c-5dc9-4703-9965-e15d7c926006 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:26.102106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f26b9c-5dc9-4703-9965-e15d7c926006 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:26.105139 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 682/1361] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:26.108612 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530ce32-ca16-46b7-b85c-d210208330fe None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:26.109021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530ce32-ca16-46b7-b85c-d210208330fe None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:26.109295 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530ce32-ca16-46b7-b85c-d210208330fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:26.129406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5530ce32-ca16-46b7-b85c-d210208330fe None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:26.131010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5530ce32-ca16-46b7-b85c-d210208330fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:26.140410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 680/1362] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:26.186863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f26b9c-5dc9-4703-9965-e15d7c926006 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:26.202215 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f26b9c-5dc9-4703-9965-e15d7c926006 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:26.208208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce580f6b-68a2-4572-af73-05c265a578c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:26.208996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce580f6b-68a2-4572-af73-05c265a578c1 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:26.209417 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce580f6b-68a2-4572-af73-05c265a578c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:26.209800 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce580f6b-68a2-4572-af73-05c265a578c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:26.218876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce580f6b-68a2-4572-af73-05c265a578c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:26.220634 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce580f6b-68a2-4572-af73-05c265a578c1 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:26.230959 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 683/1363] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:29.092506 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a321efd-5c10-4cd0-8f24-5067489e7c32 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:29.092993 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a321efd-5c10-4cd0-8f24-5067489e7c32 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:29.093128 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a321efd-5c10-4cd0-8f24-5067489e7c32 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:29.094440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 681/1364] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:29.099828 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cd7a4-bcf8-481e-a7dd-3a475b147865 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:29.100218 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cd7a4-bcf8-481e-a7dd-3a475b147865 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:29.100399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cd7a4-bcf8-481e-a7dd-3a475b147865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:29.118449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-f61cd7a4-bcf8-481e-a7dd-3a475b147865 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:29.119644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f61cd7a4-bcf8-481e-a7dd-3a475b147865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:29.128318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 684/1365] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:29.177505 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f521e53-f239-4698-bf3e-0293658b15f9 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:29.177505 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f521e53-f239-4698-bf3e-0293658b15f9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:29.177505 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f521e53-f239-4698-bf3e-0293658b15f9 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:29.178058 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 682/1366] 10.222.0.62 () {54 vars in 960 bytes} [Wed Apr 6 11:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:29.184450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351dc1b-0857-450d-8365-73b798270123 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:29.184931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351dc1b-0857-450d-8365-73b798270123 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:29.186433 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351dc1b-0857-450d-8365-73b798270123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:29.215869 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-b351dc1b-0857-450d-8365-73b798270123 None None] MFA Rules not processed for user `650c5809116e4bcd808044236c06dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:29.217517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b351dc1b-0857-450d-8365-73b798270123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:29.231319 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 685/1367] 10.222.0.62 () {58 vars in 1057 bytes} [Wed Apr 6 11:00:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:29.240063 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f521e53-f239-4698-bf3e-0293658b15f9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:29.258306 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f521e53-f239-4698-bf3e-0293658b15f9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:29.265549 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6354c66-b421-431b-9210-709862a2c00f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:29.266395 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6354c66-b421-431b-9210-709862a2c00f service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:29.266870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6354c66-b421-431b-9210-709862a2c00f service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:29.267297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6354c66-b421-431b-9210-709862a2c00f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:29.276634 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6354c66-b421-431b-9210-709862a2c00f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:29.278484 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6354c66-b421-431b-9210-709862a2c00f service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:29.289353 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 683/1368] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:31.627012 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30060d-d2bc-4d11-8460-2ed36d58ac93 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:31.627623 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30060d-d2bc-4d11-8460-2ed36d58ac93 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:31.627882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30060d-d2bc-4d11-8460-2ed36d58ac93 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:31.629514 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 686/1369] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:31.635084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e0d2a-34c7-4793-b5bc-bc2032b9a875 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:31.635502 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e0d2a-34c7-4793-b5bc-bc2032b9a875 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:31.635640 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e0d2a-34c7-4793-b5bc-bc2032b9a875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:31.656130 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-597e0d2a-34c7-4793-b5bc-bc2032b9a875 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:31.657876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-597e0d2a-34c7-4793-b5bc-bc2032b9a875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:31.666410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 684/1370] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:31.838318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906486-c2a7-48b4-a9a9-c12014a8ec3e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:31.838610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906486-c2a7-48b4-a9a9-c12014a8ec3e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:31.839064 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906486-c2a7-48b4-a9a9-c12014a8ec3e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:31.840494 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 687/1371] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:31.846443 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1974349-a6b5-4a1b-87e7-43664c422555 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:31.846918 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1974349-a6b5-4a1b-87e7-43664c422555 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:31.847369 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1974349-a6b5-4a1b-87e7-43664c422555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:31.865965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b1974349-a6b5-4a1b-87e7-43664c422555 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:31.867157 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b1974349-a6b5-4a1b-87e7-43664c422555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:31.875659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 685/1372] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:31.923377 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad906486-c2a7-48b4-a9a9-c12014a8ec3e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:31.941758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad906486-c2a7-48b4-a9a9-c12014a8ec3e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:31.947969 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447dc1b-52ff-48b5-bb87-c2d7ce5178ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:31.948742 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447dc1b-52ff-48b5-bb87-c2d7ce5178ae service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:31.949166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447dc1b-52ff-48b5-bb87-c2d7ce5178ae service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:31.949551 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447dc1b-52ff-48b5-bb87-c2d7ce5178ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:31.971572 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447dc1b-52ff-48b5-bb87-c2d7ce5178ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:31.973541 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447dc1b-52ff-48b5-bb87-c2d7ce5178ae service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:31.976838 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff7635-99ec-47c0-82f7-62018ed82d98 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:31.977193 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff7635-99ec-47c0-82f7-62018ed82d98 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:31.977479 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff7635-99ec-47c0-82f7-62018ed82d98 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:31.979214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 686/1373] 10.222.0.62 () {54 vars in 962 bytes} [Wed Apr 6 11:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:31.984101 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5a6e5-d4ee-438d-b403-713b8efe5f04 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:31.984387 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5a6e5-d4ee-438d-b403-713b8efe5f04 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:31.984663 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5a6e5-d4ee-438d-b403-713b8efe5f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:31.987354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 688/1374] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:32.034006 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7de5a6e5-d4ee-438d-b403-713b8efe5f04 None None] MFA Rules not processed for user `5d07bf80c4f741e68d14665b092edcff`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:32.035191 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7de5a6e5-d4ee-438d-b403-713b8efe5f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:32.096257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 687/1375] 10.222.0.62 () {58 vars in 1059 bytes} [Wed Apr 6 11:00:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:00:32.104115 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447dc1b-52ff-48b5-bb87-c2d7ce5178ae service nova] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:32.113889 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447dc1b-52ff-48b5-bb87-c2d7ce5178ae service nova] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:32.117745 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a0fa8-5339-4a49-a8e4-e9c5aa27b131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:32.118392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0fa8-5339-4a49-a8e4-e9c5aa27b131 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:32.118674 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0fa8-5339-4a49-a8e4-e9c5aa27b131 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:32.118953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0fa8-5339-4a49-a8e4-e9c5aa27b131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:32.129011 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a0fa8-5339-4a49-a8e4-e9c5aa27b131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:32.130509 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a0fa8-5339-4a49-a8e4-e9c5aa27b131 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:32.140696 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 689/1376] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:34.435547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cd1c5-c356-440f-8d4a-bb3012adbeb7 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:34.436048 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cd1c5-c356-440f-8d4a-bb3012adbeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:34.436145 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cd1c5-c356-440f-8d4a-bb3012adbeb7 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:34.437657 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 688/1377] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:34.442876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e061c94-bf86-41c7-9365-06c4d8584b6c None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:34.443275 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e061c94-bf86-41c7-9365-06c4d8584b6c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:34.443444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e061c94-bf86-41c7-9365-06c4d8584b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:34.462406 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7e061c94-bf86-41c7-9365-06c4d8584b6c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:34.463696 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7e061c94-bf86-41c7-9365-06c4d8584b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:34.472492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 690/1378] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:34.518946 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cd1c5-c356-440f-8d4a-bb3012adbeb7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:34.536635 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cd1c5-c356-440f-8d4a-bb3012adbeb7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:34.542309 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9efcc-bb91-48c0-bce0-98ed215f04bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:34.542952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9efcc-bb91-48c0-bce0-98ed215f04bf service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:34.543236 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9efcc-bb91-48c0-bce0-98ed215f04bf service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:34.543514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9efcc-bb91-48c0-bce0-98ed215f04bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:34.552743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9efcc-bb91-48c0-bce0-98ed215f04bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:34.554684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9efcc-bb91-48c0-bce0-98ed215f04bf service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:34.564606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 689/1379] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:37.076919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e72f2-142b-4e59-838f-7367a4f11e5b None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:37.077498 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e72f2-142b-4e59-838f-7367a4f11e5b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:37.077498 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e72f2-142b-4e59-838f-7367a4f11e5b None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:37.078969 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 691/1380] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:37.084966 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b3f02-8c78-47cc-b47f-e1b1113d8e66 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:37.085503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b3f02-8c78-47cc-b47f-e1b1113d8e66 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:37.085579 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b3f02-8c78-47cc-b47f-e1b1113d8e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:37.103858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-797b3f02-8c78-47cc-b47f-e1b1113d8e66 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:37.105039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-797b3f02-8c78-47cc-b47f-e1b1113d8e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:37.113801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 690/1381] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:37.159407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e72f2-142b-4e59-838f-7367a4f11e5b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:37.174755 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e72f2-142b-4e59-838f-7367a4f11e5b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:37.180620 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b45350-93ca-4590-8e8d-dfb37dfcabb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:37.181344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b45350-93ca-4590-8e8d-dfb37dfcabb9 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:37.181917 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b45350-93ca-4590-8e8d-dfb37dfcabb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:37.182093 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b45350-93ca-4590-8e8d-dfb37dfcabb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:37.193857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b45350-93ca-4590-8e8d-dfb37dfcabb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:37.196438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b45350-93ca-4590-8e8d-dfb37dfcabb9 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:37.206364 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 692/1382] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:39.656343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae2168-9a80-42cb-939e-03aa62af0ee7 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:39.656860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae2168-9a80-42cb-939e-03aa62af0ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:39.656860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae2168-9a80-42cb-939e-03aa62af0ee7 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:39.659530 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 691/1383] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:39.663752 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e29d5-8e66-4684-a378-f92da94948af None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:39.664167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e29d5-8e66-4684-a378-f92da94948af None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:39.664328 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e29d5-8e66-4684-a378-f92da94948af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:39.684063 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-907e29d5-8e66-4684-a378-f92da94948af None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:39.686157 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-907e29d5-8e66-4684-a378-f92da94948af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:39.695979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 693/1384] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:39.738417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae2168-9a80-42cb-939e-03aa62af0ee7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:39.753205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae2168-9a80-42cb-939e-03aa62af0ee7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:39.758561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29faf25-fd38-49a7-b6a5-438057b7d476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:39.759194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29faf25-fd38-49a7-b6a5-438057b7d476 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:39.759476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29faf25-fd38-49a7-b6a5-438057b7d476 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:39.759751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29faf25-fd38-49a7-b6a5-438057b7d476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:39.767999 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29faf25-fd38-49a7-b6a5-438057b7d476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:39.769649 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29faf25-fd38-49a7-b6a5-438057b7d476 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:39.779734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 692/1385] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:42.094345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10620d-5ae5-4fe8-bd49-01eb83388446 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:42.095101 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10620d-5ae5-4fe8-bd49-01eb83388446 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:42.095101 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10620d-5ae5-4fe8-bd49-01eb83388446 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:42.096307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 694/1386] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:42.101564 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439edb1-26b0-4798-acd2-55f606c35d56 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:42.102001 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439edb1-26b0-4798-acd2-55f606c35d56 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:42.102128 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439edb1-26b0-4798-acd2-55f606c35d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:42.120635 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b439edb1-26b0-4798-acd2-55f606c35d56 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:42.121847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b439edb1-26b0-4798-acd2-55f606c35d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:42.129729 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 693/1387] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:42.176419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10620d-5ae5-4fe8-bd49-01eb83388446 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:42.192483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10620d-5ae5-4fe8-bd49-01eb83388446 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:42.198522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092147df-ebfe-4fd1-a498-de45605618cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:42.199192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092147df-ebfe-4fd1-a498-de45605618cf service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:42.199486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092147df-ebfe-4fd1-a498-de45605618cf service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:42.199765 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092147df-ebfe-4fd1-a498-de45605618cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:42.217602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092147df-ebfe-4fd1-a498-de45605618cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:42.220639 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092147df-ebfe-4fd1-a498-de45605618cf service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:42.239091 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 695/1388] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:44.781500 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33eb45d-5f19-4389-ad8b-954ece26095f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:44.782066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33eb45d-5f19-4389-ad8b-954ece26095f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:44.782066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33eb45d-5f19-4389-ad8b-954ece26095f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:44.783414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 694/1389] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:44.788834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868ff13-c66b-4388-bb43-b76501ea697f None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:44.789301 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868ff13-c66b-4388-bb43-b76501ea697f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:44.789497 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868ff13-c66b-4388-bb43-b76501ea697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:44.808237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-2868ff13-c66b-4388-bb43-b76501ea697f None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:44.809513 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2868ff13-c66b-4388-bb43-b76501ea697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:44.818172 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 696/1390] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:44.867210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33eb45d-5f19-4389-ad8b-954ece26095f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:44.883254 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33eb45d-5f19-4389-ad8b-954ece26095f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:44.890382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4e90d-de90-44e3-bcbb-1c6fff2363b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:44.891136 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4e90d-de90-44e3-bcbb-1c6fff2363b1 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:44.891474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4e90d-de90-44e3-bcbb-1c6fff2363b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:44.891793 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4e90d-de90-44e3-bcbb-1c6fff2363b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:44.901437 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4e90d-de90-44e3-bcbb-1c6fff2363b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:44.903099 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4e90d-de90-44e3-bcbb-1c6fff2363b1 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:44.913743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 695/1391] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:47.444762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356033c-ca85-4e6c-a8f8-aee4bf60fbb7 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:47.445377 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356033c-ca85-4e6c-a8f8-aee4bf60fbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:47.445377 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356033c-ca85-4e6c-a8f8-aee4bf60fbb7 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:47.446743 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 697/1392] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:47.452667 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebede6e-b246-48d5-a427-9988ac45aacf None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:47.453131 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebede6e-b246-48d5-a427-9988ac45aacf None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:47.453268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebede6e-b246-48d5-a427-9988ac45aacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:47.470876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-bebede6e-b246-48d5-a427-9988ac45aacf None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:47.472058 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-bebede6e-b246-48d5-a427-9988ac45aacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:47.480816 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 696/1393] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:47.526148 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356033c-ca85-4e6c-a8f8-aee4bf60fbb7 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:47.540384 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356033c-ca85-4e6c-a8f8-aee4bf60fbb7 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:47.545867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf92f93-179c-4b7a-b6a4-7abccbde32b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:47.546496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf92f93-179c-4b7a-b6a4-7abccbde32b1 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:47.546782 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf92f93-179c-4b7a-b6a4-7abccbde32b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:47.547061 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf92f93-179c-4b7a-b6a4-7abccbde32b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:47.555227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf92f93-179c-4b7a-b6a4-7abccbde32b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:47.556801 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf92f93-179c-4b7a-b6a4-7abccbde32b1 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:47.566608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 698/1394] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:48.515201 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd82cf1-2790-4eb0-9ac7-dc78ad4669e2 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:48.515788 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd82cf1-2790-4eb0-9ac7-dc78ad4669e2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:48.515890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd82cf1-2790-4eb0-9ac7-dc78ad4669e2 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:48.517308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 697/1395] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:48.522684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39730bd6-fec5-4467-b8c4-008f74f5b4ad None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:48.523123 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39730bd6-fec5-4467-b8c4-008f74f5b4ad None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:48.523349 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39730bd6-fec5-4467-b8c4-008f74f5b4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:48.541379 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-39730bd6-fec5-4467-b8c4-008f74f5b4ad None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:48.542575 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-39730bd6-fec5-4467-b8c4-008f74f5b4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:48.550375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 699/1396] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:00:48.608032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6718143-2310-408a-8d53-4e47305c1203 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:48.608323 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6718143-2310-408a-8d53-4e47305c1203 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:48.608603 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6718143-2310-408a-8d53-4e47305c1203 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:48.609999 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 698/1397] 10.222.0.62 () {54 vars in 961 bytes} [Wed Apr 6 11:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:48.614925 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2f11f-467b-42e4-9a91-0bf8bed0b8e7 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:48.620619 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2f11f-467b-42e4-9a91-0bf8bed0b8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:48.620619 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2f11f-467b-42e4-9a91-0bf8bed0b8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:48.663277 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-11c2f11f-467b-42e4-9a91-0bf8bed0b8e7 None None] MFA Rules not processed for user `42cd381cf5c745de9dac8f77a8cea554`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:48.664463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-11c2f11f-467b-42e4-9a91-0bf8bed0b8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:48.723081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 700/1398] 10.222.0.62 () {58 vars in 1058 bytes} [Wed Apr 6 11:00:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:48.730811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6718143-2310-408a-8d53-4e47305c1203 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:48.741352 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6718143-2310-408a-8d53-4e47305c1203 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:48.744794 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040532b3-d9f9-4127-adb5-ec39f38df738 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42cd381cf5c745de9dac8f77a8cea554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:48.745449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040532b3-d9f9-4127-adb5-ec39f38df738 service glance] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:48.745729 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040532b3-d9f9-4127-adb5-ec39f38df738 service glance] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:48.745998 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040532b3-d9f9-4127-adb5-ec39f38df738 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:48.755010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040532b3-d9f9-4127-adb5-ec39f38df738 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:48.756464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040532b3-d9f9-4127-adb5-ec39f38df738 service glance] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:48.766474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 699/1399] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:49.274714 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770a7f3-d78f-4311-8cbc-d54b161169ac None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:49.275009 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770a7f3-d78f-4311-8cbc-d54b161169ac None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:49.275291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770a7f3-d78f-4311-8cbc-d54b161169ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:49.323066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a770a7f3-d78f-4311-8cbc-d54b161169ac None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:49.324265 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a770a7f3-d78f-4311-8cbc-d54b161169ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:49.385993 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 701/1400] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:00:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:49.428540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d4d4-6ccf-4512-a5b9-5e5f23c16f11 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:49.428831 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d4d4-6ccf-4512-a5b9-5e5f23c16f11 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:49.429448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d4d4-6ccf-4512-a5b9-5e5f23c16f11 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:49.430878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 700/1401] 10.222.0.62 () {54 vars in 942 bytes} [Wed Apr 6 11:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:49.437705 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2479c-938e-42a1-97b6-9d98d94f3470 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:49.438070 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2479c-938e-42a1-97b6-9d98d94f3470 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:49.438421 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2479c-938e-42a1-97b6-9d98d94f3470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:49.486199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7fc2479c-938e-42a1-97b6-9d98d94f3470 None None] MFA Rules not processed for user `89101c5ca3b048939a46b0bb246d2cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:49.487405 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7fc2479c-938e-42a1-97b6-9d98d94f3470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:49.557580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 702/1402] 10.222.0.62 () {58 vars in 1039 bytes} [Wed Apr 6 11:00:49 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:49.566400 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808d4d4-6ccf-4512-a5b9-5e5f23c16f11 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:49.579576 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808d4d4-6ccf-4512-a5b9-5e5f23c16f11 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:49.584512 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f432a-1461-4f50-a2c0-f6f3a630a31c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:49.585249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f432a-1461-4f50-a2c0-f6f3a630a31c service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:49.585597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f432a-1461-4f50-a2c0-f6f3a630a31c service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:49.585936 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f432a-1461-4f50-a2c0-f6f3a630a31c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:49.594457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f432a-1461-4f50-a2c0-f6f3a630a31c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:49.596138 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f432a-1461-4f50-a2c0-f6f3a630a31c service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:49.604196 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 701/1403] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:00:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 06 11:00:50.040425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50b85f-f26c-418f-ae51-e7b06df580a0 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:50.040714 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50b85f-f26c-418f-ae51-e7b06df580a0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:50.040988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50b85f-f26c-418f-ae51-e7b06df580a0 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:50.042414 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 703/1404] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:50.047697 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3e093-d35d-414c-a427-8a1d50cb62f6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:50.048057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3e093-d35d-414c-a427-8a1d50cb62f6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:50.048514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3e093-d35d-414c-a427-8a1d50cb62f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:50.068387 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-03f3e093-d35d-414c-a427-8a1d50cb62f6 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:50.069909 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-03f3e093-d35d-414c-a427-8a1d50cb62f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:50.078675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 702/1405] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:50.122426 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50b85f-f26c-418f-ae51-e7b06df580a0 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:50.137304 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50b85f-f26c-418f-ae51-e7b06df580a0 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:50.147664 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0074-a2c1-495c-9c4a-889b44dfdba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:50.148318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0074-a2c1-495c-9c4a-889b44dfdba2 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:50.148604 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0074-a2c1-495c-9c4a-889b44dfdba2 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:50.148882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0074-a2c1-495c-9c4a-889b44dfdba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:50.158419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0074-a2c1-495c-9c4a-889b44dfdba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:50.159998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0074-a2c1-495c-9c4a-889b44dfdba2 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:50.169563 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 704/1406] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:00:52.697264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11619d-cc00-422d-af2d-b4b7b0a96273 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:52.697799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11619d-cc00-422d-af2d-b4b7b0a96273 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:52.697799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11619d-cc00-422d-af2d-b4b7b0a96273 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:52.701356 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 703/1407] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:00:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:00:52.704259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ba32a-3461-43ad-a12b-40ada7ed82e5 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:52.704695 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ba32a-3461-43ad-a12b-40ada7ed82e5 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:52.704792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ba32a-3461-43ad-a12b-40ada7ed82e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:52.724591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0a5ba32a-3461-43ad-a12b-40ada7ed82e5 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:00:52.725841 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0a5ba32a-3461-43ad-a12b-40ada7ed82e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:00:52.734536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 705/1408] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:00:52.778226 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11619d-cc00-422d-af2d-b4b7b0a96273 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:00:52.793533 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11619d-cc00-422d-af2d-b4b7b0a96273 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:00:52.799403 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb691f-34e2-4734-b8e0-62ac93d98996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:00:52.800051 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb691f-34e2-4734-b8e0-62ac93d98996 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:00:52.800331 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb691f-34e2-4734-b8e0-62ac93d98996 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:00:52.800607 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb691f-34e2-4734-b8e0-62ac93d98996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:00:52.809599 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb691f-34e2-4734-b8e0-62ac93d98996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:00:52.811743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb691f-34e2-4734-b8e0-62ac93d98996 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:00:52.822016 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 704/1409] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:14.159243 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39bdd7-3322-46d8-8178-a18142acf8ed None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:14.159872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39bdd7-3322-46d8-8178-a18142acf8ed None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:14.159872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39bdd7-3322-46d8-8178-a18142acf8ed None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:14.161240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 706/1410] 10.222.0.62 () {54 vars in 918 bytes} [Wed Apr 6 11:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:14.166420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd612-0567-4896-94fe-0d85f8399261 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:14.166887 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd612-0567-4896-94fe-0d85f8399261 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:14.166990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd612-0567-4896-94fe-0d85f8399261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:14.185013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7d3dd612-0567-4896-94fe-0d85f8399261 None None] MFA Rules not processed for user `1bd095449a5b44c6b1c9aca712edc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:14.186740 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7d3dd612-0567-4896-94fe-0d85f8399261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:14.195156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 705/1411] 10.222.0.62 () {58 vars in 1015 bytes} [Wed Apr 6 11:01:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:14.209727 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be3ef5-46dc-4ff9-85fb-c5b6e1aa69c6 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:14.210100 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be3ef5-46dc-4ff9-85fb-c5b6e1aa69c6 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:14.210461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be3ef5-46dc-4ff9-85fb-c5b6e1aa69c6 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:14.211792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 707/1412] 10.222.0.62 () {54 vars in 918 bytes} [Wed Apr 6 11:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:14.216296 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f55846-c106-4af8-8467-d99cad086f46 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:14.216578 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f55846-c106-4af8-8467-d99cad086f46 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:14.216851 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f55846-c106-4af8-8467-d99cad086f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:14.234553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e8f55846-c106-4af8-8467-d99cad086f46 None None] MFA Rules not processed for user `650c5809116e4bcd808044236c06dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:14.235714 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e8f55846-c106-4af8-8467-d99cad086f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:14.244556 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 706/1413] 10.222.0.62 () {58 vars in 1015 bytes} [Wed Apr 6 11:01:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:16.995668 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd7350-be71-4448-8f6d-1825eaf967cb None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:16.996126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd7350-be71-4448-8f6d-1825eaf967cb None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:16.996223 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd7350-be71-4448-8f6d-1825eaf967cb None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:16.997625 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:17.002872 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55629b-13cd-499d-94c5-bd39142e1f1e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:17.003317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55629b-13cd-499d-94c5-bd39142e1f1e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:17.003423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55629b-13cd-499d-94c5-bd39142e1f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:17.020532 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9b55629b-13cd-499d-94c5-bd39142e1f1e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:17.021754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9b55629b-13cd-499d-94c5-bd39142e1f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:17.029568 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:17.072447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd7350-be71-4448-8f6d-1825eaf967cb None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:17.086446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd7350-be71-4448-8f6d-1825eaf967cb None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:17.091748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3497d9-50d1-4657-bfe6-22030a9474c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:17.092878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3497d9-50d1-4657-bfe6-22030a9474c0 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:17.093187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3497d9-50d1-4657-bfe6-22030a9474c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:17.093458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3497d9-50d1-4657-bfe6-22030a9474c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:17.101442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3497d9-50d1-4657-bfe6-22030a9474c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:17.103109 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3497d9-50d1-4657-bfe6-22030a9474c0 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:17.113427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 709/1416] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:18.469488 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556f283-29df-4a51-933c-110124f4db6e None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:18.470058 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556f283-29df-4a51-933c-110124f4db6e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:18.470058 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556f283-29df-4a51-933c-110124f4db6e None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:18.471370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 11:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:18.476243 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41e055-652a-4545-98cb-647badfb26a2 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:18.476693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41e055-652a-4545-98cb-647badfb26a2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:18.476827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41e055-652a-4545-98cb-647badfb26a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:18.494966 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-3d41e055-652a-4545-98cb-647badfb26a2 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:18.496182 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3d41e055-652a-4545-98cb-647badfb26a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:18.504564 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 11:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:18.665851 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556f283-29df-4a51-933c-110124f4db6e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:18.680857 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556f283-29df-4a51-933c-110124f4db6e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:18.686884 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8f324-0ce6-4344-bdcb-d13e125b92b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:18.687515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f324-0ce6-4344-bdcb-d13e125b92b3 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:18.687795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f324-0ce6-4344-bdcb-d13e125b92b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:18.688069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f324-0ce6-4344-bdcb-d13e125b92b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:18.696017 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8f324-0ce6-4344-bdcb-d13e125b92b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:18.697678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8f324-0ce6-4344-bdcb-d13e125b92b3 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:18.706868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 709/1419] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:20.009296 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953fddc-60f5-494c-b7d3-ceee49f51945 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:20.009843 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953fddc-60f5-494c-b7d3-ceee49f51945 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:20.009843 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953fddc-60f5-494c-b7d3-ceee49f51945 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:20.011231 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 11:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:20.016703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48949800-5e51-4331-b01e-e47fd99a7571 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:20.017174 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48949800-5e51-4331-b01e-e47fd99a7571 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:20.017288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48949800-5e51-4331-b01e-e47fd99a7571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:20.035474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-48949800-5e51-4331-b01e-e47fd99a7571 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:20.036707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-48949800-5e51-4331-b01e-e47fd99a7571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:20.044490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 11:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:20.195522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953fddc-60f5-494c-b7d3-ceee49f51945 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:20.210209 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953fddc-60f5-494c-b7d3-ceee49f51945 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:20.215797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c8454-a970-4ec2-ae8c-3e80ae58f38d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:20.216438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c8454-a970-4ec2-ae8c-3e80ae58f38d service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:20.216723 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c8454-a970-4ec2-ae8c-3e80ae58f38d service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:20.217001 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c8454-a970-4ec2-ae8c-3e80ae58f38d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:20.225735 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c8454-a970-4ec2-ae8c-3e80ae58f38d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:20.227313 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c8454-a970-4ec2-ae8c-3e80ae58f38d service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:20.236655 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 712/1422] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:21.527449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388b4dc-07e7-498c-b7ef-0b5de1e0f508 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:21.528008 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388b4dc-07e7-498c-b7ef-0b5de1e0f508 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:21.528008 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388b4dc-07e7-498c-b7ef-0b5de1e0f508 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:21.529476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 11:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:21.534828 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6036a0-2dae-4da3-a9b4-d5a58fd80b85 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:21.535231 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6036a0-2dae-4da3-a9b4-d5a58fd80b85 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:21.535391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6036a0-2dae-4da3-a9b4-d5a58fd80b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:21.553043 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-fb6036a0-2dae-4da3-a9b4-d5a58fd80b85 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:21.554518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fb6036a0-2dae-4da3-a9b4-d5a58fd80b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:21.562336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 11:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:21.716554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388b4dc-07e7-498c-b7ef-0b5de1e0f508 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:21.731373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388b4dc-07e7-498c-b7ef-0b5de1e0f508 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:21.736739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2db3a-13df-437d-82af-915e1dc0a27f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:21.737392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2db3a-13df-437d-82af-915e1dc0a27f service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:21.737676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2db3a-13df-437d-82af-915e1dc0a27f service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:21.737949 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2db3a-13df-437d-82af-915e1dc0a27f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:21.745914 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2db3a-13df-437d-82af-915e1dc0a27f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:21.748565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2db3a-13df-437d-82af-915e1dc0a27f service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:21.757962 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 712/1425] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:23.068618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ebedc-cf2b-479e-a0bb-d5e99d566804 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:23.069150 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ebedc-cf2b-479e-a0bb-d5e99d566804 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:23.069251 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ebedc-cf2b-479e-a0bb-d5e99d566804 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:23.070584 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 11:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:23.075567 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74033965-c927-4041-aa02-5ffe769299af None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:23.075990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74033965-c927-4041-aa02-5ffe769299af None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:23.076115 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74033965-c927-4041-aa02-5ffe769299af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:23.094509 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-74033965-c927-4041-aa02-5ffe769299af None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:23.095673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-74033965-c927-4041-aa02-5ffe769299af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:23.103295 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 11:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:23.250528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ebedc-cf2b-479e-a0bb-d5e99d566804 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:23.265238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ebedc-cf2b-479e-a0bb-d5e99d566804 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:23.270552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e79a75-33aa-4494-9bff-334bf7e28ce2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:23.271178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e79a75-33aa-4494-9bff-334bf7e28ce2 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:23.271460 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e79a75-33aa-4494-9bff-334bf7e28ce2 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:23.271730 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e79a75-33aa-4494-9bff-334bf7e28ce2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:23.280418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e79a75-33aa-4494-9bff-334bf7e28ce2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:23.282102 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e79a75-33aa-4494-9bff-334bf7e28ce2 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:23.291419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 715/1428] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:24.654488 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db965528-6ef1-409f-b40c-920fd82b8b96 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:24.655363 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db965528-6ef1-409f-b40c-920fd82b8b96 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:24.655363 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db965528-6ef1-409f-b40c-920fd82b8b96 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:24.656476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 11:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:24.661528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a1b89-2ebb-47f1-8ec5-a65970ea7dcc None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:24.661934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a1b89-2ebb-47f1-8ec5-a65970ea7dcc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:24.662091 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a1b89-2ebb-47f1-8ec5-a65970ea7dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:24.680991 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a33a1b89-2ebb-47f1-8ec5-a65970ea7dcc None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:24.682215 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a33a1b89-2ebb-47f1-8ec5-a65970ea7dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:24.690749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 11:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:24.839388 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db965528-6ef1-409f-b40c-920fd82b8b96 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:24.854404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db965528-6ef1-409f-b40c-920fd82b8b96 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:24.860412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb30274-7fce-498e-9f7c-d3689c28370f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:24.861242 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb30274-7fce-498e-9f7c-d3689c28370f service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:24.861395 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb30274-7fce-498e-9f7c-d3689c28370f service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:24.861640 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb30274-7fce-498e-9f7c-d3689c28370f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:24.869459 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb30274-7fce-498e-9f7c-d3689c28370f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:24.871061 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb30274-7fce-498e-9f7c-d3689c28370f service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:24.880362 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 715/1431] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:26.195701 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd5deb-a32e-4dbf-807b-40ddd505170e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:26.196276 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd5deb-a32e-4dbf-807b-40ddd505170e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:26.196276 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd5deb-a32e-4dbf-807b-40ddd505170e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:26.197719 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 11:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:26.204475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c913e-62f1-40e0-9f89-4439c22023f1 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:26.204902 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c913e-62f1-40e0-9f89-4439c22023f1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:26.205028 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c913e-62f1-40e0-9f89-4439c22023f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:26.224279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-735c913e-62f1-40e0-9f89-4439c22023f1 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:26.225515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-735c913e-62f1-40e0-9f89-4439c22023f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:26.233334 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 11:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:01:26.383711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd5deb-a32e-4dbf-807b-40ddd505170e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:26.397982 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd5deb-a32e-4dbf-807b-40ddd505170e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:26.403360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4f13c-546a-4bc7-8803-e1c8d329e68d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:26.403992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4f13c-546a-4bc7-8803-e1c8d329e68d service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:26.404281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4f13c-546a-4bc7-8803-e1c8d329e68d service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:26.404587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4f13c-546a-4bc7-8803-e1c8d329e68d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:26.412728 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4f13c-546a-4bc7-8803-e1c8d329e68d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:26.414375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4f13c-546a-4bc7-8803-e1c8d329e68d service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:26.423997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 718/1434] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:27.760633 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087149bb-84d6-47a6-8655-195e00ede823 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:27.761232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087149bb-84d6-47a6-8655-195e00ede823 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:27.761232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087149bb-84d6-47a6-8655-195e00ede823 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:27.762557 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 11:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:27.768699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b7696-2786-4dab-bafd-da1ee09d6e10 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:27.769127 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b7696-2786-4dab-bafd-da1ee09d6e10 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:27.769283 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b7696-2786-4dab-bafd-da1ee09d6e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:27.786852 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-502b7696-2786-4dab-bafd-da1ee09d6e10 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:27.788038 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-502b7696-2786-4dab-bafd-da1ee09d6e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:27.796429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 11:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:27.946007 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087149bb-84d6-47a6-8655-195e00ede823 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:27.960087 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087149bb-84d6-47a6-8655-195e00ede823 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:27.965483 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b8e76-605a-489d-9fdd-1e32fea750d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:27.966108 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b8e76-605a-489d-9fdd-1e32fea750d8 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:27.966390 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b8e76-605a-489d-9fdd-1e32fea750d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:27.966666 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b8e76-605a-489d-9fdd-1e32fea750d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:27.977175 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b8e76-605a-489d-9fdd-1e32fea750d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:27.978787 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b8e76-605a-489d-9fdd-1e32fea750d8 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:27.988573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 718/1437] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:29.271056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df1eeb-03fd-4aba-b483-4bd9d84cb16c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:29.271700 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df1eeb-03fd-4aba-b483-4bd9d84cb16c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:29.271700 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df1eeb-03fd-4aba-b483-4bd9d84cb16c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:29.272913 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 11:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:29.277951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b754b0-f731-46b2-a254-deaaec7454aa None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:29.278346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b754b0-f731-46b2-a254-deaaec7454aa None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:29.278509 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b754b0-f731-46b2-a254-deaaec7454aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:29.296554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-99b754b0-f731-46b2-a254-deaaec7454aa None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:29.297779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-99b754b0-f731-46b2-a254-deaaec7454aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:29.305779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 11:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:29.454350 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df1eeb-03fd-4aba-b483-4bd9d84cb16c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:29.468547 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df1eeb-03fd-4aba-b483-4bd9d84cb16c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:29.473912 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff8495-07e3-420f-a8ba-4dab901c71e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:29.474537 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8495-07e3-420f-a8ba-4dab901c71e7 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:29.474830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8495-07e3-420f-a8ba-4dab901c71e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:29.475082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8495-07e3-420f-a8ba-4dab901c71e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:29.483438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff8495-07e3-420f-a8ba-4dab901c71e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:29.484986 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff8495-07e3-420f-a8ba-4dab901c71e7 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:29.494164 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 721/1440] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:31.663540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9a6ee-9e20-4b61-9037-3e0296859a0a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:31.664074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9a6ee-9e20-4b61-9037-3e0296859a0a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:31.664074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9a6ee-9e20-4b61-9037-3e0296859a0a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:31.665478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:31.671247 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe381b2-5f8e-44f2-a115-91c0ab8b5b6c None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:31.671687 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe381b2-5f8e-44f2-a115-91c0ab8b5b6c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:31.671807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe381b2-5f8e-44f2-a115-91c0ab8b5b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:31.690528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-9fe381b2-5f8e-44f2-a115-91c0ab8b5b6c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:31.691710 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9fe381b2-5f8e-44f2-a115-91c0ab8b5b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:31.699416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:01:31.739066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9a6ee-9e20-4b61-9037-3e0296859a0a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:31.749699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9a6ee-9e20-4b61-9037-3e0296859a0a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:31.753203 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de380866-96dd-4be2-8638-707d7129264c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:31.753832 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de380866-96dd-4be2-8638-707d7129264c service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:31.754113 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de380866-96dd-4be2-8638-707d7129264c service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:31.754390 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de380866-96dd-4be2-8638-707d7129264c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:31.763092 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de380866-96dd-4be2-8638-707d7129264c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:31.764609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de380866-96dd-4be2-8638-707d7129264c service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:31.773851 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 721/1443] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:34.188390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfdff6-6da1-4038-84b1-15ca358dd86b None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:34.188990 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfdff6-6da1-4038-84b1-15ca358dd86b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:34.188990 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfdff6-6da1-4038-84b1-15ca358dd86b None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:34.190393 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:34.196129 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4e417-83db-4136-b16a-4cf327ef0795 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:34.196558 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4e417-83db-4136-b16a-4cf327ef0795 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:34.196675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4e417-83db-4136-b16a-4cf327ef0795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:34.214557 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b1c4e417-83db-4136-b16a-4cf327ef0795 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:34.215801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b1c4e417-83db-4136-b16a-4cf327ef0795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:34.223597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:34.262707 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfdff6-6da1-4038-84b1-15ca358dd86b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:34.273517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfdff6-6da1-4038-84b1-15ca358dd86b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:34.277006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030980d-1e79-4b26-9dbf-ab2e005074e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:34.277674 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030980d-1e79-4b26-9dbf-ab2e005074e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:34.277959 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030980d-1e79-4b26-9dbf-ab2e005074e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:34.278236 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030980d-1e79-4b26-9dbf-ab2e005074e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:34.286863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030980d-1e79-4b26-9dbf-ab2e005074e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:34.288276 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030980d-1e79-4b26-9dbf-ab2e005074e0 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:34.297971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 724/1446] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:36.916288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693ae4b-a3e2-439d-9789-bca2618f5c6b None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:36.916832 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693ae4b-a3e2-439d-9789-bca2618f5c6b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:36.916832 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693ae4b-a3e2-439d-9789-bca2618f5c6b None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:36.918228 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:36.923393 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80764268-a3c1-4b43-bde0-3acdbe443f79 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:36.923842 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80764268-a3c1-4b43-bde0-3acdbe443f79 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:36.923954 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80764268-a3c1-4b43-bde0-3acdbe443f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:36.941980 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-80764268-a3c1-4b43-bde0-3acdbe443f79 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:36.943186 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-80764268-a3c1-4b43-bde0-3acdbe443f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:36.951301 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:36.990936 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693ae4b-a3e2-439d-9789-bca2618f5c6b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:36.992629 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3693ae4b-a3e2-439d-9789-bca2618f5c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:37.005880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693ae4b-a3e2-439d-9789-bca2618f5c6b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:37.009386 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31c28f-9f10-4cfc-8673-616b4d6306fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:37.010000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31c28f-9f10-4cfc-8673-616b4d6306fa service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:37.010279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31c28f-9f10-4cfc-8673-616b4d6306fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:37.010553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31c28f-9f10-4cfc-8673-616b4d6306fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:37.019888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31c28f-9f10-4cfc-8673-616b4d6306fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:37.021377 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31c28f-9f10-4cfc-8673-616b4d6306fa service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:37.030531 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 724/1449] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:39.492194 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633824d4-4514-4d4d-8459-03c56ad09c6f None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:39.492761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633824d4-4514-4d4d-8459-03c56ad09c6f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:39.492761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633824d4-4514-4d4d-8459-03c56ad09c6f None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:39.494142 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:39.499279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c96ce-d5eb-4cc3-95ee-4d671518224d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:39.499695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c96ce-d5eb-4cc3-95ee-4d671518224d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:39.499844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c96ce-d5eb-4cc3-95ee-4d671518224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:39.517597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-fa8c96ce-d5eb-4cc3-95ee-4d671518224d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:39.518790 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fa8c96ce-d5eb-4cc3-95ee-4d671518224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:39.526575 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:39.566013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633824d4-4514-4d4d-8459-03c56ad09c6f None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:39.577071 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633824d4-4514-4d4d-8459-03c56ad09c6f None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:39.580562 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d9ead-48da-426f-82f5-665c60ada1b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:39.581230 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d9ead-48da-426f-82f5-665c60ada1b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:39.581516 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d9ead-48da-426f-82f5-665c60ada1b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:39.581794 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d9ead-48da-426f-82f5-665c60ada1b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:39.590450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d9ead-48da-426f-82f5-665c60ada1b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:39.592500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d9ead-48da-426f-82f5-665c60ada1b3 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:39.601734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 727/1452] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:42.028621 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56edef-6604-449b-bad9-464e6d250188 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:42.029202 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56edef-6604-449b-bad9-464e6d250188 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:42.029300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56edef-6604-449b-bad9-464e6d250188 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:42.030657 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:42.036014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393328d-267d-4f9a-9807-48e6137ad48d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:42.036419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393328d-267d-4f9a-9807-48e6137ad48d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:42.036567 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393328d-267d-4f9a-9807-48e6137ad48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:42.054551 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-3393328d-267d-4f9a-9807-48e6137ad48d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:42.055732 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3393328d-267d-4f9a-9807-48e6137ad48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:42.064120 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:42.102601 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56edef-6604-449b-bad9-464e6d250188 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:42.113768 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56edef-6604-449b-bad9-464e6d250188 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:42.117308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dc8ba-f345-4a73-a09a-c4f525c43521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:42.117937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dc8ba-f345-4a73-a09a-c4f525c43521 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:42.118218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dc8ba-f345-4a73-a09a-c4f525c43521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:42.118493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dc8ba-f345-4a73-a09a-c4f525c43521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:42.128668 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dc8ba-f345-4a73-a09a-c4f525c43521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:42.130356 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dc8ba-f345-4a73-a09a-c4f525c43521 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:42.140509 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 727/1455] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:44.490860 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194abf5-aabc-43c1-ad15-15d851d58ce6 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:44.491425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194abf5-aabc-43c1-ad15-15d851d58ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:44.491425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194abf5-aabc-43c1-ad15-15d851d58ce6 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:44.492768 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:44.498023 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdab642-116e-4e5c-82f4-7b7bad951b19 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:44.498482 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdab642-116e-4e5c-82f4-7b7bad951b19 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:44.498612 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdab642-116e-4e5c-82f4-7b7bad951b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:44.515754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ccdab642-116e-4e5c-82f4-7b7bad951b19 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:44.516938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ccdab642-116e-4e5c-82f4-7b7bad951b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:44.524631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:44.563543 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194abf5-aabc-43c1-ad15-15d851d58ce6 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:44.574063 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194abf5-aabc-43c1-ad15-15d851d58ce6 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:44.578111 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392011b-ac7b-49f3-a4da-415b1afdfa1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:44.578746 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392011b-ac7b-49f3-a4da-415b1afdfa1d service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:44.579026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392011b-ac7b-49f3-a4da-415b1afdfa1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:44.579298 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392011b-ac7b-49f3-a4da-415b1afdfa1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:44.588420 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392011b-ac7b-49f3-a4da-415b1afdfa1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:44.589877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392011b-ac7b-49f3-a4da-415b1afdfa1d service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:44.599685 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 730/1458] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:47.021333 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9dbb8-9f56-46f5-8808-44cd14a66a50 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:47.021751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9dbb8-9f56-46f5-8808-44cd14a66a50 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:47.021881 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9dbb8-9f56-46f5-8808-44cd14a66a50 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:47.023244 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:47.028533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bbfad-c5bb-4629-b3d1-4b9fd74a18cb None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:47.028964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bbfad-c5bb-4629-b3d1-4b9fd74a18cb None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:47.029127 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bbfad-c5bb-4629-b3d1-4b9fd74a18cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:47.046909 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-ae7bbfad-c5bb-4629-b3d1-4b9fd74a18cb None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:47.048099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ae7bbfad-c5bb-4629-b3d1-4b9fd74a18cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:47.056149 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:47.093858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9dbb8-9f56-46f5-8808-44cd14a66a50 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:47.104322 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9dbb8-9f56-46f5-8808-44cd14a66a50 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:47.108548 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad17b9d-c265-49cc-9cb0-dc1baf851b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:47.109218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad17b9d-c265-49cc-9cb0-dc1baf851b1f service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:47.109501 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad17b9d-c265-49cc-9cb0-dc1baf851b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:47.109774 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad17b9d-c265-49cc-9cb0-dc1baf851b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:47.118759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad17b9d-c265-49cc-9cb0-dc1baf851b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:47.120218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad17b9d-c265-49cc-9cb0-dc1baf851b1f service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:47.130165 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 730/1461] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:49.452805 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0febd7-70e1-4695-be39-7255567aaac4 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:49.453345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0febd7-70e1-4695-be39-7255567aaac4 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:49.453345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0febd7-70e1-4695-be39-7255567aaac4 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:49.454673 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:49.459783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c900d4-2a0d-4445-bbeb-769b1a7e95a5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:49.460225 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c900d4-2a0d-4445-bbeb-769b1a7e95a5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:49.460369 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c900d4-2a0d-4445-bbeb-769b1a7e95a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:49.478291 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f4c900d4-2a0d-4445-bbeb-769b1a7e95a5 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:49.479482 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f4c900d4-2a0d-4445-bbeb-769b1a7e95a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:49.487447 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:49.524810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0febd7-70e1-4695-be39-7255567aaac4 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:49.535751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0febd7-70e1-4695-be39-7255567aaac4 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:49.539167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a105d-c2a8-4ffe-a6ff-c716bc87d48f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:49.539789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a105d-c2a8-4ffe-a6ff-c716bc87d48f service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:49.540065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a105d-c2a8-4ffe-a6ff-c716bc87d48f service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:49.540333 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a105d-c2a8-4ffe-a6ff-c716bc87d48f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:49.549534 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a105d-c2a8-4ffe-a6ff-c716bc87d48f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:49.550939 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a105d-c2a8-4ffe-a6ff-c716bc87d48f service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:49.560210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 733/1464] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:51.847446 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b726ea-2c3d-47b2-810a-1bb6b5dfcfe8 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:51.854875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b726ea-2c3d-47b2-810a-1bb6b5dfcfe8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:51.854875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b726ea-2c3d-47b2-810a-1bb6b5dfcfe8 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:51.854875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:51.855238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05a415-8923-4eeb-97ab-2b4d02b69378 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:51.855238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05a415-8923-4eeb-97ab-2b4d02b69378 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:51.855238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05a415-8923-4eeb-97ab-2b4d02b69378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:51.872471 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0a05a415-8923-4eeb-97ab-2b4d02b69378 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:51.874240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0a05a415-8923-4eeb-97ab-2b4d02b69378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:51.882106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:01:51.919097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b726ea-2c3d-47b2-810a-1bb6b5dfcfe8 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:51.930060 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b726ea-2c3d-47b2-810a-1bb6b5dfcfe8 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:51.933535 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6444e4-94b2-4e88-b22f-ff4a178fc246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:51.934164 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6444e4-94b2-4e88-b22f-ff4a178fc246 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:51.934529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6444e4-94b2-4e88-b22f-ff4a178fc246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:51.934810 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6444e4-94b2-4e88-b22f-ff4a178fc246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:51.944266 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6444e4-94b2-4e88-b22f-ff4a178fc246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:51.945778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6444e4-94b2-4e88-b22f-ff4a178fc246 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:51.955819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 733/1467] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:01:54.272574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718a98-a1b9-4635-b2b3-6c5864d82534 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:54.273167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718a98-a1b9-4635-b2b3-6c5864d82534 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:54.273167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718a98-a1b9-4635-b2b3-6c5864d82534 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:54.274541 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:01:54.280339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0899f-2ef8-4aa7-b27c-9266d721bea2 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:54.280740 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0899f-2ef8-4aa7-b27c-9266d721bea2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:54.280884 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0899f-2ef8-4aa7-b27c-9266d721bea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:54.298756 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-44d0899f-2ef8-4aa7-b27c-9266d721bea2 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:01:54.299928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-44d0899f-2ef8-4aa7-b27c-9266d721bea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:01:54.307942 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:01:54.346055 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03718a98-a1b9-4635-b2b3-6c5864d82534 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:01:54.356755 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03718a98-a1b9-4635-b2b3-6c5864d82534 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:01:54.361037 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c53b57-e741-448d-b163-6653a46e8f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:01:54.361692 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53b57-e741-448d-b163-6653a46e8f8c service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:01:54.361968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53b57-e741-448d-b163-6653a46e8f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:01:54.362258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53b57-e741-448d-b163-6653a46e8f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:01:54.371016 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c53b57-e741-448d-b163-6653a46e8f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:01:54.372437 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c53b57-e741-448d-b163-6653a46e8f8c service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:01:54.381533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 736/1470] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:02:27.962912 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a24acc-5cb4-42ca-bdfb-ec5206b27d5a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:27.963468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a24acc-5cb4-42ca-bdfb-ec5206b27d5a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:27.963468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a24acc-5cb4-42ca-bdfb-ec5206b27d5a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:27.964762 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 735/1471] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:02:27.970351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4bded-db9a-4bb6-ace0-290272f74675 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:27.970781 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4bded-db9a-4bb6-ace0-290272f74675 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:27.970944 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4bded-db9a-4bb6-ace0-290272f74675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:27.988797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-68b4bded-db9a-4bb6-ace0-290272f74675 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:02:27.990038 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-68b4bded-db9a-4bb6-ace0-290272f74675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:02:27.997735 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 737/1472] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:02:28.043389 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdec1b6-c5b7-427b-9e12-72bd578c3af6 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:28.043677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdec1b6-c5b7-427b-9e12-72bd578c3af6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:28.043956 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdec1b6-c5b7-427b-9e12-72bd578c3af6 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:28.045927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 736/1473] 10.222.0.62 () {54 vars in 961 bytes} [Wed Apr 6 11:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:02:28.050600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c0a24-43a0-44e9-b60a-fe9a63680f92 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:28.050893 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c0a24-43a0-44e9-b60a-fe9a63680f92 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:28.051172 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c0a24-43a0-44e9-b60a-fe9a63680f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:28.068792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5e1c0a24-43a0-44e9-b60a-fe9a63680f92 None None] MFA Rules not processed for user `42cd381cf5c745de9dac8f77a8cea554`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:02:28.070012 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5e1c0a24-43a0-44e9-b60a-fe9a63680f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:02:28.076351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 738/1474] 10.222.0.62 () {58 vars in 1058 bytes} [Wed Apr 6 11:02:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:02:28.083551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdec1b6-c5b7-427b-9e12-72bd578c3af6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:02:28.094428 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdec1b6-c5b7-427b-9e12-72bd578c3af6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:02:28.097945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce75a6f-a4cd-41ae-89c4-cc2ff037c397 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42cd381cf5c745de9dac8f77a8cea554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:02:28.098560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce75a6f-a4cd-41ae-89c4-cc2ff037c397 service glance] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:28.098841 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce75a6f-a4cd-41ae-89c4-cc2ff037c397 service glance] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:28.099115 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce75a6f-a4cd-41ae-89c4-cc2ff037c397 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:28.108399 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce75a6f-a4cd-41ae-89c4-cc2ff037c397 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:02:28.109886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce75a6f-a4cd-41ae-89c4-cc2ff037c397 service glance] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:02:28.119104 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 737/1475] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:02:30.501107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed4b4a-bed7-414c-88d2-272d4b062df4 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:30.501671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed4b4a-bed7-414c-88d2-272d4b062df4 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:30.501671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed4b4a-bed7-414c-88d2-272d4b062df4 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:30.503075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 739/1476] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:02:30.508490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab8783-db38-464a-979b-9368c7f7b943 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:30.508922 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab8783-db38-464a-979b-9368c7f7b943 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:30.509030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab8783-db38-464a-979b-9368c7f7b943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:30.526132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-57ab8783-db38-464a-979b-9368c7f7b943 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:02:30.527318 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-57ab8783-db38-464a-979b-9368c7f7b943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:02:30.534997 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 738/1477] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:02:30.558381 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed4b4a-bed7-414c-88d2-272d4b062df4 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:02:30.571172 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed4b4a-bed7-414c-88d2-272d4b062df4 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:02:30.575571 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c813901-21c8-4ecd-a755-0a807a18fa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:02:30.576204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c813901-21c8-4ecd-a755-0a807a18fa9b admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:30.576486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c813901-21c8-4ecd-a755-0a807a18fa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:30.576763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c813901-21c8-4ecd-a755-0a807a18fa9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:30.577550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c813901-21c8-4ecd-a755-0a807a18fa9b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:02:30.579259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-8c813901-21c8-4ecd-a755-0a807a18fa9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:02:30.579259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Apr 06 11:02:30.579259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: Apr 06 11:02:30.580382 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c813901-21c8-4ecd-a755-0a807a18fa9b admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:02:30.598715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 740/1478] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Apr 6 11:02:30 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:02:32.926191 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1b1fa-b4b3-4c8a-a925-d5305693c342 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:32.926723 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1b1fa-b4b3-4c8a-a925-d5305693c342 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:32.926723 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1b1fa-b4b3-4c8a-a925-d5305693c342 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:32.928279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 739/1479] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:02:32.933630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb564a-671e-465c-8ace-cd18f97db944 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:32.934014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb564a-671e-465c-8ace-cd18f97db944 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:32.934191 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb564a-671e-465c-8ace-cd18f97db944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:32.952533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-49fb564a-671e-465c-8ace-cd18f97db944 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:02:32.953751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-49fb564a-671e-465c-8ace-cd18f97db944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:02:32.961394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 741/1480] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:02:33.002671 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1b1fa-b4b3-4c8a-a925-d5305693c342 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:02:33.017121 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1b1fa-b4b3-4c8a-a925-d5305693c342 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:02:33.022478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46b496-8e65-4c58-9ec6-12a6a5cb0257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:02:33.023101 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46b496-8e65-4c58-9ec6-12a6a5cb0257 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:33.023385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46b496-8e65-4c58-9ec6-12a6a5cb0257 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:33.023665 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46b496-8e65-4c58-9ec6-12a6a5cb0257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:33.032215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46b496-8e65-4c58-9ec6-12a6a5cb0257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:02:33.033955 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46b496-8e65-4c58-9ec6-12a6a5cb0257 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:02:33.043476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 740/1481] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:02:35.505385 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96084d-c369-4164-a057-6a3cc7bb4344 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:35.505966 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96084d-c369-4164-a057-6a3cc7bb4344 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:35.505966 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96084d-c369-4164-a057-6a3cc7bb4344 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:35.507366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 742/1482] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:02:35.513213 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e2e4b-46c1-4474-8de3-9490645b5c62 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:35.513631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e2e4b-46c1-4474-8de3-9490645b5c62 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:35.513771 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e2e4b-46c1-4474-8de3-9490645b5c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:35.531978 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a67e2e4b-46c1-4474-8de3-9490645b5c62 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:02:35.533232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a67e2e4b-46c1-4474-8de3-9490645b5c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:02:35.540833 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 741/1483] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:02:35.576786 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96084d-c369-4164-a057-6a3cc7bb4344 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:02:35.587442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96084d-c369-4164-a057-6a3cc7bb4344 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:02:35.591635 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30d3c6-34c7-4b10-8c34-b30b1f63b382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:02:35.592265 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30d3c6-34c7-4b10-8c34-b30b1f63b382 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:35.592550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30d3c6-34c7-4b10-8c34-b30b1f63b382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:35.592828 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30d3c6-34c7-4b10-8c34-b30b1f63b382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:35.601861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30d3c6-34c7-4b10-8c34-b30b1f63b382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:02:35.603284 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30d3c6-34c7-4b10-8c34-b30b1f63b382 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:02:35.612617 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 743/1484] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:02:37.940975 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81504529-34e0-4f3d-82d3-31fefb629e82 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:37.941576 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81504529-34e0-4f3d-82d3-31fefb629e82 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:37.941576 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81504529-34e0-4f3d-82d3-31fefb629e82 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:37.942819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 742/1485] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:02:37.948007 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5b794-14fc-4237-85d8-27a43ae39fab None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:37.948449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5b794-14fc-4237-85d8-27a43ae39fab None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:37.948555 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5b794-14fc-4237-85d8-27a43ae39fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:37.966898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c4a5b794-14fc-4237-85d8-27a43ae39fab None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:02:37.968120 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c4a5b794-14fc-4237-85d8-27a43ae39fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:02:37.975911 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 744/1486] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:02:38.013804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81504529-34e0-4f3d-82d3-31fefb629e82 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:02:38.024389 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81504529-34e0-4f3d-82d3-31fefb629e82 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:02:38.027957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050401-ef7e-4c7c-8a4c-b91b1878279b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:02:38.028580 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050401-ef7e-4c7c-8a4c-b91b1878279b service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:38.028855 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050401-ef7e-4c7c-8a4c-b91b1878279b service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:38.029184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050401-ef7e-4c7c-8a4c-b91b1878279b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:38.037929 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27050401-ef7e-4c7c-8a4c-b91b1878279b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:02:38.039391 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27050401-ef7e-4c7c-8a4c-b91b1878279b service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:02:38.048517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 743/1487] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:02:40.428465 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2d8be-88f5-45c4-aa6e-f8f1745d3c13 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:40.429035 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2d8be-88f5-45c4-aa6e-f8f1745d3c13 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:40.429035 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2d8be-88f5-45c4-aa6e-f8f1745d3c13 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:40.430432 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 745/1488] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:02:40.437543 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e689e-fb94-43c4-8f69-91f31eea06cb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:40.438017 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e689e-fb94-43c4-8f69-91f31eea06cb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:40.438128 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e689e-fb94-43c4-8f69-91f31eea06cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:40.456009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-921e689e-fb94-43c4-8f69-91f31eea06cb None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:02:40.457214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-921e689e-fb94-43c4-8f69-91f31eea06cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:02:40.464794 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 744/1489] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:02:40.504835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2d8be-88f5-45c4-aa6e-f8f1745d3c13 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:02:40.516097 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2d8be-88f5-45c4-aa6e-f8f1745d3c13 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:02:40.519669 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897d8cd-fa6c-41b3-8656-8d65836458dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:02:40.520303 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d8cd-fa6c-41b3-8656-8d65836458dc service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:40.520589 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d8cd-fa6c-41b3-8656-8d65836458dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:40.520867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d8cd-fa6c-41b3-8656-8d65836458dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:40.529686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897d8cd-fa6c-41b3-8656-8d65836458dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:02:40.531112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897d8cd-fa6c-41b3-8656-8d65836458dc service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:02:40.540316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 746/1490] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:02:43.207361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52772-98d4-4e6e-8b8e-70a10f996f8f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:43.207916 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52772-98d4-4e6e-8b8e-70a10f996f8f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:43.207916 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52772-98d4-4e6e-8b8e-70a10f996f8f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:43.209294 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 745/1491] 10.222.0.62 () {54 vars in 926 bytes} [Wed Apr 6 11:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:02:43.214640 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73cb9b-833d-43cc-bd8a-1a87bce927f3 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:43.215109 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73cb9b-833d-43cc-bd8a-1a87bce927f3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:43.215220 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73cb9b-833d-43cc-bd8a-1a87bce927f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:43.234163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-1e73cb9b-833d-43cc-bd8a-1a87bce927f3 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:02:43.235356 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1e73cb9b-833d-43cc-bd8a-1a87bce927f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:02:43.243331 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 747/1492] 10.222.0.62 () {58 vars in 1023 bytes} [Wed Apr 6 11:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:02:43.282785 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca52772-98d4-4e6e-8b8e-70a10f996f8f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:02:43.293417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca52772-98d4-4e6e-8b8e-70a10f996f8f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:02:43.296977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fb57f-fd9b-455b-8a74-9a46904c6ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:02:43.297637 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fb57f-fd9b-455b-8a74-9a46904c6ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:02:43.297915 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fb57f-fd9b-455b-8a74-9a46904c6ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:02:43.298184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fb57f-fd9b-455b-8a74-9a46904c6ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:02:43.307256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fb57f-fd9b-455b-8a74-9a46904c6ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:02:43.308716 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fb57f-fd9b-455b-8a74-9a46904c6ed7 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:02:43.318597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 746/1493] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:04:21.460392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3efe-8fba-48a6-a390-2c0ef4603503 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:21.460956 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3efe-8fba-48a6-a390-2c0ef4603503 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:21.460956 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3efe-8fba-48a6-a390-2c0ef4603503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:21.478968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-fede3efe-8fba-48a6-a390-2c0ef4603503 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:04:21.480155 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fede3efe-8fba-48a6-a390-2c0ef4603503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:04:21.488352 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 748/1494] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:04:21.496193 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22a3f-ee08-4a2c-8d63-fb3e4b9a8ae6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:21.496662 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22a3f-ee08-4a2c-8d63-fb3e4b9a8ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:21.496763 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22a3f-ee08-4a2c-8d63-fb3e4b9a8ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:21.514509 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-40d22a3f-ee08-4a2c-8d63-fb3e4b9a8ae6 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:04:21.515728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-40d22a3f-ee08-4a2c-8d63-fb3e4b9a8ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:04:21.523331 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 747/1495] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:04:21.528232 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede3efe-8fba-48a6-a390-2c0ef4603503 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:04:21.538270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede3efe-8fba-48a6-a390-2c0ef4603503 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:04:21.542766 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437fba0-ed9d-46a5-b239-f8a3e7ef44f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:04:21.543407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437fba0-ed9d-46a5-b239-f8a3e7ef44f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:21.543690 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437fba0-ed9d-46a5-b239-f8a3e7ef44f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:21.543964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437fba0-ed9d-46a5-b239-f8a3e7ef44f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:21.544701 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437fba0-ed9d-46a5-b239-f8a3e7ef44f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:04:21.545035 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437fba0-ed9d-46a5-b239-f8a3e7ef44f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:04:21.546065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-4437fba0-ed9d-46a5-b239-f8a3e7ef44f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:04:21.546065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Apr 06 11:04:21.546065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: Apr 06 11:04:21.546949 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437fba0-ed9d-46a5-b239-f8a3e7ef44f8 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:04:21.559059 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 749/1496] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:04:21.567150 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d22a3f-ee08-4a2c-8d63-fb3e4b9a8ae6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:04:21.576176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d22a3f-ee08-4a2c-8d63-fb3e4b9a8ae6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:04:21.585283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0288058-a3b7-484b-9f2c-53236ca25047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:04:21.585924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0288058-a3b7-484b-9f2c-53236ca25047 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:21.586204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0288058-a3b7-484b-9f2c-53236ca25047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:21.586480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0288058-a3b7-484b-9f2c-53236ca25047 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:21.587166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0288058-a3b7-484b-9f2c-53236ca25047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:04:21.588892 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-a0288058-a3b7-484b-9f2c-53236ca25047 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:04:21.588892 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: warnings.warn(msg) Apr 06 11:04:21.588892 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: Apr 06 11:04:21.590103 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0288058-a3b7-484b-9f2c-53236ca25047 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:04:21.700726 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 748/1497] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:04:21 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:04:21.706132 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437fba0-ed9d-46a5-b239-f8a3e7ef44f8 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:04:21.718788 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437fba0-ed9d-46a5-b239-f8a3e7ef44f8 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:04:21.771761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db0607-8d42-4270-b080-cefe55d4fb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:04:21.772419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db0607-8d42-4270-b080-cefe55d4fb62 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:21.772699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db0607-8d42-4270-b080-cefe55d4fb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:21.772972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db0607-8d42-4270-b080-cefe55d4fb62 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:21.773672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db0607-8d42-4270-b080-cefe55d4fb62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:04:21.774663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-88db0607-8d42-4270-b080-cefe55d4fb62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:04:21.774663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Apr 06 11:04:21.774663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: Apr 06 11:04:21.775851 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db0607-8d42-4270-b080-cefe55d4fb62 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:04:21.843271 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 750/1498] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:04:21 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:04:21.847553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0288058-a3b7-484b-9f2c-53236ca25047 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:04:21.857532 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0288058-a3b7-484b-9f2c-53236ca25047 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:04:21.862105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c93e91-b803-425d-8c46-68718952f2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:04:21.862753 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c93e91-b803-425d-8c46-68718952f2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:21.863033 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c93e91-b803-425d-8c46-68718952f2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:21.863307 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c93e91-b803-425d-8c46-68718952f2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:21.864027 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c93e91-b803-425d-8c46-68718952f2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:04:21.865093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-d1c93e91-b803-425d-8c46-68718952f2b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:04:21.865093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: warnings.warn(msg) Apr 06 11:04:21.865093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: Apr 06 11:04:21.865976 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c93e91-b803-425d-8c46-68718952f2b4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:04:21.878665 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 749/1499] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:04:21.882538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db0607-8d42-4270-b080-cefe55d4fb62 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:04:21.893231 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db0607-8d42-4270-b080-cefe55d4fb62 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:04:21.897740 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecebe0b-540f-4b9f-a137-3a118404f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:04:21.908578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecebe0b-540f-4b9f-a137-3a118404f5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:21.908578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecebe0b-540f-4b9f-a137-3a118404f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:21.908578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecebe0b-540f-4b9f-a137-3a118404f5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:21.908578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecebe0b-540f-4b9f-a137-3a118404f5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:04:21.908578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-cecebe0b-540f-4b9f-a137-3a118404f5f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:04:21.908578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Apr 06 11:04:21.908578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: Apr 06 11:04:21.909181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecebe0b-540f-4b9f-a137-3a118404f5f8 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:04:21.914489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 751/1500] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:04:21.918618 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c93e91-b803-425d-8c46-68718952f2b4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:04:21.928971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c93e91-b803-425d-8c46-68718952f2b4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:04:21.933936 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e2d25-7f5b-43ac-806e-778aabb294de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:04:21.934808 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e2d25-7f5b-43ac-806e-778aabb294de admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:21.935089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e2d25-7f5b-43ac-806e-778aabb294de admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:21.935364 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e2d25-7f5b-43ac-806e-778aabb294de admin admin] PATH_INFO: `/v3/projects/40f9f688b1674c64b44abce96149d472/users/64e1705fe17643ee8cbbc044551f95fc/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:21.950173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e2d25-7f5b-43ac-806e-778aabb294de admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f9f688b1674c64b44abce96149d472, user_id=64e1705fe17643ee8cbbc044551f95fc, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:04:21.951239 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-db1e2d25-7f5b-43ac-806e-778aabb294de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:04:21.951239 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: warnings.warn(msg) Apr 06 11:04:21.951239 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: Apr 06 11:04:21.953795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e2d25-7f5b-43ac-806e-778aabb294de admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:04:22.036180 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 750/1501] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:04:21 2022] PUT /identity/v3/projects/40f9f688b1674c64b44abce96149d472/users/64e1705fe17643ee8cbbc044551f95fc/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:04:22.047365 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592764ed-cea4-4d69-970b-ddfb0fb0399a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:22.047653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592764ed-cea4-4d69-970b-ddfb0fb0399a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:22.047956 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592764ed-cea4-4d69-970b-ddfb0fb0399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:22.073880 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-592764ed-cea4-4d69-970b-ddfb0fb0399a None None] MFA Rules not processed for user `64e1705fe17643ee8cbbc044551f95fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:04:22.075146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-592764ed-cea4-4d69-970b-ddfb0fb0399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:04:22.136447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 752/1502] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:04:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:04:22.148437 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e2d25-7f5b-43ac-806e-778aabb294de admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:04:22.215281 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e2d25-7f5b-43ac-806e-778aabb294de admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:04:22.220727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8425d3-6888-4a26-9ede-2620eb5b4ef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:04:22.221395 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8425d3-6888-4a26-9ede-2620eb5b4ef9 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:22.221677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8425d3-6888-4a26-9ede-2620eb5b4ef9 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:22.221951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8425d3-6888-4a26-9ede-2620eb5b4ef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:22.229464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8425d3-6888-4a26-9ede-2620eb5b4ef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:04:22.231082 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8425d3-6888-4a26-9ede-2620eb5b4ef9 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:04:22.240076 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 751/1503] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:04:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:04:22.311418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765972c-cd67-4d61-be7e-9a221e3f6b96 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:22.311708 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765972c-cd67-4d61-be7e-9a221e3f6b96 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:22.311982 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765972c-cd67-4d61-be7e-9a221e3f6b96 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:22.313315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 753/1504] 10.222.0.62 () {52 vars in 829 bytes} [Wed Apr 6 11:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:04:22.316758 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8425d3-6888-4a26-9ede-2620eb5b4ef9 service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:04:22.375330 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8425d3-6888-4a26-9ede-2620eb5b4ef9 service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:04:22.379824 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:04:22.380677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:22.380956 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:22.381263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] PATH_INFO: `/v3/users/64e1705fe17643ee8cbbc044551f95fc` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:22.382428 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64e1705fe17643ee8cbbc044551f95fc)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:04:22.383476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:04:22.383476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: warnings.warn(msg) Apr 06 11:04:22.383476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: Apr 06 11:04:22.384676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:04:22.647245 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64e1705fe17643ee8cbbc044551f95fc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:04:22.647875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64e1705fe17643ee8cbbc044551f95fc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:04:22.648494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64e1705fe17643ee8cbbc044551f95fc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:04:22.807950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64e1705fe17643ee8cbbc044551f95fc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:04:22.826149 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64e1705fe17643ee8cbbc044551f95fc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:04:22.843317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 752/1505] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:04:22 2022] DELETE /identity/v3/users/64e1705fe17643ee8cbbc044551f95fc => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:04:22.847761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227a93f-f163-42cb-bf46-c969515fad90 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:22.848268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227a93f-f163-42cb-bf46-c969515fad90 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:22.848375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227a93f-f163-42cb-bf46-c969515fad90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:22.866143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-8227a93f-f163-42cb-bf46-c969515fad90 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:04:22.867337 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8227a93f-f163-42cb-bf46-c969515fad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:04:22.923408 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 754/1506] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:04:22.933183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:04:22.934597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:04:22.990933 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a10f9-aa63-41f2-92a9-a0940afa4a18 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:04:22.994612 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac73940-db6b-4804-87a1-c66f0dc4d37d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:04:22.995259 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac73940-db6b-4804-87a1-c66f0dc4d37d service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:22.995547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac73940-db6b-4804-87a1-c66f0dc4d37d service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:22.995827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac73940-db6b-4804-87a1-c66f0dc4d37d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:23.004716 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac73940-db6b-4804-87a1-c66f0dc4d37d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:04:23.006229 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac73940-db6b-4804-87a1-c66f0dc4d37d service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:04:23.015944 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 753/1507] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:04:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:04:23.501676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227a93f-f163-42cb-bf46-c969515fad90 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:04:23.503253 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8227a93f-f163-42cb-bf46-c969515fad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:04:23.515876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227a93f-f163-42cb-bf46-c969515fad90 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:04:23.520825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:04:23.521727 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:04:23.522014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:04:23.522285 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe admin admin] PATH_INFO: `/v3/projects/40f9f688b1674c64b44abce96149d472` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:04:23.523519 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f9f688b1674c64b44abce96149d472)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:04:23.524486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:04:23.524486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Apr 06 11:04:23.524486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: Apr 06 11:04:23.525716 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:04:23.659112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f9f688b1674c64b44abce96149d472', 'request_id': 'req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:04:23.734341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f9f688b1674c64b44abce96149d472', 'request_id': 'req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:04:23.748139 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f9f688b1674c64b44abce96149d472', 'request_id': 'req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:04:23.759016 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe admin admin] The token cache is being invalidate because project 40f9f688b1674c64b44abce96149d472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:04:23.759301 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:04:23.760028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-8a7e3d82-a1f3-401e-9530-810f82bc0dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:04:23.761608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 755/1508] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:04:23 2022] DELETE /identity/v3/projects/40f9f688b1674c64b44abce96149d472 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:06:08.695727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd27faa-3ff4-4f4a-8c88-65f4582261f0 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:08.696256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd27faa-3ff4-4f4a-8c88-65f4582261f0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:08.696383 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd27faa-3ff4-4f4a-8c88-65f4582261f0 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:08.697693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 754/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 11:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:06:08.702520 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f55a-94a9-445e-8eb2-fe03454a0056 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:08.702931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f55a-94a9-445e-8eb2-fe03454a0056 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:08.703086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f55a-94a9-445e-8eb2-fe03454a0056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:08.720674 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7f13f55a-94a9-445e-8eb2-fe03454a0056 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:06:08.721889 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7f13f55a-94a9-445e-8eb2-fe03454a0056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:06:08.776835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 756/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 11:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:06:08.930185 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd27faa-3ff4-4f4a-8c88-65f4582261f0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:06:08.931973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ebd27faa-3ff4-4f4a-8c88-65f4582261f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:06:09.006595 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd27faa-3ff4-4f4a-8c88-65f4582261f0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:06:09.012060 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4e182-80a2-4e98-9c32-4f5237afb5bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:06:09.012691 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4e182-80a2-4e98-9c32-4f5237afb5bf service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:09.012975 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4e182-80a2-4e98-9c32-4f5237afb5bf service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:09.013286 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4e182-80a2-4e98-9c32-4f5237afb5bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:09.021198 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4e182-80a2-4e98-9c32-4f5237afb5bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:06:09.022819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4e182-80a2-4e98-9c32-4f5237afb5bf service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:06:09.032029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 755/1511] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:06:10.281837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d041cb-3a0b-45fd-ab7b-63bc340185cf None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:10.282427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d041cb-3a0b-45fd-ab7b-63bc340185cf None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:10.282427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d041cb-3a0b-45fd-ab7b-63bc340185cf None None] PATH_INFO: `/v3` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:10.283740 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 757/1512] 10.222.0.49 () {54 vars in 925 bytes} [Wed Apr 6 11:06:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:06:10.290853 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f26d4f-2bdb-4af8-af65-d1617b30730c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:10.291262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f26d4f-2bdb-4af8-af65-d1617b30730c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:10.291429 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f26d4f-2bdb-4af8-af65-d1617b30730c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:10.308834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d437bd-c14c-4f7c-b760-ce75b81fb526 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:10.309147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d437bd-c14c-4f7c-b760-ce75b81fb526 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:10.309302 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e5f26d4f-2bdb-4af8-af65-d1617b30730c None None] MFA Rules not processed for user `1bd095449a5b44c6b1c9aca712edc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:06:10.309414 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d437bd-c14c-4f7c-b760-ce75b81fb526 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:10.310490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e5f26d4f-2bdb-4af8-af65-d1617b30730c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:06:10.310749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 758/1513] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 11:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 11:06:10.316108 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d3c32-eade-4ec4-9a0b-a79ee49c6aaf None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:10.316417 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d3c32-eade-4ec4-9a0b-a79ee49c6aaf None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:10.316678 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d3c32-eade-4ec4-9a0b-a79ee49c6aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:10.336040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-786d3c32-eade-4ec4-9a0b-a79ee49c6aaf None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:06:10.337269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-786d3c32-eade-4ec4-9a0b-a79ee49c6aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:06:10.345184 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 759/1514] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 11:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:06:10.371701 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 756/1515] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Apr 6 11:06:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:06:10.498648 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d3c32-eade-4ec4-9a0b-a79ee49c6aaf None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:06:10.510689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d3c32-eade-4ec4-9a0b-a79ee49c6aaf None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:06:10.516524 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299ffbf-556f-4ccd-bae8-c845e9e6f2fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:06:10.517218 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299ffbf-556f-4ccd-bae8-c845e9e6f2fb service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:10.517497 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299ffbf-556f-4ccd-bae8-c845e9e6f2fb service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:10.517766 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299ffbf-556f-4ccd-bae8-c845e9e6f2fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:10.525601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299ffbf-556f-4ccd-bae8-c845e9e6f2fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:06:10.527177 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299ffbf-556f-4ccd-bae8-c845e9e6f2fb service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:06:10.536751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 760/1516] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:06:20.425111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0085cc7-3f1b-49f2-a69a-e43bd5778d3d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:20.425949 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0085cc7-3f1b-49f2-a69a-e43bd5778d3d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:20.425949 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0085cc7-3f1b-49f2-a69a-e43bd5778d3d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:20.427236 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 757/1517] 10.222.0.62 () {54 vars in 960 bytes} [Wed Apr 6 11:06:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:06:20.432274 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4613612-b958-4a43-89b5-e145363fcecb None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:20.432699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4613612-b958-4a43-89b5-e145363fcecb None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:20.432853 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4613612-b958-4a43-89b5-e145363fcecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:20.450469 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a4613612-b958-4a43-89b5-e145363fcecb None None] MFA Rules not processed for user `1bd095449a5b44c6b1c9aca712edc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:06:20.451669 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a4613612-b958-4a43-89b5-e145363fcecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:06:20.460225 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 761/1518] 10.222.0.62 () {58 vars in 1057 bytes} [Wed Apr 6 11:06:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:06:20.467496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0085cc7-3f1b-49f2-a69a-e43bd5778d3d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:06:20.481003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0085cc7-3f1b-49f2-a69a-e43bd5778d3d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:06:20.486585 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982482a-b923-41ba-a090-2422b6d80365 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd095449a5b44c6b1c9aca712edc11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:06:20.487201 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982482a-b923-41ba-a090-2422b6d80365 service placement] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:20.487478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982482a-b923-41ba-a090-2422b6d80365 service placement] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:20.487750 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982482a-b923-41ba-a090-2422b6d80365 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:20.495801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982482a-b923-41ba-a090-2422b6d80365 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:06:20.497459 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982482a-b923-41ba-a090-2422b6d80365 service placement] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:06:20.506860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 758/1519] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:06:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:06:22.245411 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aed2d-c480-4190-ab37-0fe8e8053339 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:22.245991 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aed2d-c480-4190-ab37-0fe8e8053339 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:22.245991 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aed2d-c480-4190-ab37-0fe8e8053339 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:22.247343 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 762/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 11:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:06:22.252980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e12186-3200-4c7c-a2bf-a96cedfff3b8 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:22.253434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e12186-3200-4c7c-a2bf-a96cedfff3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:22.253544 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e12186-3200-4c7c-a2bf-a96cedfff3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:22.271066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e4e12186-3200-4c7c-a2bf-a96cedfff3b8 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:06:22.272263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e4e12186-3200-4c7c-a2bf-a96cedfff3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:06:22.280006 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 759/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 11:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:06:22.431580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368aed2d-c480-4190-ab37-0fe8e8053339 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:06:22.446110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368aed2d-c480-4190-ab37-0fe8e8053339 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:06:22.451381 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8cb07-c267-4699-87c7-50bbfb7dd4da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:06:22.452002 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8cb07-c267-4699-87c7-50bbfb7dd4da service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:22.452278 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8cb07-c267-4699-87c7-50bbfb7dd4da service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:22.452547 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8cb07-c267-4699-87c7-50bbfb7dd4da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:22.460307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8cb07-c267-4699-87c7-50bbfb7dd4da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:06:22.461891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8cb07-c267-4699-87c7-50bbfb7dd4da service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:06:22.471478 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 763/1522] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:06:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:06:23.768122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e1bd5-1937-4324-abbf-52044852ec00 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:23.768676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e1bd5-1937-4324-abbf-52044852ec00 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:23.768676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e1bd5-1937-4324-abbf-52044852ec00 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:23.770075 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 760/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 11:06:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:06:23.775209 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03586233-382e-4e52-bffc-0394b7271352 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:23.775660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03586233-382e-4e52-bffc-0394b7271352 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:23.775772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03586233-382e-4e52-bffc-0394b7271352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:23.793750 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-03586233-382e-4e52-bffc-0394b7271352 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:06:23.794942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-03586233-382e-4e52-bffc-0394b7271352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:06:23.802913 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 764/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 11:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:06:23.959865 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e1bd5-1937-4324-abbf-52044852ec00 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:06:23.975268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e1bd5-1937-4324-abbf-52044852ec00 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:06:23.980715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32510816-d072-4378-8341-9b807e4ffaa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:06:23.981381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32510816-d072-4378-8341-9b807e4ffaa0 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:23.981662 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32510816-d072-4378-8341-9b807e4ffaa0 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:23.981938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32510816-d072-4378-8341-9b807e4ffaa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:23.990587 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32510816-d072-4378-8341-9b807e4ffaa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:06:23.992202 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32510816-d072-4378-8341-9b807e4ffaa0 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:06:24.001516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 761/1525] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:06:28.303652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b424b8-96de-4e81-887e-0092300cd6c5 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:28.304144 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b424b8-96de-4e81-887e-0092300cd6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:28.304256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b424b8-96de-4e81-887e-0092300cd6c5 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:28.305719 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 765/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:06:28.310932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58465ab1-ec1d-46c4-ae07-1c5b017cb424 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:28.311360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58465ab1-ec1d-46c4-ae07-1c5b017cb424 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:28.311515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58465ab1-ec1d-46c4-ae07-1c5b017cb424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:28.329660 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-58465ab1-ec1d-46c4-ae07-1c5b017cb424 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:06:28.330849 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-58465ab1-ec1d-46c4-ae07-1c5b017cb424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:06:28.338646 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 762/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:06:28.374127 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b424b8-96de-4e81-887e-0092300cd6c5 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:06:28.375846 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-89b424b8-96de-4e81-887e-0092300cd6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:06:28.431376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b424b8-96de-4e81-887e-0092300cd6c5 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:06:28.434925 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf109ff4-995d-4a38-bb7c-2c363869b0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:06:28.435554 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109ff4-995d-4a38-bb7c-2c363869b0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:28.435838 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109ff4-995d-4a38-bb7c-2c363869b0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:28.436131 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109ff4-995d-4a38-bb7c-2c363869b0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:28.445472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf109ff4-995d-4a38-bb7c-2c363869b0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:06:28.446923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf109ff4-995d-4a38-bb7c-2c363869b0d1 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:06:28.456130 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 766/1528] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:06:30.747349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4ca07-81bc-4819-938a-4cb12b04236c None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:30.747878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4ca07-81bc-4819-938a-4cb12b04236c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:30.747990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4ca07-81bc-4819-938a-4cb12b04236c None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:30.749366 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 763/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:06:30.755093 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff67b6-68d7-4a50-b92f-b773ba50f771 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:30.755501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff67b6-68d7-4a50-b92f-b773ba50f771 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:30.755644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff67b6-68d7-4a50-b92f-b773ba50f771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:30.773849 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7eff67b6-68d7-4a50-b92f-b773ba50f771 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:06:30.775064 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7eff67b6-68d7-4a50-b92f-b773ba50f771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:06:30.782753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 767/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:06:30.818883 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4ca07-81bc-4819-938a-4cb12b04236c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:06:30.832612 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4ca07-81bc-4819-938a-4cb12b04236c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:06:30.836166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4201e-c91f-4762-975b-de18a0213dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:06:30.836798 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4201e-c91f-4762-975b-de18a0213dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:30.837104 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4201e-c91f-4762-975b-de18a0213dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:30.837385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4201e-c91f-4762-975b-de18a0213dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:30.846190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4201e-c91f-4762-975b-de18a0213dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:06:30.847652 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4201e-c91f-4762-975b-de18a0213dc3 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:06:30.856808 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 764/1531] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:06:34.651278 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68013b33-8ea3-4513-a86d-177927e63488 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:34.651845 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68013b33-8ea3-4513-a86d-177927e63488 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:34.651977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68013b33-8ea3-4513-a86d-177927e63488 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:34.653329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 768/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:06:34.658580 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491871-4d40-421c-ac6e-edde13b685d4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:34.659017 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491871-4d40-421c-ac6e-edde13b685d4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:34.659124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491871-4d40-421c-ac6e-edde13b685d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:34.677983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4e491871-4d40-421c-ac6e-edde13b685d4 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:06:34.679215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4e491871-4d40-421c-ac6e-edde13b685d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:06:34.687208 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 765/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:06:34.960537 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68013b33-8ea3-4513-a86d-177927e63488 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:06:34.962401 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-68013b33-8ea3-4513-a86d-177927e63488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:06:35.020132 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68013b33-8ea3-4513-a86d-177927e63488 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:06:35.023686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecc0ed-4230-4743-ad2a-cd866d580f90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:06:35.024326 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecc0ed-4230-4743-ad2a-cd866d580f90 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:35.024609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecc0ed-4230-4743-ad2a-cd866d580f90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:35.024885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecc0ed-4230-4743-ad2a-cd866d580f90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:35.033700 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ecc0ed-4230-4743-ad2a-cd866d580f90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:06:35.035119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ecc0ed-4230-4743-ad2a-cd866d580f90 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:06:35.044362 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 769/1534] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:06:37.382309 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812de960-aa6a-4d88-b4f9-e2a2e830c60b None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:37.382878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812de960-aa6a-4d88-b4f9-e2a2e830c60b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:37.382878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812de960-aa6a-4d88-b4f9-e2a2e830c60b None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:37.384222 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 766/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 11:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:06:37.389483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611754f6-b3fc-4cc3-a413-db1ec5a74dac None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:37.389915 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611754f6-b3fc-4cc3-a413-db1ec5a74dac None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:37.390038 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611754f6-b3fc-4cc3-a413-db1ec5a74dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:37.408704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-611754f6-b3fc-4cc3-a413-db1ec5a74dac None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:06:37.409935 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-611754f6-b3fc-4cc3-a413-db1ec5a74dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:06:37.418107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 770/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 11:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:06:37.686354 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2f747-0c89-4427-b3c1-293a929a8e77 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:37.686644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2f747-0c89-4427-b3c1-293a929a8e77 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:37.686923 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2f747-0c89-4427-b3c1-293a929a8e77 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:37.688281 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 767/1537] 10.222.0.62 () {54 vars in 962 bytes} [Wed Apr 6 11:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:06:37.693633 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ce20a-5c7e-48c0-906d-7d941b8836eb None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:37.693924 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ce20a-5c7e-48c0-906d-7d941b8836eb None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:37.694206 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ce20a-5c7e-48c0-906d-7d941b8836eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:37.712282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-b60ce20a-5c7e-48c0-906d-7d941b8836eb None None] MFA Rules not processed for user `5d07bf80c4f741e68d14665b092edcff`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:06:37.713496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b60ce20a-5c7e-48c0-906d-7d941b8836eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:06:37.719875 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 771/1538] 10.222.0.62 () {58 vars in 1059 bytes} [Wed Apr 6 11:06:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:06:37.727058 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2f747-0c89-4427-b3c1-293a929a8e77 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:06:37.737360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2f747-0c89-4427-b3c1-293a929a8e77 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:06:37.740800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa9d09-3a1e-4298-b2b7-1e7e2db6768b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:06:37.741451 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa9d09-3a1e-4298-b2b7-1e7e2db6768b service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:06:37.741735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa9d09-3a1e-4298-b2b7-1e7e2db6768b service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:06:37.742012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa9d09-3a1e-4298-b2b7-1e7e2db6768b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:06:37.750683 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa9d09-3a1e-4298-b2b7-1e7e2db6768b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:06:37.752717 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa9d09-3a1e-4298-b2b7-1e7e2db6768b service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:06:37.761929 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 768/1539] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:08:15.447500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35f71a-23a3-40f3-8f5a-d3bfeb72e86c None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.448137 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35f71a-23a3-40f3-8f5a-d3bfeb72e86c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.448137 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35f71a-23a3-40f3-8f5a-d3bfeb72e86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.454006 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b3f69-0824-4954-aa66-a8bbce73f996 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.454577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b3f69-0824-4954-aa66-a8bbce73f996 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.454577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b3f69-0824-4954-aa66-a8bbce73f996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.486103 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4d35f71a-23a3-40f3-8f5a-d3bfeb72e86c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:15.487752 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4d35f71a-23a3-40f3-8f5a-d3bfeb72e86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:15.490296 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-622b3f69-0824-4954-aa66-a8bbce73f996 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:15.491497 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-622b3f69-0824-4954-aa66-a8bbce73f996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:15.501629 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 772/1540] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:08:15.503569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aff4e-b661-461b-8d3c-34e6e6cd58de None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.504094 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aff4e-b661-461b-8d3c-34e6e6cd58de None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.507097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 769/1541] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Apr 06 11:08:15.507532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aff4e-b661-461b-8d3c-34e6e6cd58de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.520841 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95feec8-461f-46ad-9d9d-809e4579ceae None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.520841 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95feec8-461f-46ad-9d9d-809e4579ceae None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.520841 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95feec8-461f-46ad-9d9d-809e4579ceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.534210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-944aff4e-b661-461b-8d3c-34e6e6cd58de None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:15.535998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-944aff4e-b661-461b-8d3c-34e6e6cd58de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:15.548428 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 773/1542] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:15.550646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710a3ab-1ab9-4274-9172-520e1130cc4a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.551173 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710a3ab-1ab9-4274-9172-520e1130cc4a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.552368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710a3ab-1ab9-4274-9172-520e1130cc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.556174 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e95feec8-461f-46ad-9d9d-809e4579ceae None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:15.556174 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e95feec8-461f-46ad-9d9d-809e4579ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:15.573108 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 770/1543] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:15.573108 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8b3ec-aa7d-4a1a-a5ab-4109194d597c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.573108 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8b3ec-aa7d-4a1a-a5ab-4109194d597c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.573108 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8b3ec-aa7d-4a1a-a5ab-4109194d597c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.580777 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4710a3ab-1ab9-4274-9172-520e1130cc4a None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:15.582372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4710a3ab-1ab9-4274-9172-520e1130cc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:15.599520 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 774/1544] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:15.601261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ddc70-1876-46ae-a8fe-bddc06349b90 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.601802 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ddc70-1876-46ae-a8fe-bddc06349b90 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.602322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ddc70-1876-46ae-a8fe-bddc06349b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.607614 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5fa8b3ec-aa7d-4a1a-a5ab-4109194d597c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:15.608804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5fa8b3ec-aa7d-4a1a-a5ab-4109194d597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:15.623586 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a11ddc70-1876-46ae-a8fe-bddc06349b90 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:15.625468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a11ddc70-1876-46ae-a8fe-bddc06349b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:15.632598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 771/1545] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:15.632598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6e2a-fe23-40a0-8596-c6e8e57a2a3e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.632598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6e2a-fe23-40a0-8596-c6e8e57a2a3e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.632598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6e2a-fe23-40a0-8596-c6e8e57a2a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.651173 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 775/1546] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:15.652525 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0670d5d-0e97-47a4-93b2-448c2b6a644b None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.653398 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0670d5d-0e97-47a4-93b2-448c2b6a644b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.653716 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0670d5d-0e97-47a4-93b2-448c2b6a644b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.665880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-870d6e2a-fe23-40a0-8596-c6e8e57a2a3e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:15.667127 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-870d6e2a-fe23-40a0-8596-c6e8e57a2a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:15.679410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 772/1547] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:15.680133 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d6e2a-fe23-40a0-8596-c6e8e57a2a3e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:15.684390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e0670d5d-0e97-47a4-93b2-448c2b6a644b None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:15.685883 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e0670d5d-0e97-47a4-93b2-448c2b6a644b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:15.690884 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d6e2a-fe23-40a0-8596-c6e8e57a2a3e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:15.695272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 776/1548] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:15.695894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0670d5d-0e97-47a4-93b2-448c2b6a644b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:15.696141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f46565-057a-4cce-a4d7-8b6887e3672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:15.696795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f46565-057a-4cce-a4d7-8b6887e3672b admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.697096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f46565-057a-4cce-a4d7-8b6887e3672b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.697567 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f46565-057a-4cce-a4d7-8b6887e3672b admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.698473 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f46565-057a-4cce-a4d7-8b6887e3672b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:15.698967 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f46565-057a-4cce-a4d7-8b6887e3672b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:15.700210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-23f46565-057a-4cce-a4d7-8b6887e3672b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:08:15.700210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: warnings.warn(msg) Apr 06 11:08:15.700210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: Apr 06 11:08:15.702411 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f46565-057a-4cce-a4d7-8b6887e3672b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:15.706218 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0670d5d-0e97-47a4-93b2-448c2b6a644b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:15.711447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025ec0d-0da0-43ca-b8c3-0aab1f486dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:15.712109 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ec0d-0da0-43ca-b8c3-0aab1f486dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.712392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ec0d-0da0-43ca-b8c3-0aab1f486dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.712786 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ec0d-0da0-43ca-b8c3-0aab1f486dc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.713663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025ec0d-0da0-43ca-b8c3-0aab1f486dc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:15.713970 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025ec0d-0da0-43ca-b8c3-0aab1f486dc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:15.715295 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 773/1549] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:08:15.715589 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025ec0d-0da0-43ca-b8c3-0aab1f486dc7 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:15.716474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f46565-057a-4cce-a4d7-8b6887e3672b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:15.728472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 777/1550] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:08:15.729933 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4ff28-9476-4f7a-9a70-78d4bdf38456 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.730226 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4ff28-9476-4f7a-9a70-78d4bdf38456 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.730507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4ff28-9476-4f7a-9a70-78d4bdf38456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.734251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f46565-057a-4cce-a4d7-8b6887e3672b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:15.748217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c8ce8-71ec-45d4-9020-c60009c454e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:15.748217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8ce8-71ec-45d4-9020-c60009c454e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.748217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8ce8-71ec-45d4-9020-c60009c454e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.748217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8ce8-71ec-45d4-9020-c60009c454e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.748715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c8ce8-71ec-45d4-9020-c60009c454e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:15.748715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c8ce8-71ec-45d4-9020-c60009c454e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:15.748715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c8ce8-71ec-45d4-9020-c60009c454e5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:15.749863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d0b4ff28-9476-4f7a-9a70-78d4bdf38456 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:15.750717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d0b4ff28-9476-4f7a-9a70-78d4bdf38456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:15.763993 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 778/1551] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:15.764570 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 774/1552] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:08:15.764570 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c8ce8-71ec-45d4-9020-c60009c454e5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:15.767451 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1957b7-cee7-4eb8-90aa-8e92ca3c5873 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.767933 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1957b7-cee7-4eb8-90aa-8e92ca3c5873 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.768367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1957b7-cee7-4eb8-90aa-8e92ca3c5873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.778633 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c8ce8-71ec-45d4-9020-c60009c454e5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:15.783349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69682492-a833-4c28-84a1-f51daf0e868a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:15.784004 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69682492-a833-4c28-84a1-f51daf0e868a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.784288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69682492-a833-4c28-84a1-f51daf0e868a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.784563 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69682492-a833-4c28-84a1-f51daf0e868a admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.785324 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69682492-a833-4c28-84a1-f51daf0e868a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:15.785743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69682492-a833-4c28-84a1-f51daf0e868a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:15.786835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5c1957b7-cee7-4eb8-90aa-8e92ca3c5873 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:15.788091 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5c1957b7-cee7-4eb8-90aa-8e92ca3c5873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:15.788218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69682492-a833-4c28-84a1-f51daf0e868a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:15.796306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 779/1553] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:15.797350 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0b31c-ba95-41d6-a509-c5d98633fb59 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.797634 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0b31c-ba95-41d6-a509-c5d98633fb59 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.797936 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0b31c-ba95-41d6-a509-c5d98633fb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.800298 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 775/1554] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:08:15.801119 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69682492-a833-4c28-84a1-f51daf0e868a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:15.814731 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69682492-a833-4c28-84a1-f51daf0e868a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:15.819171 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d5d0b31c-ba95-41d6-a509-c5d98633fb59 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:15.819374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cbd01-1418-4eb3-b86f-2ecf08ba6ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:15.820028 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cbd01-1418-4eb3-b86f-2ecf08ba6ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.820306 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cbd01-1418-4eb3-b86f-2ecf08ba6ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.820417 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d5d0b31c-ba95-41d6-a509-c5d98633fb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:15.820586 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cbd01-1418-4eb3-b86f-2ecf08ba6ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.821300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726cbd01-1418-4eb3-b86f-2ecf08ba6ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:15.823234 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726cbd01-1418-4eb3-b86f-2ecf08ba6ad2 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:15.831982 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 780/1555] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:15.831982 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0b31c-ba95-41d6-a509-c5d98633fb59 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:15.838465 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0b31c-ba95-41d6-a509-c5d98633fb59 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:15.843320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78a0d5-d916-488a-8df6-f096ee360973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:15.851495 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78a0d5-d916-488a-8df6-f096ee360973 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.851495 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78a0d5-d916-488a-8df6-f096ee360973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.851495 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78a0d5-d916-488a-8df6-f096ee360973 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.851495 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78a0d5-d916-488a-8df6-f096ee360973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:15.851495 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-4b78a0d5-d916-488a-8df6-f096ee360973 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:08:15.851495 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Apr 06 11:08:15.851495 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: Apr 06 11:08:15.852061 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78a0d5-d916-488a-8df6-f096ee360973 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:15.918140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 776/1556] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:15.919098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cbd01-1418-4eb3-b86f-2ecf08ba6ad2 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:15.936910 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 781/1557] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/projects => generated 357 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:15.938366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0cf3-23ce-462b-b55b-8b932cd5d33f None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:15.938660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0cf3-23ce-462b-b55b-8b932cd5d33f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:15.938965 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0cf3-23ce-462b-b55b-8b932cd5d33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:15.956345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-64bc0cf3-23ce-462b-b55b-8b932cd5d33f None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:15.958267 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-64bc0cf3-23ce-462b-b55b-8b932cd5d33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:15.981973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cbd01-1418-4eb3-b86f-2ecf08ba6ad2 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.015570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 782/1558] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:16.016774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ed1e0-03ce-493f-8aa8-f588c93c2f8e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.017097 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ed1e0-03ce-493f-8aa8-f588c93c2f8e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.017368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ed1e0-03ce-493f-8aa8-f588c93c2f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.035853 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd648d5-f11e-43c0-ae65-76664d98f762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.036110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-109ed1e0-03ce-493f-8aa8-f588c93c2f8e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:16.037046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd648d5-f11e-43c0-ae65-76664d98f762 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.037350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd648d5-f11e-43c0-ae65-76664d98f762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.037624 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd648d5-f11e-43c0-ae65-76664d98f762 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.037731 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-109ed1e0-03ce-493f-8aa8-f588c93c2f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:16.038307 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd648d5-f11e-43c0-ae65-76664d98f762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.040260 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd648d5-f11e-43c0-ae65-76664d98f762 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.045589 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 783/1559] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:16.046791 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d281465-0d58-401e-a6c2-62bf4686e6b5 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.047137 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d281465-0d58-401e-a6c2-62bf4686e6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.047333 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d281465-0d58-401e-a6c2-62bf4686e6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.065216 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-3d281465-0d58-401e-a6c2-62bf4686e6b5 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:16.066436 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3d281465-0d58-401e-a6c2-62bf4686e6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:16.074889 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 784/1560] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:16.075624 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d281465-0d58-401e-a6c2-62bf4686e6b5 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.085113 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d281465-0d58-401e-a6c2-62bf4686e6b5 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.090324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c08aa-b639-4dea-a591-9de6008b14de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.090948 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c08aa-b639-4dea-a591-9de6008b14de admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.091230 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c08aa-b639-4dea-a591-9de6008b14de admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.091504 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c08aa-b639-4dea-a591-9de6008b14de admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.092176 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c08aa-b639-4dea-a591-9de6008b14de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.094119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c08aa-b639-4dea-a591-9de6008b14de admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.118616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 777/1561] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:15 2022] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:16.119588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd648d5-f11e-43c0-ae65-76664d98f762 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.177591 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd648d5-f11e-43c0-ae65-76664d98f762 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.182135 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259516ba-09ce-42b7-a15d-b0635f94ce66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.182783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259516ba-09ce-42b7-a15d-b0635f94ce66 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.183064 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259516ba-09ce-42b7-a15d-b0635f94ce66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.183340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259516ba-09ce-42b7-a15d-b0635f94ce66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.184053 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259516ba-09ce-42b7-a15d-b0635f94ce66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:16.184358 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259516ba-09ce-42b7-a15d-b0635f94ce66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.186015 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259516ba-09ce-42b7-a15d-b0635f94ce66 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.196787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 785/1562] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:16 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:16.196787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c08aa-b639-4dea-a591-9de6008b14de admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.207230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 778/1563] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:08:16.207230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259516ba-09ce-42b7-a15d-b0635f94ce66 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.211389 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259516ba-09ce-42b7-a15d-b0635f94ce66 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.254977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c08aa-b639-4dea-a591-9de6008b14de admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.259596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2589-35da-497f-ac57-054c8765f013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.260266 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2589-35da-497f-ac57-054c8765f013 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.260553 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2589-35da-497f-ac57-054c8765f013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.260829 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2589-35da-497f-ac57-054c8765f013 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.261550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b2589-35da-497f-ac57-054c8765f013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.263466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b2589-35da-497f-ac57-054c8765f013 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.265287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d2343-19a4-4be2-b58f-551b0fad44b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.266029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2343-19a4-4be2-b58f-551b0fad44b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.266256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2343-19a4-4be2-b58f-551b0fad44b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.266527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2343-19a4-4be2-b58f-551b0fad44b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.267198 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d2343-19a4-4be2-b58f-551b0fad44b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.268263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-4a1d2343-19a4-4be2-b58f-551b0fad44b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:08:16.268263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: warnings.warn(msg) Apr 06 11:08:16.268263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: Apr 06 11:08:16.269495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d2343-19a4-4be2-b58f-551b0fad44b7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.380896 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 786/1564] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:16 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:16.381765 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2589-35da-497f-ac57-054c8765f013 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.391034 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2589-35da-497f-ac57-054c8765f013 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.395698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a12ff3-77b4-4a11-863c-1b0c2afc2653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.396329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a12ff3-77b4-4a11-863c-1b0c2afc2653 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.396615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a12ff3-77b4-4a11-863c-1b0c2afc2653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.396895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a12ff3-77b4-4a11-863c-1b0c2afc2653 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.397640 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a12ff3-77b4-4a11-863c-1b0c2afc2653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:16.397952 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a12ff3-77b4-4a11-863c-1b0c2afc2653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.399528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a12ff3-77b4-4a11-863c-1b0c2afc2653 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.411806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 787/1565] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:08:16.412968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24c3f5-6e01-46af-9d86-683db84b7c71 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.413287 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24c3f5-6e01-46af-9d86-683db84b7c71 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.413723 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24c3f5-6e01-46af-9d86-683db84b7c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.431379 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-de24c3f5-6e01-46af-9d86-683db84b7c71 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:16.432596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-de24c3f5-6e01-46af-9d86-683db84b7c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:16.441775 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 779/1566] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:16 2022] POST /identity/v3/users => generated 279 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:16.441775 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d2343-19a4-4be2-b58f-551b0fad44b7 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.447452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 788/1567] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:16.447452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24c3f5-6e01-46af-9d86-683db84b7c71 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.452236 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d2343-19a4-4be2-b58f-551b0fad44b7 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.453712 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24c3f5-6e01-46af-9d86-683db84b7c71 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.457008 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdda78-61a0-4a0b-9a5e-a17965402361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.457686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdda78-61a0-4a0b-9a5e-a17965402361 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.457993 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdda78-61a0-4a0b-9a5e-a17965402361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.458272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdda78-61a0-4a0b-9a5e-a17965402361 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.458377 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd842de-77db-48d7-9695-d0870e0acf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.458996 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdda78-61a0-4a0b-9a5e-a17965402361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:16.459110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd842de-77db-48d7-9695-d0870e0acf73 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.459282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd842de-77db-48d7-9695-d0870e0acf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.459387 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdda78-61a0-4a0b-9a5e-a17965402361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.459560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd842de-77db-48d7-9695-d0870e0acf73 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.460243 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd842de-77db-48d7-9695-d0870e0acf73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.460965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdda78-61a0-4a0b-9a5e-a17965402361 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.462201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd842de-77db-48d7-9695-d0870e0acf73 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.473122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 780/1568] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:08:16.474398 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdda78-61a0-4a0b-9a5e-a17965402361 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.483543 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdda78-61a0-4a0b-9a5e-a17965402361 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.488326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d682-e43a-478d-96de-73bc629dd150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.489609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d682-e43a-478d-96de-73bc629dd150 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.489911 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d682-e43a-478d-96de-73bc629dd150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.490188 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d682-e43a-478d-96de-73bc629dd150 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.490859 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9d682-e43a-478d-96de-73bc629dd150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.492793 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9d682-e43a-478d-96de-73bc629dd150 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.547072 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 789/1569] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:16 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:16.547652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd842de-77db-48d7-9695-d0870e0acf73 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.558269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd842de-77db-48d7-9695-d0870e0acf73 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.562875 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cff83-a01f-4d17-ad7b-6e2ef17e88db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.563517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cff83-a01f-4d17-ad7b-6e2ef17e88db admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.563804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cff83-a01f-4d17-ad7b-6e2ef17e88db admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.564081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cff83-a01f-4d17-ad7b-6e2ef17e88db admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.564766 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cff83-a01f-4d17-ad7b-6e2ef17e88db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.567344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cff83-a01f-4d17-ad7b-6e2ef17e88db admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.581674 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 781/1570] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:16 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:16.585272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d682-e43a-478d-96de-73bc629dd150 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.592279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d682-e43a-478d-96de-73bc629dd150 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.596770 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120e75b-0f28-4b62-a2b0-a24ff9581ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.597438 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120e75b-0f28-4b62-a2b0-a24ff9581ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.597720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120e75b-0f28-4b62-a2b0-a24ff9581ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.597995 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120e75b-0f28-4b62-a2b0-a24ff9581ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.599211 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120e75b-0f28-4b62-a2b0-a24ff9581ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.600824 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120e75b-0f28-4b62-a2b0-a24ff9581ee9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.610242 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 782/1571] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:16.611040 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120e75b-0f28-4b62-a2b0-a24ff9581ee9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.620792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120e75b-0f28-4b62-a2b0-a24ff9581ee9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.625355 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0a6aa-37a8-4194-851a-bc3697cbbd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.625937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0a6aa-37a8-4194-851a-bc3697cbbd9a admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.626218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0a6aa-37a8-4194-851a-bc3697cbbd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.626490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0a6aa-37a8-4194-851a-bc3697cbbd9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.627142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0a6aa-37a8-4194-851a-bc3697cbbd9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.628983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0a6aa-37a8-4194-851a-bc3697cbbd9a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.668665 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 790/1572] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:16 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:16.669537 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cff83-a01f-4d17-ad7b-6e2ef17e88db admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.725415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 783/1573] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:16 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:16.726328 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0a6aa-37a8-4194-851a-bc3697cbbd9a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.731320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cff83-a01f-4d17-ad7b-6e2ef17e88db admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.785164 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0a6aa-37a8-4194-851a-bc3697cbbd9a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.785365 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069d023-0496-4ee9-869a-c28a422c334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.785789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d023-0496-4ee9-869a-c28a422c334c admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.786105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d023-0496-4ee9-869a-c28a422c334c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.786379 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d023-0496-4ee9-869a-c28a422c334c admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.787096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069d023-0496-4ee9-869a-c28a422c334c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.788697 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069d023-0496-4ee9-869a-c28a422c334c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.789841 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f709d-4421-45e7-aa1a-ab5b2d3a7430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.790499 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f709d-4421-45e7-aa1a-ab5b2d3a7430 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.790795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f709d-4421-45e7-aa1a-ab5b2d3a7430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.791060 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f709d-4421-45e7-aa1a-ab5b2d3a7430 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.791779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f709d-4421-45e7-aa1a-ab5b2d3a7430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:16.792088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f709d-4421-45e7-aa1a-ab5b2d3a7430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.793764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f709d-4421-45e7-aa1a-ab5b2d3a7430 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.798255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 791/1574] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:16.799048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069d023-0496-4ee9-869a-c28a422c334c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.813111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 784/1575] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:08:16.813111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f709d-4421-45e7-aa1a-ab5b2d3a7430 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.813433 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069d023-0496-4ee9-869a-c28a422c334c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.816741 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f709d-4421-45e7-aa1a-ab5b2d3a7430 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.819594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8ba5a-d96d-4243-ba3c-def080b0f226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.820322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ba5a-d96d-4243-ba3c-def080b0f226 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.820614 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ba5a-d96d-4243-ba3c-def080b0f226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.820896 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ba5a-d96d-4243-ba3c-def080b0f226 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.821641 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8ba5a-d96d-4243-ba3c-def080b0f226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.822080 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa16a97-4b80-444e-93fd-cd2e77cf1f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.822735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16a97-4b80-444e-93fd-cd2e77cf1f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.823018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16a97-4b80-444e-93fd-cd2e77cf1f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.823291 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16a97-4b80-444e-93fd-cd2e77cf1f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.823761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8ba5a-d96d-4243-ba3c-def080b0f226 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.824014 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa16a97-4b80-444e-93fd-cd2e77cf1f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.825720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa16a97-4b80-444e-93fd-cd2e77cf1f44 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.835684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 785/1576] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:16.836479 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa16a97-4b80-444e-93fd-cd2e77cf1f44 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.846227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa16a97-4b80-444e-93fd-cd2e77cf1f44 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.850919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7b797-b2d1-4c55-b47d-2cb6963dcec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.851592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7b797-b2d1-4c55-b47d-2cb6963dcec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.851982 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7b797-b2d1-4c55-b47d-2cb6963dcec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.852263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7b797-b2d1-4c55-b47d-2cb6963dcec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.852973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7b797-b2d1-4c55-b47d-2cb6963dcec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.854611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7b797-b2d1-4c55-b47d-2cb6963dcec8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.868066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 786/1577] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:16.868066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7b797-b2d1-4c55-b47d-2cb6963dcec8 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.875268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7b797-b2d1-4c55-b47d-2cb6963dcec8 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.880738 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37beba8-5aa7-4762-93ad-661989342434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.881461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37beba8-5aa7-4762-93ad-661989342434 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.881746 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37beba8-5aa7-4762-93ad-661989342434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.882029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37beba8-5aa7-4762-93ad-661989342434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.882764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37beba8-5aa7-4762-93ad-661989342434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.884341 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37beba8-5aa7-4762-93ad-661989342434 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.893891 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 787/1578] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:16.896235 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37beba8-5aa7-4762-93ad-661989342434 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.903912 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37beba8-5aa7-4762-93ad-661989342434 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.908499 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4db70c-b5f2-4e92-8ed9-d0a05222af9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.909203 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4db70c-b5f2-4e92-8ed9-d0a05222af9e admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.909486 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4db70c-b5f2-4e92-8ed9-d0a05222af9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.909761 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4db70c-b5f2-4e92-8ed9-d0a05222af9e admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.910425 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4db70c-b5f2-4e92-8ed9-d0a05222af9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.912342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4db70c-b5f2-4e92-8ed9-d0a05222af9e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.913920 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 792/1579] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:16 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:16.917830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8ba5a-d96d-4243-ba3c-def080b0f226 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.976743 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8ba5a-d96d-4243-ba3c-def080b0f226 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:16.981330 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850a593-542c-4588-9c6f-a18e06269310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:16.981991 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850a593-542c-4588-9c6f-a18e06269310 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:16.982283 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850a593-542c-4588-9c6f-a18e06269310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:16.982546 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850a593-542c-4588-9c6f-a18e06269310 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:16.983223 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850a593-542c-4588-9c6f-a18e06269310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:16.985164 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850a593-542c-4588-9c6f-a18e06269310 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:16.987027 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 788/1580] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:16 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:16.987850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4db70c-b5f2-4e92-8ed9-d0a05222af9e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:16.997735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4db70c-b5f2-4e92-8ed9-d0a05222af9e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.002461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a4e7f-7923-4591-bd98-1e371ea66cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.003105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a4e7f-7923-4591-bd98-1e371ea66cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.003406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a4e7f-7923-4591-bd98-1e371ea66cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.003774 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a4e7f-7923-4591-bd98-1e371ea66cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.004492 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a4e7f-7923-4591-bd98-1e371ea66cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.006718 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a4e7f-7923-4591-bd98-1e371ea66cd3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.016818 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 789/1581] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:17.017661 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a4e7f-7923-4591-bd98-1e371ea66cd3 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.026779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a4e7f-7923-4591-bd98-1e371ea66cd3 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.031200 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bafd4-ce9f-42e5-8f6c-525bd0307751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.031787 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bafd4-ce9f-42e5-8f6c-525bd0307751 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.032064 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bafd4-ce9f-42e5-8f6c-525bd0307751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.032335 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bafd4-ce9f-42e5-8f6c-525bd0307751 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.032986 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bafd4-ce9f-42e5-8f6c-525bd0307751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.034903 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bafd4-ce9f-42e5-8f6c-525bd0307751 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.061186 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 793/1582] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:16 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:17.062073 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850a593-542c-4588-9c6f-a18e06269310 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.072186 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850a593-542c-4588-9c6f-a18e06269310 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.076904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f65d8-892f-4c9b-b53e-88b558d1b92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.077582 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f65d8-892f-4c9b-b53e-88b558d1b92b admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.077869 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f65d8-892f-4c9b-b53e-88b558d1b92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.078147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f65d8-892f-4c9b-b53e-88b558d1b92b admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.078867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f65d8-892f-4c9b-b53e-88b558d1b92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.080455 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f65d8-892f-4c9b-b53e-88b558d1b92b admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.090496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 794/1583] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:17.091269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f65d8-892f-4c9b-b53e-88b558d1b92b admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.101013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f65d8-892f-4c9b-b53e-88b558d1b92b admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.105672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a7034-bc20-405b-8bb7-884de4673319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.106301 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a7034-bc20-405b-8bb7-884de4673319 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.106584 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a7034-bc20-405b-8bb7-884de4673319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.106861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a7034-bc20-405b-8bb7-884de4673319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.107561 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a7034-bc20-405b-8bb7-884de4673319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.108231 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 790/1584] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:17 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:17.109146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a7034-bc20-405b-8bb7-884de4673319 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.109403 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bafd4-ce9f-42e5-8f6c-525bd0307751 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.123367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 795/1585] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:17.123367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a7034-bc20-405b-8bb7-884de4673319 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.130788 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a7034-bc20-405b-8bb7-884de4673319 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.173261 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bafd4-ce9f-42e5-8f6c-525bd0307751 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.179454 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44ec4c-2eae-45c6-a3a9-ff583895d3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.180338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44ec4c-2eae-45c6-a3a9-ff583895d3de admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.180621 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44ec4c-2eae-45c6-a3a9-ff583895d3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.180901 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44ec4c-2eae-45c6-a3a9-ff583895d3de admin admin] PATH_INFO: `/v3/projects/77cc9b40d9d24168b1b12ba4f97b7e2e/users/f308c93294464e0789d62d64881d59ac/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.187531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041942f-5926-44fc-822d-8f065711ec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.188343 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041942f-5926-44fc-822d-8f065711ec6c admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.188657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041942f-5926-44fc-822d-8f065711ec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.188938 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041942f-5926-44fc-822d-8f065711ec6c admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.189656 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041942f-5926-44fc-822d-8f065711ec6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.191577 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041942f-5926-44fc-822d-8f065711ec6c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.194860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44ec4c-2eae-45c6-a3a9-ff583895d3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=77cc9b40d9d24168b1b12ba4f97b7e2e, user_id=f308c93294464e0789d62d64881d59ac, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.197599 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44ec4c-2eae-45c6-a3a9-ff583895d3de admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.294412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 791/1586] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:17 2022] PUT /identity/v3/projects/77cc9b40d9d24168b1b12ba4f97b7e2e/users/f308c93294464e0789d62d64881d59ac/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:17.295233 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44ec4c-2eae-45c6-a3a9-ff583895d3de admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.326932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 796/1587] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:17 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:17.326932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041942f-5926-44fc-822d-8f065711ec6c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.334962 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041942f-5926-44fc-822d-8f065711ec6c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.356167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44ec4c-2eae-45c6-a3a9-ff583895d3de admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.360747 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6aee5-5a50-4e41-993f-1593da5bf8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.361536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6aee5-5a50-4e41-993f-1593da5bf8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.361823 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6aee5-5a50-4e41-993f-1593da5bf8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.362096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6aee5-5a50-4e41-993f-1593da5bf8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.362835 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6aee5-5a50-4e41-993f-1593da5bf8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.365045 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6aee5-5a50-4e41-993f-1593da5bf8f1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.374570 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 792/1588] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:17.375363 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6aee5-5a50-4e41-993f-1593da5bf8f1 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.384595 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6aee5-5a50-4e41-993f-1593da5bf8f1 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.389416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c974808-1b5d-4690-af90-d5d02e86de02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.390051 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c974808-1b5d-4690-af90-d5d02e86de02 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.390337 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c974808-1b5d-4690-af90-d5d02e86de02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.390612 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c974808-1b5d-4690-af90-d5d02e86de02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.390723 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b29100-69ad-44b9-8c74-eab75dedc1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.391343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c974808-1b5d-4690-af90-d5d02e86de02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.391554 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b29100-69ad-44b9-8c74-eab75dedc1d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.391838 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b29100-69ad-44b9-8c74-eab75dedc1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.392114 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b29100-69ad-44b9-8c74-eab75dedc1d3 admin admin] PATH_INFO: `/v3/projects/ad0b07f55e734216814626b2ad995c2d/users/d3fafd9cb21f4d0cb042ea983310aaf8/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.393015 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c974808-1b5d-4690-af90-d5d02e86de02 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.402940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 793/1589] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:17.403814 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c974808-1b5d-4690-af90-d5d02e86de02 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.406145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b29100-69ad-44b9-8c74-eab75dedc1d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0b07f55e734216814626b2ad995c2d, user_id=d3fafd9cb21f4d0cb042ea983310aaf8, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.407190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-73b29100-69ad-44b9-8c74-eab75dedc1d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:08:17.407190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Apr 06 11:08:17.407190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: Apr 06 11:08:17.409126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b29100-69ad-44b9-8c74-eab75dedc1d3 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.413727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c974808-1b5d-4690-af90-d5d02e86de02 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.418252 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28689723-9120-4a55-b907-c5104e9b22f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.419113 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28689723-9120-4a55-b907-c5104e9b22f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.419392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28689723-9120-4a55-b907-c5104e9b22f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.419668 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28689723-9120-4a55-b907-c5104e9b22f1 admin admin] PATH_INFO: `/v3/projects/92825d48c6c044b3bad475b05c9d138f/users/943b6ee853b3419d86efb708721cbeb5/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.434728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28689723-9120-4a55-b907-c5104e9b22f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92825d48c6c044b3bad475b05c9d138f, user_id=943b6ee853b3419d86efb708721cbeb5, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.437486 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28689723-9120-4a55-b907-c5104e9b22f1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.478662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 797/1590] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:17 2022] PUT /identity/v3/projects/ad0b07f55e734216814626b2ad995c2d/users/d3fafd9cb21f4d0cb042ea983310aaf8/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:17.479663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b29100-69ad-44b9-8c74-eab75dedc1d3 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.506631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 794/1591] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:17 2022] PUT /identity/v3/projects/92825d48c6c044b3bad475b05c9d138f/users/943b6ee853b3419d86efb708721cbeb5/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:17.507496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28689723-9120-4a55-b907-c5104e9b22f1 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.539769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b29100-69ad-44b9-8c74-eab75dedc1d3 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.569853 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28689723-9120-4a55-b907-c5104e9b22f1 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.575535 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c5fb2-287e-4f15-98e5-4210175b33a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.576820 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c5fb2-287e-4f15-98e5-4210175b33a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.577190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c5fb2-287e-4f15-98e5-4210175b33a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.577415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c5fb2-287e-4f15-98e5-4210175b33a4 admin admin] PATH_INFO: `/v3/projects/aeca9938df6a4f308208d5b9370aff6d/users/145dbd68096f410d81b61b4c9f70ca3e/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.594119 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c5fb2-287e-4f15-98e5-4210175b33a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeca9938df6a4f308208d5b9370aff6d, user_id=145dbd68096f410d81b61b4c9f70ca3e, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.596523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a071d-0269-4ce1-b131-cacf4f7c2e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.596523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a071d-0269-4ce1-b131-cacf4f7c2e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.596523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a071d-0269-4ce1-b131-cacf4f7c2e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.596827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a071d-0269-4ce1-b131-cacf4f7c2e55 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.597011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c5fb2-287e-4f15-98e5-4210175b33a4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.597268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a071d-0269-4ce1-b131-cacf4f7c2e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.599209 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a071d-0269-4ce1-b131-cacf4f7c2e55 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.684527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 795/1592] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:17 2022] PUT /identity/v3/projects/aeca9938df6a4f308208d5b9370aff6d/users/145dbd68096f410d81b61b4c9f70ca3e/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:17.685917 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077fc8-03e5-416c-91f0-e2563473c0d6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.688485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077fc8-03e5-416c-91f0-e2563473c0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.688485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077fc8-03e5-416c-91f0-e2563473c0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.712464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-eb077fc8-03e5-416c-91f0-e2563473c0d6 None None] MFA Rules not processed for user `f308c93294464e0789d62d64881d59ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:17.717288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 798/1593] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:17 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:17.717288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a071d-0269-4ce1-b131-cacf4f7c2e55 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.717494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-eb077fc8-03e5-416c-91f0-e2563473c0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:17.723161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a071d-0269-4ce1-b131-cacf4f7c2e55 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.775069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 796/1594] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:17.775911 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb077fc8-03e5-416c-91f0-e2563473c0d6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.782248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041446c9-2a4a-46e3-8972-0d5af9e7e237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.782934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041446c9-2a4a-46e3-8972-0d5af9e7e237 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.783211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041446c9-2a4a-46e3-8972-0d5af9e7e237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.783483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041446c9-2a4a-46e3-8972-0d5af9e7e237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.784213 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041446c9-2a4a-46e3-8972-0d5af9e7e237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.785868 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041446c9-2a4a-46e3-8972-0d5af9e7e237 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.796230 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 799/1595] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:17.797095 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041446c9-2a4a-46e3-8972-0d5af9e7e237 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.807211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041446c9-2a4a-46e3-8972-0d5af9e7e237 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.811929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8d104-1fe4-4206-869e-b7a46ccd924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.812570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d104-1fe4-4206-869e-b7a46ccd924a admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.812873 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d104-1fe4-4206-869e-b7a46ccd924a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.813162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d104-1fe4-4206-869e-b7a46ccd924a admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.813871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8d104-1fe4-4206-869e-b7a46ccd924a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.815439 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8d104-1fe4-4206-869e-b7a46ccd924a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.825799 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 800/1596] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:17.827130 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7998-71a3-409d-92f2-9cb148bdf164 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.827484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7998-71a3-409d-92f2-9cb148bdf164 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.827696 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7998-71a3-409d-92f2-9cb148bdf164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.840712 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb077fc8-03e5-416c-91f0-e2563473c0d6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.845369 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6b884-d7e7-4097-b176-56ebf6df64aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.846062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6b884-d7e7-4097-b176-56ebf6df64aa admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.846342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6b884-d7e7-4097-b176-56ebf6df64aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.846618 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6b884-d7e7-4097-b176-56ebf6df64aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.847334 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6b884-d7e7-4097-b176-56ebf6df64aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.849536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6b884-d7e7-4097-b176-56ebf6df64aa admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.853463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4b7b7998-71a3-409d-92f2-9cb148bdf164 None None] MFA Rules not processed for user `d3fafd9cb21f4d0cb042ea983310aaf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:17.854680 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4b7b7998-71a3-409d-92f2-9cb148bdf164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:17.859093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 797/1597] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:17.860308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45067-6398-4160-a6fb-21ad81bf3421 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.860606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45067-6398-4160-a6fb-21ad81bf3421 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.860880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45067-6398-4160-a6fb-21ad81bf3421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.877980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-00c45067-6398-4160-a6fb-21ad81bf3421 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:17.879168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-00c45067-6398-4160-a6fb-21ad81bf3421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:17.887272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 798/1598] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:17.888458 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78b741-ac18-44f1-9bb4-9e76ef85c29f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.888738 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78b741-ac18-44f1-9bb4-9e76ef85c29f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.889009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78b741-ac18-44f1-9bb4-9e76ef85c29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.906712 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1d78b741-ac18-44f1-9bb4-9e76ef85c29f None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:17.907896 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1d78b741-ac18-44f1-9bb4-9e76ef85c29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:17.915584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 799/1599] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:17.916361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78b741-ac18-44f1-9bb4-9e76ef85c29f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.926079 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78b741-ac18-44f1-9bb4-9e76ef85c29f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.929881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 801/1600] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:17 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:17.929881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef423b4-61e8-44cd-aa18-9a6ccdb6d37c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.929881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef423b4-61e8-44cd-aa18-9a6ccdb6d37c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.929881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef423b4-61e8-44cd-aa18-9a6ccdb6d37c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.931392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 802/1601] 10.222.0.62 () {54 vars in 960 bytes} [Wed Apr 6 11:08:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:08:17.932147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef423b4-61e8-44cd-aa18-9a6ccdb6d37c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.934051 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe83463-5700-4e9e-bdab-d290f250d357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.934893 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe83463-5700-4e9e-bdab-d290f250d357 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.935327 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe83463-5700-4e9e-bdab-d290f250d357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.935794 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe83463-5700-4e9e-bdab-d290f250d357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.936686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe83463-5700-4e9e-bdab-d290f250d357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.938771 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe83463-5700-4e9e-bdab-d290f250d357 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.945587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef423b4-61e8-44cd-aa18-9a6ccdb6d37c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.952232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 800/1602] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:17.952232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe83463-5700-4e9e-bdab-d290f250d357 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.956977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854c2c6-c592-402e-b1cd-c317c161566b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.957739 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c2c6-c592-402e-b1cd-c317c161566b admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.958530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c2c6-c592-402e-b1cd-c317c161566b admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.958804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c2c6-c592-402e-b1cd-c317c161566b admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.959529 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854c2c6-c592-402e-b1cd-c317c161566b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.960189 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe83463-5700-4e9e-bdab-d290f250d357 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.961166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854c2c6-c592-402e-b1cd-c317c161566b admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.964688 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b9f0-66a7-4c92-bfc9-9de1b86ea23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.965591 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b9f0-66a7-4c92-bfc9-9de1b86ea23d admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.965872 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b9f0-66a7-4c92-bfc9-9de1b86ea23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.966147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b9f0-66a7-4c92-bfc9-9de1b86ea23d admin admin] PATH_INFO: `/v3/projects/94c0b061e2a24d03a975a9eade9dd120/users/585d8737c50a4aa7b8665c9702429880/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:17.971222 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 803/1603] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:17.972054 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854c2c6-c592-402e-b1cd-c317c161566b admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:17.980965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871b9f0-66a7-4c92-bfc9-9de1b86ea23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c0b061e2a24d03a975a9eade9dd120, user_id=585d8737c50a4aa7b8665c9702429880, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:17.981507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854c2c6-c592-402e-b1cd-c317c161566b admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:17.983696 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871b9f0-66a7-4c92-bfc9-9de1b86ea23d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:17.986034 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f9098-dfcf-42b6-bef0-441ff3338389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:17.986895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f9098-dfcf-42b6-bef0-441ff3338389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:17.987205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f9098-dfcf-42b6-bef0-441ff3338389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:17.987460 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f9098-dfcf-42b6-bef0-441ff3338389 admin admin] PATH_INFO: `/v3/projects/a0dc163b51fb4e55b0618099d5459785/users/4f1a57c46e594a539019605221e02227/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.002386 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f9098-dfcf-42b6-bef0-441ff3338389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0dc163b51fb4e55b0618099d5459785, user_id=4f1a57c46e594a539019605221e02227, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:18.005896 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f9098-dfcf-42b6-bef0-441ff3338389 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:18.100007 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 801/1604] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:17 2022] PUT /identity/v3/projects/94c0b061e2a24d03a975a9eade9dd120/users/585d8737c50a4aa7b8665c9702429880/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:18.100847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b9f0-66a7-4c92-bfc9-9de1b86ea23d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:18.112142 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 804/1605] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:17 2022] PUT /identity/v3/projects/a0dc163b51fb4e55b0618099d5459785/users/4f1a57c46e594a539019605221e02227/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:18.113025 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f9098-dfcf-42b6-bef0-441ff3338389 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:18.156401 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b9f0-66a7-4c92-bfc9-9de1b86ea23d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:18.172795 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f9098-dfcf-42b6-bef0-441ff3338389 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:18.177318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220dd2f-2afb-4aa0-976f-2b4a3c3171ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:18.177967 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220dd2f-2afb-4aa0-976f-2b4a3c3171ae service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.178248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220dd2f-2afb-4aa0-976f-2b4a3c3171ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.178525 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220dd2f-2afb-4aa0-976f-2b4a3c3171ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.204009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aefaa4-18cc-491b-ba39-54a01d43dd66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:18.204744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aefaa4-18cc-491b-ba39-54a01d43dd66 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.205024 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aefaa4-18cc-491b-ba39-54a01d43dd66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.205325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aefaa4-18cc-491b-ba39-54a01d43dd66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.243168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220dd2f-2afb-4aa0-976f-2b4a3c3171ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:18.244613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220dd2f-2afb-4aa0-976f-2b4a3c3171ae service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:18.254315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 805/1606] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:18.255764 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220dd2f-2afb-4aa0-976f-2b4a3c3171ae service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:18.265003 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220dd2f-2afb-4aa0-976f-2b4a3c3171ae service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:18.270576 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450b8ee-78e8-4a69-aefd-b957491c7bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:18.271249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450b8ee-78e8-4a69-aefd-b957491c7bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.271521 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450b8ee-78e8-4a69-aefd-b957491c7bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.271796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450b8ee-78e8-4a69-aefd-b957491c7bb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.272487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450b8ee-78e8-4a69-aefd-b957491c7bb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:18.274425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450b8ee-78e8-4a69-aefd-b957491c7bb9 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:18.280554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aefaa4-18cc-491b-ba39-54a01d43dd66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:18.282074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aefaa4-18cc-491b-ba39-54a01d43dd66 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:18.291481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 802/1607] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:18.292877 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4af23-3012-45ae-8ecb-9d5b30d6d2e2 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.293198 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4af23-3012-45ae-8ecb-9d5b30d6d2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.293479 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4af23-3012-45ae-8ecb-9d5b30d6d2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.311534 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f4d4af23-3012-45ae-8ecb-9d5b30d6d2e2 None None] MFA Rules not processed for user `650c5809116e4bcd808044236c06dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:18.317947 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f4d4af23-3012-45ae-8ecb-9d5b30d6d2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:18.374984 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 806/1608] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:18 2022] POST /identity/v3/projects => generated 355 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:18.374984 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450b8ee-78e8-4a69-aefd-b957491c7bb9 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:18.380632 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 803/1609] 10.222.0.62 () {58 vars in 1057 bytes} [Wed Apr 6 11:08:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:18.381443 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4af23-3012-45ae-8ecb-9d5b30d6d2e2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:18.392184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4af23-3012-45ae-8ecb-9d5b30d6d2e2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:18.440240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450b8ee-78e8-4a69-aefd-b957491c7bb9 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:18.446020 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cbf22-ea2f-4014-b915-aade15c8ef80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:18.446713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cbf22-ea2f-4014-b915-aade15c8ef80 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.447004 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cbf22-ea2f-4014-b915-aade15c8ef80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.447285 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cbf22-ea2f-4014-b915-aade15c8ef80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.448013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cbf22-ea2f-4014-b915-aade15c8ef80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:18.449718 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cbf22-ea2f-4014-b915-aade15c8ef80 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:18.453951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c763d-3088-4a1d-8ea1-965d0a4f5d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:18.454176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c763d-3088-4a1d-8ea1-965d0a4f5d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.454449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c763d-3088-4a1d-8ea1-965d0a4f5d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.454699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c763d-3088-4a1d-8ea1-965d0a4f5d06 admin admin] PATH_INFO: `/v3/projects/570fcc7ba7fd442190ca2be7ca059e29/users/aaed14bffb5745349ea35289c4e30089/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.460892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 807/1610] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:18.462279 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4029e-93e1-4c85-99ba-8b6f453d1243 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.462640 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4029e-93e1-4c85-99ba-8b6f453d1243 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.462924 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4029e-93e1-4c85-99ba-8b6f453d1243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.471621 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c763d-3088-4a1d-8ea1-965d0a4f5d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=570fcc7ba7fd442190ca2be7ca059e29, user_id=aaed14bffb5745349ea35289c4e30089, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:18.474928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c763d-3088-4a1d-8ea1-965d0a4f5d06 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:18.493923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-adc4029e-93e1-4c85-99ba-8b6f453d1243 None None] MFA Rules not processed for user `585d8737c50a4aa7b8665c9702429880`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:18.495160 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-adc4029e-93e1-4c85-99ba-8b6f453d1243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:18.554013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 804/1611] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:18 2022] PUT /identity/v3/projects/570fcc7ba7fd442190ca2be7ca059e29/users/aaed14bffb5745349ea35289c4e30089/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:18.555557 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b894330-146a-40ce-8ff8-83f4a7198e0d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.555854 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b894330-146a-40ce-8ff8-83f4a7198e0d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.556133 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b894330-146a-40ce-8ff8-83f4a7198e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.564464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 808/1612] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:18.566003 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4029e-93e1-4c85-99ba-8b6f453d1243 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:18.582686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4029e-93e1-4c85-99ba-8b6f453d1243 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:18.586436 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1b894330-146a-40ce-8ff8-83f4a7198e0d None None] MFA Rules not processed for user `4f1a57c46e594a539019605221e02227`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:18.587827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1b894330-146a-40ce-8ff8-83f4a7198e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:18.662003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 805/1613] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:18.662949 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b894330-146a-40ce-8ff8-83f4a7198e0d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:18.664093 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2107c-04a0-4197-bcdf-57df3b7c0a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:18.664786 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2107c-04a0-4197-bcdf-57df3b7c0a3c admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.665106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2107c-04a0-4197-bcdf-57df3b7c0a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.665413 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2107c-04a0-4197-bcdf-57df3b7c0a3c admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.666196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2107c-04a0-4197-bcdf-57df3b7c0a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:18.668619 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2107c-04a0-4197-bcdf-57df3b7c0a3c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:18.738881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 809/1614] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:18 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:18.738881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2107c-04a0-4197-bcdf-57df3b7c0a3c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:18.740231 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b894330-146a-40ce-8ff8-83f4a7198e0d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:18.745665 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d54ae-4221-4f50-bd1b-f9e5c723d6ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:18.746334 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d54ae-4221-4f50-bd1b-f9e5c723d6ad service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.746798 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d54ae-4221-4f50-bd1b-f9e5c723d6ad service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.746972 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d54ae-4221-4f50-bd1b-f9e5c723d6ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.750269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2107c-04a0-4197-bcdf-57df3b7c0a3c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:18.756378 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81c68f-7821-4dd1-901e-e34b265f2109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:18.757483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81c68f-7821-4dd1-901e-e34b265f2109 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.757900 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81c68f-7821-4dd1-901e-e34b265f2109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.758231 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81c68f-7821-4dd1-901e-e34b265f2109 admin admin] PATH_INFO: `/v3/projects/8bcfb6262bb7416b985b1d670dcdf4ec/users/f506156c62014060ab9004b7abbb2369/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.774316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81c68f-7821-4dd1-901e-e34b265f2109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bcfb6262bb7416b985b1d670dcdf4ec, user_id=f506156c62014060ab9004b7abbb2369, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:18.777445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81c68f-7821-4dd1-901e-e34b265f2109 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:18.808058 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d54ae-4221-4f50-bd1b-f9e5c723d6ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:18.813938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d54ae-4221-4f50-bd1b-f9e5c723d6ad service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:18.824794 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 806/1615] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:18.826571 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f51d39-30d7-4846-8078-200e95d3d71b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.827013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f51d39-30d7-4846-8078-200e95d3d71b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.836376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f51d39-30d7-4846-8078-200e95d3d71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.847083 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-89f51d39-30d7-4846-8078-200e95d3d71b None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:18.848734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-89f51d39-30d7-4846-8078-200e95d3d71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:18.858278 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 807/1616] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:18.860078 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d1fe1-30f6-4dff-adfa-e4ef493dfa6a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.860539 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d1fe1-30f6-4dff-adfa-e4ef493dfa6a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.861017 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d1fe1-30f6-4dff-adfa-e4ef493dfa6a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.865427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 810/1617] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:18 2022] PUT /identity/v3/projects/8bcfb6262bb7416b985b1d670dcdf4ec/users/f506156c62014060ab9004b7abbb2369/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:18.866360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81c68f-7821-4dd1-901e-e34b265f2109 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:18.868157 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 808/1618] 10.222.0.62 () {54 vars in 960 bytes} [Wed Apr 6 11:08:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:08:18.869490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d1fe1-30f6-4dff-adfa-e4ef493dfa6a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:18.950832 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81c68f-7821-4dd1-901e-e34b265f2109 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:18.956169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b87d7-2a8d-4273-a1e9-c361ed0c9dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:18.956680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d1fe1-30f6-4dff-adfa-e4ef493dfa6a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:18.957197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b87d7-2a8d-4273-a1e9-c361ed0c9dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.957673 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b87d7-2a8d-4273-a1e9-c361ed0c9dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.958169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b87d7-2a8d-4273-a1e9-c361ed0c9dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.959004 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b87d7-2a8d-4273-a1e9-c361ed0c9dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:18.961233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b87d7-2a8d-4273-a1e9-c361ed0c9dc7 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:18.962247 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3643b5-8f31-40e1-86c4-cde57fef0bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:18.963146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3643b5-8f31-40e1-86c4-cde57fef0bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:18.963838 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3643b5-8f31-40e1-86c4-cde57fef0bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:18.964219 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3643b5-8f31-40e1-86c4-cde57fef0bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:18.965754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3643b5-8f31-40e1-86c4-cde57fef0bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:18.967618 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3643b5-8f31-40e1-86c4-cde57fef0bc4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:18.990253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 809/1619] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:18.991327 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3643b5-8f31-40e1-86c4-cde57fef0bc4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:19.060778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 811/1620] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:18 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:19.061233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f797e-80e0-442b-964f-6db1996a25a5 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.061416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f797e-80e0-442b-964f-6db1996a25a5 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.067903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f797e-80e0-442b-964f-6db1996a25a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.080527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3643b5-8f31-40e1-86c4-cde57fef0bc4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:19.093344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-cf2f797e-80e0-442b-964f-6db1996a25a5 None None] MFA Rules not processed for user `650c5809116e4bcd808044236c06dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:19.094762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-cf2f797e-80e0-442b-964f-6db1996a25a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:19.134642 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b25655-5997-443b-b96f-f736beb7f206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:19.135297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b25655-5997-443b-b96f-f736beb7f206 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.135577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b25655-5997-443b-b96f-f736beb7f206 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.136580 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b25655-5997-443b-b96f-f736beb7f206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.176778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 812/1621] 10.222.0.62 () {58 vars in 1057 bytes} [Wed Apr 6 11:08:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:19.178207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac774e-465c-40ca-a910-9dd8e118b561 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.178496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac774e-465c-40ca-a910-9dd8e118b561 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.178782 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac774e-465c-40ca-a910-9dd8e118b561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.200520 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-baac774e-465c-40ca-a910-9dd8e118b561 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:19.201886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-baac774e-465c-40ca-a910-9dd8e118b561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:19.213756 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b25655-5997-443b-b96f-f736beb7f206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:19.215746 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b25655-5997-443b-b96f-f736beb7f206 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:19.217479 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 813/1622] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:19.218615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac774e-465c-40ca-a910-9dd8e118b561 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:19.229826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 810/1623] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:19.231831 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc4fbe-bf84-40ea-91f0-df8bf4f36ea6 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.235390 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc4fbe-bf84-40ea-91f0-df8bf4f36ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.235390 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc4fbe-bf84-40ea-91f0-df8bf4f36ea6 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.235390 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 811/1624] 10.222.0.62 () {54 vars in 912 bytes} [Wed Apr 6 11:08:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:08:19.235390 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc4fbe-bf84-40ea-91f0-df8bf4f36ea6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:19.243220 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac774e-465c-40ca-a910-9dd8e118b561 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:19.249179 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab4e81-2b65-4aba-a3f0-9e04d10784a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:19.250848 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab4e81-2b65-4aba-a3f0-9e04d10784a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.251478 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab4e81-2b65-4aba-a3f0-9e04d10784a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.252197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab4e81-2b65-4aba-a3f0-9e04d10784a0 admin admin] PATH_INFO: `/v3/projects/3a2e53cd8e0840a3b515d4052da436a2/users/08e20d8f2de24f50a31be5b8d17571fe/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.256390 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc4fbe-bf84-40ea-91f0-df8bf4f36ea6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:19.262276 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc8876-56d8-4d5f-96f8-16d0d380852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:19.265455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc8876-56d8-4d5f-96f8-16d0d380852c admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.265455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc8876-56d8-4d5f-96f8-16d0d380852c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.265455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc8876-56d8-4d5f-96f8-16d0d380852c admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.265455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc8876-56d8-4d5f-96f8-16d0d380852c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:19.267409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc8876-56d8-4d5f-96f8-16d0d380852c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:19.293578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab4e81-2b65-4aba-a3f0-9e04d10784a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2e53cd8e0840a3b515d4052da436a2, user_id=08e20d8f2de24f50a31be5b8d17571fe, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:19.296662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab4e81-2b65-4aba-a3f0-9e04d10784a0 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:19.347747 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 812/1625] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:19 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:19.348936 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc8876-56d8-4d5f-96f8-16d0d380852c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:19.370277 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc8876-56d8-4d5f-96f8-16d0d380852c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:19.380729 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 814/1626] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:19 2022] PUT /identity/v3/projects/3a2e53cd8e0840a3b515d4052da436a2/users/08e20d8f2de24f50a31be5b8d17571fe/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:19.382355 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf1756-1e91-45c1-886c-ab3e9df86d42 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.382652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf1756-1e91-45c1-886c-ab3e9df86d42 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.383097 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf1756-1e91-45c1-886c-ab3e9df86d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.412256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-fecf1756-1e91-45c1-886c-ab3e9df86d42 None None] MFA Rules not processed for user `650c5809116e4bcd808044236c06dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:19.413841 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fecf1756-1e91-45c1-886c-ab3e9df86d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:19.463926 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381aa42-3e82-4e72-b630-470adacb47bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:19.464875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381aa42-3e82-4e72-b630-470adacb47bf service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.465413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381aa42-3e82-4e72-b630-470adacb47bf service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.466010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381aa42-3e82-4e72-b630-470adacb47bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.509809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 815/1627] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:08:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:19.510798 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf1756-1e91-45c1-886c-ab3e9df86d42 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:19.536609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381aa42-3e82-4e72-b630-470adacb47bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:19.538484 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381aa42-3e82-4e72-b630-470adacb47bf service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:19.549712 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 813/1628] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:19.550666 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381aa42-3e82-4e72-b630-470adacb47bf service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:19.587129 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf1756-1e91-45c1-886c-ab3e9df86d42 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:19.591408 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe11d81-51fe-453b-8dcb-2ff4101fccca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:19.592220 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe11d81-51fe-453b-8dcb-2ff4101fccca service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.593082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe11d81-51fe-453b-8dcb-2ff4101fccca service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.599015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe11d81-51fe-453b-8dcb-2ff4101fccca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.630599 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381aa42-3e82-4e72-b630-470adacb47bf service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:19.635978 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a18ea-541e-4da4-b1f0-4127c0729b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:19.636989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a18ea-541e-4da4-b1f0-4127c0729b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.636989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a18ea-541e-4da4-b1f0-4127c0729b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.637311 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a18ea-541e-4da4-b1f0-4127c0729b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.638028 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a18ea-541e-4da4-b1f0-4127c0729b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:19.639859 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a18ea-541e-4da4-b1f0-4127c0729b75 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:19.657342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 814/1629] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:19.657342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a18ea-541e-4da4-b1f0-4127c0729b75 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:19.666618 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a18ea-541e-4da4-b1f0-4127c0729b75 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:19.676305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe11d81-51fe-453b-8dcb-2ff4101fccca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:19.678186 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe11d81-51fe-453b-8dcb-2ff4101fccca service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:19.684826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e999d-ef4b-4652-8113-56641a8791fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:19.684826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e999d-ef4b-4652-8113-56641a8791fd admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.684826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e999d-ef4b-4652-8113-56641a8791fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.684826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e999d-ef4b-4652-8113-56641a8791fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.685210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e999d-ef4b-4652-8113-56641a8791fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:19.685210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e999d-ef4b-4652-8113-56641a8791fd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:19.689431 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 816/1630] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:19.690181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe11d81-51fe-453b-8dcb-2ff4101fccca service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:19.695173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 815/1631] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:19.696269 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e999d-ef4b-4652-8113-56641a8791fd admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:19.709402 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e999d-ef4b-4652-8113-56641a8791fd admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:19.719496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a53de7-6b55-42e3-b29b-c7653c7985c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:19.719496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53de7-6b55-42e3-b29b-c7653c7985c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.719496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53de7-6b55-42e3-b29b-c7653c7985c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.719496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53de7-6b55-42e3-b29b-c7653c7985c3 admin admin] PATH_INFO: `/v3/projects/f7c5eec49d1d468b94b23ba7c41a4ac5/users/2ab38757ed4e43deace01860d4de23bb/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.744848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a53de7-6b55-42e3-b29b-c7653c7985c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c5eec49d1d468b94b23ba7c41a4ac5, user_id=2ab38757ed4e43deace01860d4de23bb, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:19.749346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a53de7-6b55-42e3-b29b-c7653c7985c3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:19.753958 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe11d81-51fe-453b-8dcb-2ff4101fccca service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:19.759152 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ee4bd-0700-4914-98fc-860c8bc35017 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:19.759904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ee4bd-0700-4914-98fc-860c8bc35017 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.760357 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ee4bd-0700-4914-98fc-860c8bc35017 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.760885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ee4bd-0700-4914-98fc-860c8bc35017 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.774667 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ee4bd-0700-4914-98fc-860c8bc35017 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:19.776705 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ee4bd-0700-4914-98fc-860c8bc35017 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:19.791155 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 817/1632] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:19.791936 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ee4bd-0700-4914-98fc-860c8bc35017 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:19.805486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ee4bd-0700-4914-98fc-860c8bc35017 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:19.815880 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523ffa-6c3b-4292-9819-1d1a99d11ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:19.820863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523ffa-6c3b-4292-9819-1d1a99d11ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.820863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523ffa-6c3b-4292-9819-1d1a99d11ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.820863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523ffa-6c3b-4292-9819-1d1a99d11ac1 admin admin] PATH_INFO: `/v3/projects/3a2e53cd8e0840a3b515d4052da436a2/users/08e20d8f2de24f50a31be5b8d17571fe/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.820863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41523ffa-6c3b-4292-9819-1d1a99d11ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2e53cd8e0840a3b515d4052da436a2, user_id=08e20d8f2de24f50a31be5b8d17571fe, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:19.823768 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41523ffa-6c3b-4292-9819-1d1a99d11ac1 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:19.852811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 816/1634] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:19 2022] PUT /identity/v3/projects/f7c5eec49d1d468b94b23ba7c41a4ac5/users/2ab38757ed4e43deace01860d4de23bb/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:19.855753 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4a84d-2529-4f0a-ad1f-9ad946ae135c None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.856247 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4a84d-2529-4f0a-ad1f-9ad946ae135c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.856887 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4a84d-2529-4f0a-ad1f-9ad946ae135c None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.859345 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 817/1635] 10.222.0.62 () {54 vars in 912 bytes} [Wed Apr 6 11:08:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:08:19.860441 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4a84d-2529-4f0a-ad1f-9ad946ae135c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:19.871374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 818/1635] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:19 2022] PUT /identity/v3/projects/3a2e53cd8e0840a3b515d4052da436a2/users/08e20d8f2de24f50a31be5b8d17571fe/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:19.873019 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dc7f2-63a9-4232-855b-958cdf5a42ed None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.873685 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dc7f2-63a9-4232-855b-958cdf5a42ed None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.873969 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dc7f2-63a9-4232-855b-958cdf5a42ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.942334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4f9dc7f2-63a9-4232-855b-958cdf5a42ed None None] MFA Rules not processed for user `08e20d8f2de24f50a31be5b8d17571fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:19.943620 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4f9dc7f2-63a9-4232-855b-958cdf5a42ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:19.944393 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4a84d-2529-4f0a-ad1f-9ad946ae135c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:19.950908 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f5681-47b1-4bcf-85ac-135eef994f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:19.951369 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f5681-47b1-4bcf-85ac-135eef994f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.951705 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f5681-47b1-4bcf-85ac-135eef994f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.952020 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f5681-47b1-4bcf-85ac-135eef994f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:19.952754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f5681-47b1-4bcf-85ac-135eef994f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:19.954823 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f5681-47b1-4bcf-85ac-135eef994f39 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:19.978906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 818/1636] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:19.986216 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ee8d6-6e5f-43fa-a47c-a122cd65fbbe None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:19.986452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ee8d6-6e5f-43fa-a47c-a122cd65fbbe None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:19.986668 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ee8d6-6e5f-43fa-a47c-a122cd65fbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:20.023906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f29ee8d6-6e5f-43fa-a47c-a122cd65fbbe None None] MFA Rules not processed for user `650c5809116e4bcd808044236c06dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:20.030891 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f29ee8d6-6e5f-43fa-a47c-a122cd65fbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:20.093083 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 819/1637] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:19 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:20.094564 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dc7f2-63a9-4232-855b-958cdf5a42ed None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:20.114857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dc7f2-63a9-4232-855b-958cdf5a42ed None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:20.120014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b4b4d-784c-48af-b70e-f9e21a5c5e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:20.126169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b4b4d-784c-48af-b70e-f9e21a5c5e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:20.126169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b4b4d-784c-48af-b70e-f9e21a5c5e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:20.126169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b4b4d-784c-48af-b70e-f9e21a5c5e3f admin admin] PATH_INFO: `/v3/projects/f7c5eec49d1d468b94b23ba7c41a4ac5/users/2ab38757ed4e43deace01860d4de23bb/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:20.126169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b4b4d-784c-48af-b70e-f9e21a5c5e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c5eec49d1d468b94b23ba7c41a4ac5, user_id=2ab38757ed4e43deace01860d4de23bb, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:20.128556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b4b4d-784c-48af-b70e-f9e21a5c5e3f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:20.154603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 820/1638] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:20 2022] PUT /identity/v3/projects/f7c5eec49d1d468b94b23ba7c41a4ac5/users/2ab38757ed4e43deace01860d4de23bb/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:20.156011 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dc278-c97c-470e-8650-7fbff211192f None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:20.156315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dc278-c97c-470e-8650-7fbff211192f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:20.156666 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dc278-c97c-470e-8650-7fbff211192f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:20.191539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-945dc278-c97c-470e-8650-7fbff211192f None None] MFA Rules not processed for user `943b6ee853b3419d86efb708721cbeb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:20.193825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-945dc278-c97c-470e-8650-7fbff211192f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:20.206788 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 819/1639] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:08:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:20.208613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ee8d6-6e5f-43fa-a47c-a122cd65fbbe None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:20.283289 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ee8d6-6e5f-43fa-a47c-a122cd65fbbe None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:20.350393 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38daff6-c6b4-42ba-93c3-44dfff1f92d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:20.351913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38daff6-c6b4-42ba-93c3-44dfff1f92d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:20.351913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38daff6-c6b4-42ba-93c3-44dfff1f92d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:20.352132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38daff6-c6b4-42ba-93c3-44dfff1f92d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:20.371825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 821/1640] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:20.373586 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f544de-0f99-434d-bc74-9c326a56ef08 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:20.377630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f544de-0f99-434d-bc74-9c326a56ef08 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:20.377630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f544de-0f99-434d-bc74-9c326a56ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:20.409207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-83f544de-0f99-434d-bc74-9c326a56ef08 None None] MFA Rules not processed for user `2ab38757ed4e43deace01860d4de23bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:20.411211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-83f544de-0f99-434d-bc74-9c326a56ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:20.444459 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38daff6-c6b4-42ba-93c3-44dfff1f92d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:20.446192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38daff6-c6b4-42ba-93c3-44dfff1f92d0 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:20.469916 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 820/1641] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:20 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:20.479776 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5218e2a-774e-42ca-9e0b-af65afa24eee None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:20.480254 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5218e2a-774e-42ca-9e0b-af65afa24eee None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:20.480639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5218e2a-774e-42ca-9e0b-af65afa24eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:20.506625 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e5218e2a-774e-42ca-9e0b-af65afa24eee None None] MFA Rules not processed for user `943b6ee853b3419d86efb708721cbeb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:20.508727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e5218e2a-774e-42ca-9e0b-af65afa24eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:20.516897 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 821/1642] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:20.573161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 822/1643] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:20.604444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5218e2a-774e-42ca-9e0b-af65afa24eee None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:20.614776 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5218e2a-774e-42ca-9e0b-af65afa24eee None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:20.619563 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd060f7-6075-43f3-b702-9610f2c92511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:20.620472 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd060f7-6075-43f3-b702-9610f2c92511 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:20.620912 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd060f7-6075-43f3-b702-9610f2c92511 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:20.621532 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd060f7-6075-43f3-b702-9610f2c92511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:20.720786 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd060f7-6075-43f3-b702-9610f2c92511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:20.722422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd060f7-6075-43f3-b702-9610f2c92511 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:20.735612 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 822/1644] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:21.001810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f544de-0f99-434d-bc74-9c326a56ef08 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:21.012570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f544de-0f99-434d-bc74-9c326a56ef08 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:21.016494 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b94b-3c30-4282-8d7f-143c57ca9c00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:21.017179 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b94b-3c30-4282-8d7f-143c57ca9c00 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:21.017457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b94b-3c30-4282-8d7f-143c57ca9c00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:21.017732 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b94b-3c30-4282-8d7f-143c57ca9c00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:21.028059 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60b94b-3c30-4282-8d7f-143c57ca9c00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:21.029526 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60b94b-3c30-4282-8d7f-143c57ca9c00 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:21.039388 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 823/1645] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:21.071082 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd060f7-6075-43f3-b702-9610f2c92511 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:21.273609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd060f7-6075-43f3-b702-9610f2c92511 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:21.296872 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1aedf-61d6-41f2-b1ac-8ddcde50f107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:21.297936 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1aedf-61d6-41f2-b1ac-8ddcde50f107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:21.301002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1aedf-61d6-41f2-b1ac-8ddcde50f107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:21.301002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1aedf-61d6-41f2-b1ac-8ddcde50f107 admin admin] PATH_INFO: `/v3/users/4f1a57c46e594a539019605221e02227` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:21.301002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1aedf-61d6-41f2-b1ac-8ddcde50f107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f1a57c46e594a539019605221e02227)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:21.308667 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1aedf-61d6-41f2-b1ac-8ddcde50f107 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:21.372517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b94b-3c30-4282-8d7f-143c57ca9c00 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:21.391111 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b94b-3c30-4282-8d7f-143c57ca9c00 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:21.454173 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd72eff-2718-489e-b04f-956e00fe492b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:21.454173 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd72eff-2718-489e-b04f-956e00fe492b service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:21.454173 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd72eff-2718-489e-b04f-956e00fe492b service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:21.454173 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd72eff-2718-489e-b04f-956e00fe492b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:21.471943 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd72eff-2718-489e-b04f-956e00fe492b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:21.476780 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd72eff-2718-489e-b04f-956e00fe492b service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:21.520751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 824/1646] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:21.538772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd72eff-2718-489e-b04f-956e00fe492b service nova] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:21.544587 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b0f1aedf-61d6-41f2-b1ac-8ddcde50f107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f1a57c46e594a539019605221e02227'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:21.545446 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b0f1aedf-61d6-41f2-b1ac-8ddcde50f107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f1a57c46e594a539019605221e02227'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:21.546066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b0f1aedf-61d6-41f2-b1ac-8ddcde50f107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f1a57c46e594a539019605221e02227'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:21.573540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd72eff-2718-489e-b04f-956e00fe492b service nova] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:21.587848 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf24847-d846-4f6e-8ef0-da4a26a7d36b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:21.588588 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf24847-d846-4f6e-8ef0-da4a26a7d36b service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:21.588926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf24847-d846-4f6e-8ef0-da4a26a7d36b service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:21.589518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf24847-d846-4f6e-8ef0-da4a26a7d36b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:21.591636 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4bf24847-d846-4f6e-8ef0-da4a26a7d36b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:21.656448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b0f1aedf-61d6-41f2-b1ac-8ddcde50f107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f1a57c46e594a539019605221e02227'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:21.686053 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b0f1aedf-61d6-41f2-b1ac-8ddcde50f107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f1a57c46e594a539019605221e02227'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:21.716862 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 823/1647] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:08:21 2022] DELETE /identity/v3/users/4f1a57c46e594a539019605221e02227 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:21.718563 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d33998-21a4-4b42-b16b-56217b92f2b8 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:21.719055 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d33998-21a4-4b42-b16b-56217b92f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:21.719416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d33998-21a4-4b42-b16b-56217b92f2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:21.739800 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf24847-d846-4f6e-8ef0-da4a26a7d36b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:21.741452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf24847-d846-4f6e-8ef0-da4a26a7d36b service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:21.766145 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b9d33998-21a4-4b42-b16b-56217b92f2b8 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:21.767256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b9d33998-21a4-4b42-b16b-56217b92f2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:21.769863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 825/1648] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:21 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:21.914142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 824/1649] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:22.057681 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf24847-d846-4f6e-8ef0-da4a26a7d36b service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:22.061137 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4bf24847-d846-4f6e-8ef0-da4a26a7d36b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:22.188831 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf24847-d846-4f6e-8ef0-da4a26a7d36b service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:22.284597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff2d5-8792-4c5f-afeb-848f8f37ba52 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:22.290601 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff2d5-8792-4c5f-afeb-848f8f37ba52 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:22.290601 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff2d5-8792-4c5f-afeb-848f8f37ba52 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:22.292069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 825/1650] 10.222.0.62 () {54 vars in 912 bytes} [Wed Apr 6 11:08:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:08:22.297006 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab173347-c39c-4935-9c1d-144abda2938a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:22.297415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab173347-c39c-4935-9c1d-144abda2938a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:22.297611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab173347-c39c-4935-9c1d-144abda2938a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:22.300112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6812ca-9870-4bc6-845d-51eab40bce77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:22.300787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6812ca-9870-4bc6-845d-51eab40bce77 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:22.301088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6812ca-9870-4bc6-845d-51eab40bce77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:22.301413 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6812ca-9870-4bc6-845d-51eab40bce77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:22.330015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6812ca-9870-4bc6-845d-51eab40bce77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:22.331477 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6812ca-9870-4bc6-845d-51eab40bce77 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:22.353214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 826/1651] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:22.399034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ab173347-c39c-4935-9c1d-144abda2938a None None] MFA Rules not processed for user `e078c6efaf054f7489f7164fdafce714`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:22.400465 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ab173347-c39c-4935-9c1d-144abda2938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:22.410353 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 826/1652] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:08:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:22.427211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6812ca-9870-4bc6-845d-51eab40bce77 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:22.428837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ed6812ca-9870-4bc6-845d-51eab40bce77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:22.446315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6812ca-9870-4bc6-845d-51eab40bce77 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:22.458627 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ceba3a-e5fd-4b55-a145-53e6ec950afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:22.459300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceba3a-e5fd-4b55-a145-53e6ec950afd service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:22.459865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceba3a-e5fd-4b55-a145-53e6ec950afd service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:22.459985 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceba3a-e5fd-4b55-a145-53e6ec950afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:22.477504 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ceba3a-e5fd-4b55-a145-53e6ec950afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:22.479070 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ceba3a-e5fd-4b55-a145-53e6ec950afd service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:22.505283 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 827/1653] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:23.530745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1b0c3-10e5-49b1-9431-eae29aa952b3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:23.531585 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1b0c3-10e5-49b1-9431-eae29aa952b3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:23.532022 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1b0c3-10e5-49b1-9431-eae29aa952b3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:23.533821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 827/1654] 10.222.0.62 () {54 vars in 960 bytes} [Wed Apr 6 11:08:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:08:23.540146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284fd05-aef6-4907-8389-cef411cc1818 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:23.540610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284fd05-aef6-4907-8389-cef411cc1818 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:23.540610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284fd05-aef6-4907-8389-cef411cc1818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:23.613286 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c284fd05-aef6-4907-8389-cef411cc1818 None None] MFA Rules not processed for user `1bd095449a5b44c6b1c9aca712edc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:23.616680 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c284fd05-aef6-4907-8389-cef411cc1818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:23.747054 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 828/1655] 10.222.0.62 () {58 vars in 1057 bytes} [Wed Apr 6 11:08:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:23.757966 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1b0c3-10e5-49b1-9431-eae29aa952b3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:23.781886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1b0c3-10e5-49b1-9431-eae29aa952b3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:23.825945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56258310-f20b-4f3e-b2b6-1348b84ece84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd095449a5b44c6b1c9aca712edc11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:23.825945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258310-f20b-4f3e-b2b6-1348b84ece84 service placement] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:23.825945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258310-f20b-4f3e-b2b6-1348b84ece84 service placement] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:23.825945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258310-f20b-4f3e-b2b6-1348b84ece84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:23.826381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-56258310-f20b-4f3e-b2b6-1348b84ece84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:23.838352 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56258310-f20b-4f3e-b2b6-1348b84ece84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:23.840269 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56258310-f20b-4f3e-b2b6-1348b84ece84 service placement] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:23.853223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 828/1656] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:24.093532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284fd05-aef6-4907-8389-cef411cc1818 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:24.095532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c284fd05-aef6-4907-8389-cef411cc1818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:24.136337 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284fd05-aef6-4907-8389-cef411cc1818 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:24.159585 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:24.159585 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:24.159871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:24.160043 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] PATH_INFO: `/v3/projects/a0dc163b51fb4e55b0618099d5459785` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:24.169730 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0dc163b51fb4e55b0618099d5459785)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:24.174788 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:24.414542 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0dc163b51fb4e55b0618099d5459785', 'request_id': 'req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:24.526314 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0dc163b51fb4e55b0618099d5459785', 'request_id': 'req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:24.534908 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0dc163b51fb4e55b0618099d5459785', 'request_id': 'req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:24.574932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] The token cache is being invalidate because project a0dc163b51fb4e55b0618099d5459785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:08:24.576467 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:24.577607 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:24.582820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 829/1657] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:08:24 2022] DELETE /identity/v3/projects/a0dc163b51fb4e55b0618099d5459785 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:24.584565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56258310-f20b-4f3e-b2b6-1348b84ece84 service placement] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:24.596557 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56258310-f20b-4f3e-b2b6-1348b84ece84 service placement] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:24.688480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b7cfc-d1c9-4a49-b4ca-ddb26bd148b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:24.689466 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b7cfc-d1c9-4a49-b4ca-ddb26bd148b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:24.690154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b7cfc-d1c9-4a49-b4ca-ddb26bd148b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:24.690780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b7cfc-d1c9-4a49-b4ca-ddb26bd148b5 admin admin] PATH_INFO: `/v3/users/2ab38757ed4e43deace01860d4de23bb` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:24.693834 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b7cfc-d1c9-4a49-b4ca-ddb26bd148b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab38757ed4e43deace01860d4de23bb)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:24.697004 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b7cfc-d1c9-4a49-b4ca-ddb26bd148b5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:25.114518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:25.116197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:25.139871 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d45b7cfc-d1c9-4a49-b4ca-ddb26bd148b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab38757ed4e43deace01860d4de23bb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:25.140810 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d45b7cfc-d1c9-4a49-b4ca-ddb26bd148b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab38757ed4e43deace01860d4de23bb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:25.141584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d45b7cfc-d1c9-4a49-b4ca-ddb26bd148b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab38757ed4e43deace01860d4de23bb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:25.168198 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae4f3-8d4a-4b80-a2dc-f376a80cf3dd admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:25.199542 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:25.201249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:25.201713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:25.202093 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] PATH_INFO: `/v3/users/f308c93294464e0789d62d64881d59ac` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:25.203877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f308c93294464e0789d62d64881d59ac)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:25.205955 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:08:25.205955 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Apr 06 11:08:25.205955 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: Apr 06 11:08:25.208512 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:25.243443 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d45b7cfc-d1c9-4a49-b4ca-ddb26bd148b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab38757ed4e43deace01860d4de23bb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:25.262514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d45b7cfc-d1c9-4a49-b4ca-ddb26bd148b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab38757ed4e43deace01860d4de23bb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:25.347325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 829/1658] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:08:24 2022] DELETE /identity/v3/users/2ab38757ed4e43deace01860d4de23bb => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:25.520059 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f308c93294464e0789d62d64881d59ac'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:25.530115 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f308c93294464e0789d62d64881d59ac'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:25.531195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f308c93294464e0789d62d64881d59ac'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:25.585403 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f308c93294464e0789d62d64881d59ac'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:25.626417 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f308c93294464e0789d62d64881d59ac'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:25.736258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 830/1659] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:08:25 2022] DELETE /identity/v3/users/f308c93294464e0789d62d64881d59ac => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:08:25.741561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd152e-0f84-4372-be26-4671d8df26e8 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:25.742077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd152e-0f84-4372-be26-4671d8df26e8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:25.742142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd152e-0f84-4372-be26-4671d8df26e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:25.791001 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-99bd152e-0f84-4372-be26-4671d8df26e8 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:25.792592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-99bd152e-0f84-4372-be26-4671d8df26e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:25.877020 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 830/1660] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:25.899427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:25.901212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:26.019427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2fb02-c6c7-4d57-b42c-e9a508f12342 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:26.039217 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2399f2d-919e-4c42-b56a-86706000e296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:26.039910 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2399f2d-919e-4c42-b56a-86706000e296 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:26.040199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2399f2d-919e-4c42-b56a-86706000e296 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:26.044509 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2399f2d-919e-4c42-b56a-86706000e296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:26.076680 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2399f2d-919e-4c42-b56a-86706000e296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:26.083442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2399f2d-919e-4c42-b56a-86706000e296 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:26.112593 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 831/1661] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:26.970974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd152e-0f84-4372-be26-4671d8df26e8 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:26.973040 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-99bd152e-0f84-4372-be26-4671d8df26e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:26.995485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd152e-0f84-4372-be26-4671d8df26e8 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:27.004257 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2399f2d-919e-4c42-b56a-86706000e296 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:27.012024 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c2399f2d-919e-4c42-b56a-86706000e296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:27.023282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85952711-acfa-4f67-8296-f78d1e542afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:27.025797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85952711-acfa-4f67-8296-f78d1e542afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:27.029502 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85952711-acfa-4f67-8296-f78d1e542afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:27.029724 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2399f2d-919e-4c42-b56a-86706000e296 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:27.029942 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85952711-acfa-4f67-8296-f78d1e542afa admin admin] PATH_INFO: `/v3/projects/77cc9b40d9d24168b1b12ba4f97b7e2e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:27.031548 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85952711-acfa-4f67-8296-f78d1e542afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=77cc9b40d9d24168b1b12ba4f97b7e2e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:27.035465 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-85952711-acfa-4f67-8296-f78d1e542afa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 11:08:27.035465 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: warnings.warn(msg) Apr 06 11:08:27.035465 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: Apr 06 11:08:27.036785 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85952711-acfa-4f67-8296-f78d1e542afa admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:27.037216 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd181f98-42d3-4be8-a8c9-c416f931dac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:27.038492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd181f98-42d3-4be8-a8c9-c416f931dac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:27.038948 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd181f98-42d3-4be8-a8c9-c416f931dac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:27.039388 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd181f98-42d3-4be8-a8c9-c416f931dac5 admin admin] PATH_INFO: `/v3/projects/f7c5eec49d1d468b94b23ba7c41a4ac5` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:27.041335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd181f98-42d3-4be8-a8c9-c416f931dac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c5eec49d1d468b94b23ba7c41a4ac5)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:27.044327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd181f98-42d3-4be8-a8c9-c416f931dac5 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:27.215071 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-dd181f98-42d3-4be8-a8c9-c416f931dac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c5eec49d1d468b94b23ba7c41a4ac5', 'request_id': 'req-dd181f98-42d3-4be8-a8c9-c416f931dac5'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:27.253805 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-85952711-acfa-4f67-8296-f78d1e542afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77cc9b40d9d24168b1b12ba4f97b7e2e', 'request_id': 'req-85952711-acfa-4f67-8296-f78d1e542afa'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:27.287224 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-85952711-acfa-4f67-8296-f78d1e542afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77cc9b40d9d24168b1b12ba4f97b7e2e', 'request_id': 'req-85952711-acfa-4f67-8296-f78d1e542afa'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:27.290930 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-dd181f98-42d3-4be8-a8c9-c416f931dac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c5eec49d1d468b94b23ba7c41a4ac5', 'request_id': 'req-dd181f98-42d3-4be8-a8c9-c416f931dac5'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:27.300047 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-dd181f98-42d3-4be8-a8c9-c416f931dac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c5eec49d1d468b94b23ba7c41a4ac5', 'request_id': 'req-dd181f98-42d3-4be8-a8c9-c416f931dac5'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:27.304009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-85952711-acfa-4f67-8296-f78d1e542afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77cc9b40d9d24168b1b12ba4f97b7e2e', 'request_id': 'req-85952711-acfa-4f67-8296-f78d1e542afa'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:27.321694 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-dd181f98-42d3-4be8-a8c9-c416f931dac5 admin admin] The token cache is being invalidate because project f7c5eec49d1d468b94b23ba7c41a4ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:08:27.322107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-dd181f98-42d3-4be8-a8c9-c416f931dac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:27.324180 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-dd181f98-42d3-4be8-a8c9-c416f931dac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:27.329246 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 832/1662] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:08:27 2022] DELETE /identity/v3/projects/f7c5eec49d1d468b94b23ba7c41a4ac5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:08:27.341348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f23cf5-47e3-4662-b849-38ac3e0bf3cb None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:27.341945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f23cf5-47e3-4662-b849-38ac3e0bf3cb None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:27.343064 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f23cf5-47e3-4662-b849-38ac3e0bf3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:27.374694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-85952711-acfa-4f67-8296-f78d1e542afa admin admin] The token cache is being invalidate because project 77cc9b40d9d24168b1b12ba4f97b7e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:08:27.374901 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-85952711-acfa-4f67-8296-f78d1e542afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:27.375713 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-85952711-acfa-4f67-8296-f78d1e542afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:27.377767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 831/1663] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:08:26 2022] DELETE /identity/v3/projects/77cc9b40d9d24168b1b12ba4f97b7e2e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:27.390189 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d62d3-32d6-4276-886f-995ae4853694 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:27.390786 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d62d3-32d6-4276-886f-995ae4853694 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:27.391293 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d62d3-32d6-4276-886f-995ae4853694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:27.401316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e9f23cf5-47e3-4662-b849-38ac3e0bf3cb None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:27.403919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e9f23cf5-47e3-4662-b849-38ac3e0bf3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:27.430694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2a8d62d3-32d6-4276-886f-995ae4853694 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:27.434167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2a8d62d3-32d6-4276-886f-995ae4853694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:27.565104 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 832/1664] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:27.573634 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586a26a-d06a-4c67-9e81-30b4d92bb249 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:27.574204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586a26a-d06a-4c67-9e81-30b4d92bb249 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:27.574637 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586a26a-d06a-4c67-9e81-30b4d92bb249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:27.578717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 833/1665] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:27.583281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28764d4d-af0c-49a2-a07c-96024db0d341 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:27.583874 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28764d4d-af0c-49a2-a07c-96024db0d341 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:27.584341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28764d4d-af0c-49a2-a07c-96024db0d341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:27.622408 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2586a26a-d06a-4c67-9e81-30b4d92bb249 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:27.623767 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-28764d4d-af0c-49a2-a07c-96024db0d341 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:27.625197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-28764d4d-af0c-49a2-a07c-96024db0d341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:27.625299 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2586a26a-d06a-4c67-9e81-30b4d92bb249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:27.649598 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 834/1666] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:27.650835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28764d4d-af0c-49a2-a07c-96024db0d341 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:27.655054 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 833/1667] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:27.660452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586a26a-d06a-4c67-9e81-30b4d92bb249 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:27.670221 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28764d4d-af0c-49a2-a07c-96024db0d341 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:27.683504 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fde5e-1049-4fe6-9a25-3c86762aee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:27.684228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fde5e-1049-4fe6-9a25-3c86762aee72 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:27.684513 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fde5e-1049-4fe6-9a25-3c86762aee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:27.684786 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fde5e-1049-4fe6-9a25-3c86762aee72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:27.685692 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fde5e-1049-4fe6-9a25-3c86762aee72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:27.690438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fde5e-1049-4fe6-9a25-3c86762aee72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:27.690438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fde5e-1049-4fe6-9a25-3c86762aee72 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:27.690600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586a26a-d06a-4c67-9e81-30b4d92bb249 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:27.703821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30f19d-475a-43bb-aaf8-203c508da770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:27.704507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30f19d-475a-43bb-aaf8-203c508da770 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:27.706363 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30f19d-475a-43bb-aaf8-203c508da770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:27.708185 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30f19d-475a-43bb-aaf8-203c508da770 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:27.712438 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30f19d-475a-43bb-aaf8-203c508da770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:27.713088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30f19d-475a-43bb-aaf8-203c508da770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:27.719905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30f19d-475a-43bb-aaf8-203c508da770 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:27.729550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 835/1668] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:08:27.736444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fde5e-1049-4fe6-9a25-3c86762aee72 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:27.748654 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 834/1669] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:08:27.752744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30f19d-475a-43bb-aaf8-203c508da770 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:27.758362 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fde5e-1049-4fe6-9a25-3c86762aee72 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:27.772956 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f60d2-60b9-47be-8ba3-be5e9688ea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:27.773695 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f60d2-60b9-47be-8ba3-be5e9688ea5c admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:27.773986 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f60d2-60b9-47be-8ba3-be5e9688ea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:27.774258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f60d2-60b9-47be-8ba3-be5e9688ea5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:27.775017 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f60d2-60b9-47be-8ba3-be5e9688ea5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:27.775484 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30f19d-475a-43bb-aaf8-203c508da770 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:27.776993 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f60d2-60b9-47be-8ba3-be5e9688ea5c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:27.787509 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4abd84-5e4a-42f2-9fc0-6bab73f18c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:27.788493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4abd84-5e4a-42f2-9fc0-6bab73f18c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:27.789024 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4abd84-5e4a-42f2-9fc0-6bab73f18c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:27.789518 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4abd84-5e4a-42f2-9fc0-6bab73f18c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:27.790615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4abd84-5e4a-42f2-9fc0-6bab73f18c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:27.792772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4abd84-5e4a-42f2-9fc0-6bab73f18c10 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:27.906190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 836/1670] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:27 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:08:27.910432 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f60d2-60b9-47be-8ba3-be5e9688ea5c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:27.936677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 835/1671] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:27 2022] POST /identity/v3/projects => generated 401 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:08:27.940886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4abd84-5e4a-42f2-9fc0-6bab73f18c10 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:28.030374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f60d2-60b9-47be-8ba3-be5e9688ea5c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:28.059398 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4abd84-5e4a-42f2-9fc0-6bab73f18c10 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:28.068169 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b924b41-9a55-4a1f-b46a-79ed8b609ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:28.069152 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b924b41-9a55-4a1f-b46a-79ed8b609ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:28.069777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b924b41-9a55-4a1f-b46a-79ed8b609ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:28.070230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b924b41-9a55-4a1f-b46a-79ed8b609ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:28.071307 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b924b41-9a55-4a1f-b46a-79ed8b609ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:28.076921 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b924b41-9a55-4a1f-b46a-79ed8b609ed0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:28.114311 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24cfcf-8759-42a6-8bad-77e2fce203e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:28.115163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24cfcf-8759-42a6-8bad-77e2fce203e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:28.115545 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24cfcf-8759-42a6-8bad-77e2fce203e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:28.115911 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24cfcf-8759-42a6-8bad-77e2fce203e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:28.116714 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24cfcf-8759-42a6-8bad-77e2fce203e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:28.118846 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24cfcf-8759-42a6-8bad-77e2fce203e6 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:28.194505 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 836/1672] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:27 2022] POST /identity/v3/users => generated 301 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:08:28.199125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b924b41-9a55-4a1f-b46a-79ed8b609ed0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:28.212987 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b924b41-9a55-4a1f-b46a-79ed8b609ed0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:28.221413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dad20e-0d13-4794-97ea-5cf78d0544f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:28.222155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad20e-0d13-4794-97ea-5cf78d0544f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:28.223832 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad20e-0d13-4794-97ea-5cf78d0544f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:28.223832 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad20e-0d13-4794-97ea-5cf78d0544f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:28.225484 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dad20e-0d13-4794-97ea-5cf78d0544f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:28.229961 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dad20e-0d13-4794-97ea-5cf78d0544f5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:28.252624 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 837/1673] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:08:28.254134 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dad20e-0d13-4794-97ea-5cf78d0544f5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:28.256392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 837/1674] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:27 2022] POST /identity/v3/users => generated 283 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:28.260320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24cfcf-8759-42a6-8bad-77e2fce203e6 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:28.272238 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dad20e-0d13-4794-97ea-5cf78d0544f5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:28.278192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde3a89-b0ae-4120-82c6-5a19506c22fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:28.279595 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde3a89-b0ae-4120-82c6-5a19506c22fa admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:28.279595 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde3a89-b0ae-4120-82c6-5a19506c22fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:28.279595 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde3a89-b0ae-4120-82c6-5a19506c22fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:28.280398 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde3a89-b0ae-4120-82c6-5a19506c22fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:28.281966 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24cfcf-8759-42a6-8bad-77e2fce203e6 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:28.282537 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde3a89-b0ae-4120-82c6-5a19506c22fa admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:28.300345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb04479-79ae-4cef-8f78-213f60e19e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:28.301698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb04479-79ae-4cef-8f78-213f60e19e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:28.302127 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb04479-79ae-4cef-8f78-213f60e19e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:28.302572 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb04479-79ae-4cef-8f78-213f60e19e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:28.303452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb04479-79ae-4cef-8f78-213f60e19e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:28.305441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb04479-79ae-4cef-8f78-213f60e19e68 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:28.311822 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 838/1675] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:28.316132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde3a89-b0ae-4120-82c6-5a19506c22fa admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:28.331134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 838/1676] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:08:28.336247 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb04479-79ae-4cef-8f78-213f60e19e68 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:28.340477 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde3a89-b0ae-4120-82c6-5a19506c22fa admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:28.354030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7124945-2dcb-4c41-8c8b-3cc5b39c8be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:28.354384 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb04479-79ae-4cef-8f78-213f60e19e68 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:28.354920 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7124945-2dcb-4c41-8c8b-3cc5b39c8be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:28.355203 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7124945-2dcb-4c41-8c8b-3cc5b39c8be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:28.355480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7124945-2dcb-4c41-8c8b-3cc5b39c8be9 admin admin] PATH_INFO: `/v3/projects/9555cbc3fde44d82ba2ead5f06e228da/users/d613ddd37b5241ea9cff6c1208d5df66/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:28.373293 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ba4f1-bee7-4f22-bb8f-614600c2c229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:28.375949 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ba4f1-bee7-4f22-bb8f-614600c2c229 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:28.378052 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ba4f1-bee7-4f22-bb8f-614600c2c229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:28.378447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ba4f1-bee7-4f22-bb8f-614600c2c229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:28.382126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ba4f1-bee7-4f22-bb8f-614600c2c229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:28.384104 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ba4f1-bee7-4f22-bb8f-614600c2c229 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:28.402150 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7124945-2dcb-4c41-8c8b-3cc5b39c8be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9555cbc3fde44d82ba2ead5f06e228da, user_id=d613ddd37b5241ea9cff6c1208d5df66, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:28.404837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7124945-2dcb-4c41-8c8b-3cc5b39c8be9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:28.412322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 839/1677] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:28.413464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ba4f1-bee7-4f22-bb8f-614600c2c229 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:28.432933 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ba4f1-bee7-4f22-bb8f-614600c2c229 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:28.438528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64028ea-853a-4276-896f-7c307bc008fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:28.440160 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64028ea-853a-4276-896f-7c307bc008fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:28.440452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64028ea-853a-4276-896f-7c307bc008fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:28.440737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64028ea-853a-4276-896f-7c307bc008fc admin admin] PATH_INFO: `/v3/projects/b52d484a15ca45559bff66140efa410b/users/66b82a8cc61a430fbdb40a2253d48c2f/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:28.475243 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64028ea-853a-4276-896f-7c307bc008fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52d484a15ca45559bff66140efa410b, user_id=66b82a8cc61a430fbdb40a2253d48c2f, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:28.481464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64028ea-853a-4276-896f-7c307bc008fc admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:28.485516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 839/1678] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:28 2022] PUT /identity/v3/projects/9555cbc3fde44d82ba2ead5f06e228da/users/d613ddd37b5241ea9cff6c1208d5df66/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:28.487124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35ecdb-1a17-474f-828c-26fbb4658736 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:28.487414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35ecdb-1a17-474f-828c-26fbb4658736 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:28.488073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35ecdb-1a17-474f-828c-26fbb4658736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:28.536012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ae35ecdb-1a17-474f-828c-26fbb4658736 None None] MFA Rules not processed for user `d613ddd37b5241ea9cff6c1208d5df66`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:28.537431 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ae35ecdb-1a17-474f-828c-26fbb4658736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:28.568856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 840/1679] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:28 2022] PUT /identity/v3/projects/b52d484a15ca45559bff66140efa410b/users/66b82a8cc61a430fbdb40a2253d48c2f/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:28.584078 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f5d0d-b913-45d1-b89d-d85090109228 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:28.584584 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f5d0d-b913-45d1-b89d-d85090109228 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:28.585156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f5d0d-b913-45d1-b89d-d85090109228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:28.675089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-822f5d0d-b913-45d1-b89d-d85090109228 None None] MFA Rules not processed for user `66b82a8cc61a430fbdb40a2253d48c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:28.681919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-822f5d0d-b913-45d1-b89d-d85090109228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:28.725111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 840/1680] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:28.730283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35ecdb-1a17-474f-828c-26fbb4658736 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:28.817646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 841/1681] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:28.818870 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f5d0d-b913-45d1-b89d-d85090109228 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:28.878157 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35ecdb-1a17-474f-828c-26fbb4658736 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:28.981421 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f5d0d-b913-45d1-b89d-d85090109228 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:28.991442 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e023a-6a38-448c-93da-d782c9f7bf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:28.992516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e023a-6a38-448c-93da-d782c9f7bf63 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:28.992998 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e023a-6a38-448c-93da-d782c9f7bf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:28.994148 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b7e70-964a-4095-b87c-dad534b5b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:28.994837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b7e70-964a-4095-b87c-dad534b5b04b admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:28.995923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b7e70-964a-4095-b87c-dad534b5b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:28.995923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b7e70-964a-4095-b87c-dad534b5b04b admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:28.996088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b7e70-964a-4095-b87c-dad534b5b04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:29.006287 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b7e70-964a-4095-b87c-dad534b5b04b admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:29.012022 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e023a-6a38-448c-93da-d782c9f7bf63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:29.013224 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e023a-6a38-448c-93da-d782c9f7bf63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:29.015384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e023a-6a38-448c-93da-d782c9f7bf63 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:29.184351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 842/1682] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:28 2022] POST /identity/v3/projects => generated 367 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:08:29.185732 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2b8e3-2ae3-46a9-982d-2f44e8eadf87 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:29.186030 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2b8e3-2ae3-46a9-982d-2f44e8eadf87 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:29.186311 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2b8e3-2ae3-46a9-982d-2f44e8eadf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:29.202572 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 841/1683] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:28 2022] POST /identity/v3/projects => generated 399 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:08:29.204830 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e023a-6a38-448c-93da-d782c9f7bf63 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:29.253670 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-57d2b8e3-2ae3-46a9-982d-2f44e8eadf87 None None] MFA Rules not processed for user `145dbd68096f410d81b61b4c9f70ca3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:29.254863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-57d2b8e3-2ae3-46a9-982d-2f44e8eadf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:29.351190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e023a-6a38-448c-93da-d782c9f7bf63 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:29.360624 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9f295-b617-4aec-afee-2add2ba3022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:29.364383 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9f295-b617-4aec-afee-2add2ba3022d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:29.364951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9f295-b617-4aec-afee-2add2ba3022d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:29.366419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9f295-b617-4aec-afee-2add2ba3022d admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:29.367457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9f295-b617-4aec-afee-2add2ba3022d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:29.368846 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 843/1684] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:29.369802 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2b8e3-2ae3-46a9-982d-2f44e8eadf87 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:29.370848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9f295-b617-4aec-afee-2add2ba3022d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:29.386521 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2b8e3-2ae3-46a9-982d-2f44e8eadf87 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:29.399557 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cc3f2-4303-4485-a564-e748129ddbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:29.401081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cc3f2-4303-4485-a564-e748129ddbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:29.402147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cc3f2-4303-4485-a564-e748129ddbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:29.402402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cc3f2-4303-4485-a564-e748129ddbb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:29.404114 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2cc3f2-4303-4485-a564-e748129ddbb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:29.406128 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2cc3f2-4303-4485-a564-e748129ddbb7 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:29.488495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 842/1685] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:29 2022] POST /identity/v3/users => generated 290 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:29.489899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9f295-b617-4aec-afee-2add2ba3022d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:29.492455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f0f9f295-b617-4aec-afee-2add2ba3022d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:29.497601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 844/1686] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:29 2022] POST /identity/v3/users => generated 306 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:29.498735 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cc3f2-4303-4485-a564-e748129ddbb7 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:29.518816 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cc3f2-4303-4485-a564-e748129ddbb7 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:29.536077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc1799-4d4c-4d7c-918e-6e58faf721ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:29.537397 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc1799-4d4c-4d7c-918e-6e58faf721ce admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:29.537506 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc1799-4d4c-4d7c-918e-6e58faf721ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:29.537699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc1799-4d4c-4d7c-918e-6e58faf721ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:29.538449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc1799-4d4c-4d7c-918e-6e58faf721ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:29.540075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc1799-4d4c-4d7c-918e-6e58faf721ce admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:29.569208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 845/1687] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:29.569208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc1799-4d4c-4d7c-918e-6e58faf721ce admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:29.594600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc1799-4d4c-4d7c-918e-6e58faf721ce admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:29.604148 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0953c-da65-4afa-a3fd-a3bafc272acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:29.604840 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0953c-da65-4afa-a3fd-a3bafc272acf admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:29.605162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0953c-da65-4afa-a3fd-a3bafc272acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:29.605441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0953c-da65-4afa-a3fd-a3bafc272acf admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:29.606237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0953c-da65-4afa-a3fd-a3bafc272acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:29.610048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0953c-da65-4afa-a3fd-a3bafc272acf admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:29.638145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 846/1688] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:29.638584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9f295-b617-4aec-afee-2add2ba3022d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:29.639035 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0953c-da65-4afa-a3fd-a3bafc272acf admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:29.647174 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8c7f0-aa34-4782-8dc4-333ab9ba88ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:29.651780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8c7f0-aa34-4782-8dc4-333ab9ba88ae service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:29.651780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8c7f0-aa34-4782-8dc4-333ab9ba88ae service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:29.651780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8c7f0-aa34-4782-8dc4-333ab9ba88ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:29.660997 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8c7f0-aa34-4782-8dc4-333ab9ba88ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:29.663003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8c7f0-aa34-4782-8dc4-333ab9ba88ae service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:29.663120 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0953c-da65-4afa-a3fd-a3bafc272acf admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:29.677467 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 843/1689] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:29.677815 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f82f-4511-48d2-b53e-a8efd74e81b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:29.678615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8c7f0-aa34-4782-8dc4-333ab9ba88ae service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:29.678720 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f82f-4511-48d2-b53e-a8efd74e81b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:29.678993 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f82f-4511-48d2-b53e-a8efd74e81b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:29.680919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f82f-4511-48d2-b53e-a8efd74e81b1 admin admin] PATH_INFO: `/v3/projects/5b2f63e8394c4ae7b8627c550fe27a89/users/81be1c08e8d34a6c9e2459fc30c1fe66/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:29.690909 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8c7f0-aa34-4782-8dc4-333ab9ba88ae service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:29.698618 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b36a3-f037-4d0f-b485-12eecb6ddbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:29.710552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498f82f-4511-48d2-b53e-a8efd74e81b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2f63e8394c4ae7b8627c550fe27a89, user_id=81be1c08e8d34a6c9e2459fc30c1fe66, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:29.713176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b36a3-f037-4d0f-b485-12eecb6ddbf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:29.713288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498f82f-4511-48d2-b53e-a8efd74e81b1 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:29.713480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b36a3-f037-4d0f-b485-12eecb6ddbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:29.714730 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b36a3-f037-4d0f-b485-12eecb6ddbf1 admin admin] PATH_INFO: `/v3/projects/3bd6b2408be545af977f6b913d730af8/users/7af7419fe43747bea1372b4b313363f5/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:29.793522 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b36a3-f037-4d0f-b485-12eecb6ddbf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd6b2408be545af977f6b913d730af8, user_id=7af7419fe43747bea1372b4b313363f5, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:29.801735 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 847/1690] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:29 2022] PUT /identity/v3/projects/5b2f63e8394c4ae7b8627c550fe27a89/users/81be1c08e8d34a6c9e2459fc30c1fe66/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:29.805604 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f82f-4511-48d2-b53e-a8efd74e81b1 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:29.810034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b36a3-f037-4d0f-b485-12eecb6ddbf1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:29.908135 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 844/1691] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:29 2022] PUT /identity/v3/projects/3bd6b2408be545af977f6b913d730af8/users/7af7419fe43747bea1372b4b313363f5/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:29.912110 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b36a3-f037-4d0f-b485-12eecb6ddbf1 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:29.978272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f82f-4511-48d2-b53e-a8efd74e81b1 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:30.062208 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b36a3-f037-4d0f-b485-12eecb6ddbf1 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:30.090879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788710aa-52e5-4afc-b17e-4849f2fa9b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:30.090879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788710aa-52e5-4afc-b17e-4849f2fa9b1e admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:30.090879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788710aa-52e5-4afc-b17e-4849f2fa9b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:30.091322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788710aa-52e5-4afc-b17e-4849f2fa9b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:30.092191 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788710aa-52e5-4afc-b17e-4849f2fa9b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:30.094450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59615c-1b9a-4a41-b9ef-abe2244fbaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:30.094599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788710aa-52e5-4afc-b17e-4849f2fa9b1e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:30.096359 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59615c-1b9a-4a41-b9ef-abe2244fbaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:30.096764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59615c-1b9a-4a41-b9ef-abe2244fbaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:30.096930 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59615c-1b9a-4a41-b9ef-abe2244fbaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:30.100272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59615c-1b9a-4a41-b9ef-abe2244fbaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:30.104823 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59615c-1b9a-4a41-b9ef-abe2244fbaf3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:30.134793 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 845/1692] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:08:30.135721 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59615c-1b9a-4a41-b9ef-abe2244fbaf3 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:30.140527 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 848/1693] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:30.141908 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788710aa-52e5-4afc-b17e-4849f2fa9b1e admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:30.153439 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788710aa-52e5-4afc-b17e-4849f2fa9b1e admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:30.161636 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347be3a-fe5a-4cb0-9da7-c8b970562812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:30.162209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59615c-1b9a-4a41-b9ef-abe2244fbaf3 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:30.163135 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347be3a-fe5a-4cb0-9da7-c8b970562812 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:30.163638 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347be3a-fe5a-4cb0-9da7-c8b970562812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:30.164108 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347be3a-fe5a-4cb0-9da7-c8b970562812 admin admin] PATH_INFO: `/v3/projects/3bd6b2408be545af977f6b913d730af8/users/7af7419fe43747bea1372b4b313363f5/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:30.166601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347be3a-fe5a-4cb0-9da7-c8b970562812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd6b2408be545af977f6b913d730af8, user_id=7af7419fe43747bea1372b4b313363f5, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:30.170594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347be3a-fe5a-4cb0-9da7-c8b970562812 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:30.181766 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57522be9-f1ed-4275-822e-565365cd4c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:30.182684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57522be9-f1ed-4275-822e-565365cd4c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:30.182968 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57522be9-f1ed-4275-822e-565365cd4c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:30.183246 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57522be9-f1ed-4275-822e-565365cd4c49 admin admin] PATH_INFO: `/v3/projects/5b2f63e8394c4ae7b8627c550fe27a89/users/81be1c08e8d34a6c9e2459fc30c1fe66/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:30.196895 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57522be9-f1ed-4275-822e-565365cd4c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2f63e8394c4ae7b8627c550fe27a89, user_id=81be1c08e8d34a6c9e2459fc30c1fe66, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:30.203200 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 849/1694] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:30 2022] PUT /identity/v3/projects/3bd6b2408be545af977f6b913d730af8/users/7af7419fe43747bea1372b4b313363f5/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:30.211114 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c276-b3f3-420d-9706-81e73fcadaad None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:30.211239 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57522be9-f1ed-4275-822e-565365cd4c49 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:30.211639 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c276-b3f3-420d-9706-81e73fcadaad None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:30.211639 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c276-b3f3-420d-9706-81e73fcadaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:30.241693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 846/1695] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:30 2022] PUT /identity/v3/projects/5b2f63e8394c4ae7b8627c550fe27a89/users/81be1c08e8d34a6c9e2459fc30c1fe66/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:30.255757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e1cfe-97e6-4416-9a92-42597ec78ffa None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:30.255953 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e1cfe-97e6-4416-9a92-42597ec78ffa None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:30.256154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e1cfe-97e6-4416-9a92-42597ec78ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:30.259215 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-3351c276-b3f3-420d-9706-81e73fcadaad None None] MFA Rules not processed for user `7af7419fe43747bea1372b4b313363f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:30.261228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3351c276-b3f3-420d-9706-81e73fcadaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:30.327017 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b80e1cfe-97e6-4416-9a92-42597ec78ffa None None] MFA Rules not processed for user `81be1c08e8d34a6c9e2459fc30c1fe66`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:30.328669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b80e1cfe-97e6-4416-9a92-42597ec78ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:30.418161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 850/1696] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:30 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:30.437915 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351c276-b3f3-420d-9706-81e73fcadaad None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:30.439455 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3351c276-b3f3-420d-9706-81e73fcadaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:30.449788 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 847/1697] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:08:30.457928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e1cfe-97e6-4416-9a92-42597ec78ffa None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:30.463099 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b80e1cfe-97e6-4416-9a92-42597ec78ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:30.524147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351c276-b3f3-420d-9706-81e73fcadaad None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:30.534183 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b08af6-b01f-4379-ad61-2044ad742b3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:30.536794 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08af6-b01f-4379-ad61-2044ad742b3b service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:30.537340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08af6-b01f-4379-ad61-2044ad742b3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:30.537732 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08af6-b01f-4379-ad61-2044ad742b3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:30.570267 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b08af6-b01f-4379-ad61-2044ad742b3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:30.578428 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b08af6-b01f-4379-ad61-2044ad742b3b service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:30.589124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e1cfe-97e6-4416-9a92-42597ec78ffa None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:30.607030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f919c19-1f84-49b5-9029-e6cef9fe071a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:30.607030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919c19-1f84-49b5-9029-e6cef9fe071a service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:30.607030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919c19-1f84-49b5-9029-e6cef9fe071a service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:30.607030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919c19-1f84-49b5-9029-e6cef9fe071a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:30.626042 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 851/1698] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:30 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:08:30.644194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f919c19-1f84-49b5-9029-e6cef9fe071a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:30.646265 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f919c19-1f84-49b5-9029-e6cef9fe071a service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:30.687401 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 848/1699] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:08:30.882029 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b08af6-b01f-4379-ad61-2044ad742b3b service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:30.894556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b08af6-b01f-4379-ad61-2044ad742b3b service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:30.908058 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785f4ac-64f4-4647-b2f6-f00cbf5405fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:30.908715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785f4ac-64f4-4647-b2f6-f00cbf5405fa service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:30.909228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785f4ac-64f4-4647-b2f6-f00cbf5405fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:30.910132 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785f4ac-64f4-4647-b2f6-f00cbf5405fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:31.080873 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785f4ac-64f4-4647-b2f6-f00cbf5405fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:31.083291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785f4ac-64f4-4647-b2f6-f00cbf5405fa service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:31.117960 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 852/1700] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:31.203628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f919c19-1f84-49b5-9029-e6cef9fe071a service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:31.217375 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f919c19-1f84-49b5-9029-e6cef9fe071a service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:31.235632 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fc577-658f-4b6f-a596-a8e6539db9af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:31.236425 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fc577-658f-4b6f-a596-a8e6539db9af service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:31.240203 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fc577-658f-4b6f-a596-a8e6539db9af service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:31.242089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fc577-658f-4b6f-a596-a8e6539db9af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:31.410136 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fc577-658f-4b6f-a596-a8e6539db9af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:31.416733 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fc577-658f-4b6f-a596-a8e6539db9af service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:31.456123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 849/1701] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:31.788043 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f15c4-5ff2-4ccf-95fe-024f5eac6ca9 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:31.789483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f15c4-5ff2-4ccf-95fe-024f5eac6ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:31.791506 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f15c4-5ff2-4ccf-95fe-024f5eac6ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:31.844698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-732f15c4-5ff2-4ccf-95fe-024f5eac6ca9 None None] MFA Rules not processed for user `f506156c62014060ab9004b7abbb2369`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:31.846631 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-732f15c4-5ff2-4ccf-95fe-024f5eac6ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:32.029085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 853/1702] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:32.044284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fc577-658f-4b6f-a596-a8e6539db9af service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:32.046478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-047fc577-658f-4b6f-a596-a8e6539db9af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:32.378232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fc577-658f-4b6f-a596-a8e6539db9af service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:32.437734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fbb3b-dcac-4f83-8c14-1a67adfa846a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:32.439903 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fbb3b-dcac-4f83-8c14-1a67adfa846a service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:32.440971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fbb3b-dcac-4f83-8c14-1a67adfa846a service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:32.443897 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fbb3b-dcac-4f83-8c14-1a67adfa846a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:32.464268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fbb3b-dcac-4f83-8c14-1a67adfa846a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:32.468676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fbb3b-dcac-4f83-8c14-1a67adfa846a service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:32.496539 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 850/1703] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:33.233320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d13c7-037c-473c-8f0f-3680d1ff7255 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:33.234134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d13c7-037c-473c-8f0f-3680d1ff7255 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:33.234557 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d13c7-037c-473c-8f0f-3680d1ff7255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:33.317649 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-eb4d13c7-037c-473c-8f0f-3680d1ff7255 None None] MFA Rules not processed for user `aaed14bffb5745349ea35289c4e30089`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:33.319886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-eb4d13c7-037c-473c-8f0f-3680d1ff7255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:33.523249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 854/1704] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:33.534302 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0eee-f68e-4ebf-8f58-00be4e6ad098 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:33.534828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0eee-f68e-4ebf-8f58-00be4e6ad098 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:33.535056 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0eee-f68e-4ebf-8f58-00be4e6ad098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:33.571072 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e5cc0eee-f68e-4ebf-8f58-00be4e6ad098 None None] MFA Rules not processed for user `aaed14bffb5745349ea35289c4e30089`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:33.574891 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e5cc0eee-f68e-4ebf-8f58-00be4e6ad098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:33.596757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 851/1705] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:33.608083 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d13c7-037c-473c-8f0f-3680d1ff7255 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:33.631006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d13c7-037c-473c-8f0f-3680d1ff7255 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:33.646098 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96851474-8ff2-4937-ae36-1ceef5243310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:33.651926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851474-8ff2-4937-ae36-1ceef5243310 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:33.651926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851474-8ff2-4937-ae36-1ceef5243310 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:33.651926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851474-8ff2-4937-ae36-1ceef5243310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:33.682717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96851474-8ff2-4937-ae36-1ceef5243310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:33.684768 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96851474-8ff2-4937-ae36-1ceef5243310 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:33.761756 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 855/1706] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:34.376792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd21680-d7ff-44ca-abac-3e00f22cb27a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:34.377276 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd21680-d7ff-44ca-abac-3e00f22cb27a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:34.378137 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd21680-d7ff-44ca-abac-3e00f22cb27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:34.442638 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2fd21680-d7ff-44ca-abac-3e00f22cb27a None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:34.446209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2fd21680-d7ff-44ca-abac-3e00f22cb27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:34.631846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 852/1707] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:08:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:34.788161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71de350-2ff0-44ad-b522-8715909c6569 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:34.788667 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71de350-2ff0-44ad-b522-8715909c6569 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:34.788926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71de350-2ff0-44ad-b522-8715909c6569 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:34.792369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 856/1708] 10.222.0.62 () {54 vars in 912 bytes} [Wed Apr 6 11:08:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:08:34.804209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf2872-3fa8-4dc7-ac56-7ae433fa88fb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:34.805104 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf2872-3fa8-4dc7-ac56-7ae433fa88fb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:34.806062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf2872-3fa8-4dc7-ac56-7ae433fa88fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:34.851697 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a2bf2872-3fa8-4dc7-ac56-7ae433fa88fb None None] MFA Rules not processed for user `e078c6efaf054f7489f7164fdafce714`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:34.852558 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a2bf2872-3fa8-4dc7-ac56-7ae433fa88fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:34.944764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 853/1709] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:08:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:08:34.962922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71de350-2ff0-44ad-b522-8715909c6569 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:34.965931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f71de350-2ff0-44ad-b522-8715909c6569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:34.993443 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71de350-2ff0-44ad-b522-8715909c6569 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:35.021164 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a3a2f-0697-4649-ae57-d7e945afea71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:35.021853 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a3a2f-0697-4649-ae57-d7e945afea71 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:35.022134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a3a2f-0697-4649-ae57-d7e945afea71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:35.022405 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a3a2f-0697-4649-ae57-d7e945afea71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:35.060158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a3a2f-0697-4649-ae57-d7e945afea71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:35.066492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a3a2f-0697-4649-ae57-d7e945afea71 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:35.092354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 857/1710] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:35.194711 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf2872-3fa8-4dc7-ac56-7ae433fa88fb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:35.198376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a2bf2872-3fa8-4dc7-ac56-7ae433fa88fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:35.444240 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf2872-3fa8-4dc7-ac56-7ae433fa88fb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:35.467912 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7decf-71ee-40cf-9d82-55fcf8d1ffa4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:35.469313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7decf-71ee-40cf-9d82-55fcf8d1ffa4 service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:35.471352 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7decf-71ee-40cf-9d82-55fcf8d1ffa4 service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:35.471850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7decf-71ee-40cf-9d82-55fcf8d1ffa4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:35.524300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7decf-71ee-40cf-9d82-55fcf8d1ffa4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:35.524300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7decf-71ee-40cf-9d82-55fcf8d1ffa4 service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:35.531991 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758b086-9008-4f6f-87f4-06a32c5b8a82 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:35.532283 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758b086-9008-4f6f-87f4-06a32c5b8a82 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:35.532514 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758b086-9008-4f6f-87f4-06a32c5b8a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:35.568750 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 854/1711] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:08:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 11:08:35.633241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c758b086-9008-4f6f-87f4-06a32c5b8a82 None None] MFA Rules not processed for user `145dbd68096f410d81b61b4c9f70ca3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:35.633241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c758b086-9008-4f6f-87f4-06a32c5b8a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:35.865096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 858/1712] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:08:36.940978 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fd285-9daf-4659-a325-707ed582eb40 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:36.942234 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fd285-9daf-4659-a325-707ed582eb40 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:36.942234 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fd285-9daf-4659-a325-707ed582eb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:37.010386 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-087fd285-9daf-4659-a325-707ed582eb40 None None] MFA Rules not processed for user `aaed14bffb5745349ea35289c4e30089`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:37.010386 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-087fd285-9daf-4659-a325-707ed582eb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:37.023545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 855/1713] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:08:38.310608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff8b7d-905c-4284-86c7-faade9c3fac3 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:38.311463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff8b7d-905c-4284-86c7-faade9c3fac3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:38.311750 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff8b7d-905c-4284-86c7-faade9c3fac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:38.371816 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-37ff8b7d-905c-4284-86c7-faade9c3fac3 None None] MFA Rules not processed for user `e078c6efaf054f7489f7164fdafce714`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:38.377449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-37ff8b7d-905c-4284-86c7-faade9c3fac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:38.413448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 859/1714] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Apr 6 11:08:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:38.468606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fd285-9daf-4659-a325-707ed582eb40 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:38.471581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-087fd285-9daf-4659-a325-707ed582eb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:38.498020 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fd285-9daf-4659-a325-707ed582eb40 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:38.511353 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b43859-4236-4e48-b159-2978fa9991b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:38.515182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b43859-4236-4e48-b159-2978fa9991b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:38.515753 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b43859-4236-4e48-b159-2978fa9991b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:38.516309 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b43859-4236-4e48-b159-2978fa9991b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:38.563219 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b43859-4236-4e48-b159-2978fa9991b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:38.565990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b43859-4236-4e48-b159-2978fa9991b7 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:38.606693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 856/1715] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:38.897443 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff8b7d-905c-4284-86c7-faade9c3fac3 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:38.899349 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-37ff8b7d-905c-4284-86c7-faade9c3fac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:38.930921 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b43859-4236-4e48-b159-2978fa9991b7 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:39.111640 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff8b7d-905c-4284-86c7-faade9c3fac3 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:39.130779 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737ecd0-e0f1-414c-9f6c-ff6a28c1c672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:39.134215 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737ecd0-e0f1-414c-9f6c-ff6a28c1c672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:39.134574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737ecd0-e0f1-414c-9f6c-ff6a28c1c672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:39.134856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737ecd0-e0f1-414c-9f6c-ff6a28c1c672 admin admin] PATH_INFO: `/v3/users/585d8737c50a4aa7b8665c9702429880` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:39.138075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737ecd0-e0f1-414c-9f6c-ff6a28c1c672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=585d8737c50a4aa7b8665c9702429880)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:39.147527 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737ecd0-e0f1-414c-9f6c-ff6a28c1c672 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:39.155601 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b43859-4236-4e48-b159-2978fa9991b7 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:39.167453 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ac2fe-f64a-4019-bf8e-2a82fe50096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:39.169129 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ac2fe-f64a-4019-bf8e-2a82fe50096f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:39.169697 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ac2fe-f64a-4019-bf8e-2a82fe50096f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:39.170210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ac2fe-f64a-4019-bf8e-2a82fe50096f admin admin] PATH_INFO: `/v3/users/d613ddd37b5241ea9cff6c1208d5df66` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:39.172555 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ac2fe-f64a-4019-bf8e-2a82fe50096f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d613ddd37b5241ea9cff6c1208d5df66)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:39.175365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ac2fe-f64a-4019-bf8e-2a82fe50096f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:39.430813 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d737ecd0-e0f1-414c-9f6c-ff6a28c1c672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585d8737c50a4aa7b8665c9702429880'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:39.434422 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d737ecd0-e0f1-414c-9f6c-ff6a28c1c672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585d8737c50a4aa7b8665c9702429880'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:39.437458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d737ecd0-e0f1-414c-9f6c-ff6a28c1c672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585d8737c50a4aa7b8665c9702429880'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:39.476873 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-723ac2fe-f64a-4019-bf8e-2a82fe50096f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd613ddd37b5241ea9cff6c1208d5df66'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:39.479919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-723ac2fe-f64a-4019-bf8e-2a82fe50096f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd613ddd37b5241ea9cff6c1208d5df66'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:39.485298 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-723ac2fe-f64a-4019-bf8e-2a82fe50096f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd613ddd37b5241ea9cff6c1208d5df66'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:39.512719 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d737ecd0-e0f1-414c-9f6c-ff6a28c1c672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585d8737c50a4aa7b8665c9702429880'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:39.537800 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d737ecd0-e0f1-414c-9f6c-ff6a28c1c672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585d8737c50a4aa7b8665c9702429880'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:39.581594 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-723ac2fe-f64a-4019-bf8e-2a82fe50096f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd613ddd37b5241ea9cff6c1208d5df66'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:39.615641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-723ac2fe-f64a-4019-bf8e-2a82fe50096f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd613ddd37b5241ea9cff6c1208d5df66'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:39.681004 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 860/1716] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:08:38 2022] DELETE /identity/v3/users/585d8737c50a4aa7b8665c9702429880 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:39.685439 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50d52a-bb37-4a08-94f3-569ac462facc None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:39.686009 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50d52a-bb37-4a08-94f3-569ac462facc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:39.686446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50d52a-bb37-4a08-94f3-569ac462facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:39.732917 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-1b50d52a-bb37-4a08-94f3-569ac462facc None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:39.734597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1b50d52a-bb37-4a08-94f3-569ac462facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:39.775479 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 857/1717] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:08:38 2022] DELETE /identity/v3/users/d613ddd37b5241ea9cff6c1208d5df66 => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:39.785519 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff2230-5e53-485e-8982-6fe32403e9de None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:39.789274 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff2230-5e53-485e-8982-6fe32403e9de None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:39.791191 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff2230-5e53-485e-8982-6fe32403e9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:39.859658 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-86ff2230-5e53-485e-8982-6fe32403e9de None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:39.866972 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-86ff2230-5e53-485e-8982-6fe32403e9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:39.894549 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 861/1718] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:39.906297 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50d52a-bb37-4a08-94f3-569ac462facc None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:39.910197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1b50d52a-bb37-4a08-94f3-569ac462facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:39.960840 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 858/1719] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:39.972003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff2230-5e53-485e-8982-6fe32403e9de None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:39.975519 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-86ff2230-5e53-485e-8982-6fe32403e9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:40.142546 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50d52a-bb37-4a08-94f3-569ac462facc None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:40.157580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04934cbd-cc16-43d5-91a7-2d8dba1cb353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:40.158458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04934cbd-cc16-43d5-91a7-2d8dba1cb353 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:40.158888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04934cbd-cc16-43d5-91a7-2d8dba1cb353 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:40.159366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04934cbd-cc16-43d5-91a7-2d8dba1cb353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:40.165439 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff2230-5e53-485e-8982-6fe32403e9de None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:40.174592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd26eb-e2a1-4b08-9d7e-d164e1340c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:40.182002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd26eb-e2a1-4b08-9d7e-d164e1340c36 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:40.190656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd26eb-e2a1-4b08-9d7e-d164e1340c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:40.196391 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd26eb-e2a1-4b08-9d7e-d164e1340c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:40.203957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04934cbd-cc16-43d5-91a7-2d8dba1cb353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:40.214838 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04934cbd-cc16-43d5-91a7-2d8dba1cb353 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:40.222958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd26eb-e2a1-4b08-9d7e-d164e1340c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:40.232046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd26eb-e2a1-4b08-9d7e-d164e1340c36 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:40.258305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 862/1720] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:08:40.280769 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 859/1721] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:41.404336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04934cbd-cc16-43d5-91a7-2d8dba1cb353 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:41.407411 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-04934cbd-cc16-43d5-91a7-2d8dba1cb353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:41.460464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04934cbd-cc16-43d5-91a7-2d8dba1cb353 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:41.479181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369c856-45eb-488e-aba1-ced66215eb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:41.480083 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369c856-45eb-488e-aba1-ced66215eb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:41.480405 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369c856-45eb-488e-aba1-ced66215eb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:41.485584 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369c856-45eb-488e-aba1-ced66215eb35 admin admin] PATH_INFO: `/v3/projects/94c0b061e2a24d03a975a9eade9dd120` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:41.496469 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369c856-45eb-488e-aba1-ced66215eb35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c0b061e2a24d03a975a9eade9dd120)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:41.506024 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369c856-45eb-488e-aba1-ced66215eb35 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:41.521503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd26eb-e2a1-4b08-9d7e-d164e1340c36 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:41.523717 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c4dd26eb-e2a1-4b08-9d7e-d164e1340c36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:41.564364 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd26eb-e2a1-4b08-9d7e-d164e1340c36 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:41.589799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:41.591420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:41.595645 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:41.596028 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] PATH_INFO: `/v3/projects/9555cbc3fde44d82ba2ead5f06e228da` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:41.617572 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9555cbc3fde44d82ba2ead5f06e228da)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:41.620396 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:41.821842 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4369c856-45eb-488e-aba1-ced66215eb35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c0b061e2a24d03a975a9eade9dd120', 'request_id': 'req-4369c856-45eb-488e-aba1-ced66215eb35'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:41.831196 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9555cbc3fde44d82ba2ead5f06e228da', 'request_id': 'req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:41.840883 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9555cbc3fde44d82ba2ead5f06e228da', 'request_id': 'req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:41.846917 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9555cbc3fde44d82ba2ead5f06e228da', 'request_id': 'req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:41.914387 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4369c856-45eb-488e-aba1-ced66215eb35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c0b061e2a24d03a975a9eade9dd120', 'request_id': 'req-4369c856-45eb-488e-aba1-ced66215eb35'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:41.928446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4369c856-45eb-488e-aba1-ced66215eb35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c0b061e2a24d03a975a9eade9dd120', 'request_id': 'req-4369c856-45eb-488e-aba1-ced66215eb35'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:42.024588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] The token cache is being invalidate because project 9555cbc3fde44d82ba2ead5f06e228da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:08:42.024895 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:42.025617 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:42.031761 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 860/1722] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:08:41 2022] DELETE /identity/v3/projects/9555cbc3fde44d82ba2ead5f06e228da => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:42.042316 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:42.045408 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4369c856-45eb-488e-aba1-ced66215eb35 admin admin] The token cache is being invalidate because project 94c0b061e2a24d03a975a9eade9dd120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:08:42.049116 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:42.056028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4369c856-45eb-488e-aba1-ced66215eb35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:42.061729 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4369c856-45eb-488e-aba1-ced66215eb35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:42.071551 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 863/1723] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:08:41 2022] DELETE /identity/v3/projects/94c0b061e2a24d03a975a9eade9dd120 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:42.080249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8334c-8060-4f70-8b22-692df55add4d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:42.080249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8334c-8060-4f70-8b22-692df55add4d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:42.080249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8334c-8060-4f70-8b22-692df55add4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:42.138356 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-66e8334c-8060-4f70-8b22-692df55add4d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:42.142280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-66e8334c-8060-4f70-8b22-692df55add4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:42.331330 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae74efa-15d4-4e15-95fe-d7c19e4d0a5f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:42.344137 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ab42c-c70b-4d01-9dd1-c5dec4444deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:42.348957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ab42c-c70b-4d01-9dd1-c5dec4444deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:42.350009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ab42c-c70b-4d01-9dd1-c5dec4444deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:42.354061 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ab42c-c70b-4d01-9dd1-c5dec4444deb admin admin] PATH_INFO: `/v3/users/7af7419fe43747bea1372b4b313363f5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:42.354173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ab42c-c70b-4d01-9dd1-c5dec4444deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af7419fe43747bea1372b4b313363f5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:42.365732 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 864/1724] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:42.369733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b956df8-99b6-40ce-9895-d0da7ecb1abb None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:42.370050 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b956df8-99b6-40ce-9895-d0da7ecb1abb None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:42.370335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b956df8-99b6-40ce-9895-d0da7ecb1abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:42.373217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ab42c-c70b-4d01-9dd1-c5dec4444deb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:42.458395 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-1b956df8-99b6-40ce-9895-d0da7ecb1abb None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:42.460967 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1b956df8-99b6-40ce-9895-d0da7ecb1abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:42.508388 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 865/1725] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:42.512135 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b956df8-99b6-40ce-9895-d0da7ecb1abb None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:42.556596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b956df8-99b6-40ce-9895-d0da7ecb1abb None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:42.568283 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3fd68-257f-4c65-b228-c6c4808dffc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:42.571207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3fd68-257f-4c65-b228-c6c4808dffc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:42.574067 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3fd68-257f-4c65-b228-c6c4808dffc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:42.576785 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3fd68-257f-4c65-b228-c6c4808dffc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:42.576896 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3fd68-257f-4c65-b228-c6c4808dffc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:42.577492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3fd68-257f-4c65-b228-c6c4808dffc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:42.583189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3fd68-257f-4c65-b228-c6c4808dffc9 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:42.631844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 866/1726] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:08:42.637009 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3fd68-257f-4c65-b228-c6c4808dffc9 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:42.650011 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3fd68-257f-4c65-b228-c6c4808dffc9 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:42.669418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1f641-9135-4a5f-b729-49c423f4307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:42.670704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1f641-9135-4a5f-b729-49c423f4307b admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:42.671288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1f641-9135-4a5f-b729-49c423f4307b admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:42.672262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1f641-9135-4a5f-b729-49c423f4307b admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:42.676220 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1f641-9135-4a5f-b729-49c423f4307b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:42.686285 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1f641-9135-4a5f-b729-49c423f4307b admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:42.705095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9e0ab42c-c70b-4d01-9dd1-c5dec4444deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af7419fe43747bea1372b4b313363f5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:42.708261 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9e0ab42c-c70b-4d01-9dd1-c5dec4444deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af7419fe43747bea1372b4b313363f5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:42.710033 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9e0ab42c-c70b-4d01-9dd1-c5dec4444deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af7419fe43747bea1372b4b313363f5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:42.793042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9e0ab42c-c70b-4d01-9dd1-c5dec4444deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af7419fe43747bea1372b4b313363f5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:42.825961 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9e0ab42c-c70b-4d01-9dd1-c5dec4444deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af7419fe43747bea1372b4b313363f5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:42.847325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 861/1727] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:08:42 2022] DELETE /identity/v3/users/7af7419fe43747bea1372b4b313363f5 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:42.848846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b19bb-ae5a-4141-b480-04058c7ade1c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:42.849175 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b19bb-ae5a-4141-b480-04058c7ade1c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:42.849641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b19bb-ae5a-4141-b480-04058c7ade1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:42.889647 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 867/1728] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:42 2022] POST /identity/v3/projects => generated 367 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:42.899584 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1f641-9135-4a5f-b729-49c423f4307b admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:42.902628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ccb1f641-9135-4a5f-b729-49c423f4307b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:42.905048 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c38b19bb-ae5a-4141-b480-04058c7ade1c None None] MFA Rules not processed for user `f506156c62014060ab9004b7abbb2369`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:42.910814 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c38b19bb-ae5a-4141-b480-04058c7ade1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:43.022719 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 862/1729] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:43.079569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1f641-9135-4a5f-b729-49c423f4307b admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:43.087279 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e5061-3c6d-43ba-9c1d-fd7b0330ff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:43.087279 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e5061-3c6d-43ba-9c1d-fd7b0330ff5f admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:43.090226 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e5061-3c6d-43ba-9c1d-fd7b0330ff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:43.090226 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e5061-3c6d-43ba-9c1d-fd7b0330ff5f admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:43.090226 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e5061-3c6d-43ba-9c1d-fd7b0330ff5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:43.092441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e5061-3c6d-43ba-9c1d-fd7b0330ff5f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:43.118413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b19bb-ae5a-4141-b480-04058c7ade1c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:43.120067 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c38b19bb-ae5a-4141-b480-04058c7ade1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:43.162455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b19bb-ae5a-4141-b480-04058c7ade1c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:43.168322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 868/1730] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:42 2022] POST /identity/v3/users => generated 284 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:43.170112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e5061-3c6d-43ba-9c1d-fd7b0330ff5f admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:43.190035 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753b25d-fc87-48df-9c9e-c20008222da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:43.192264 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e5061-3c6d-43ba-9c1d-fd7b0330ff5f admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:43.193877 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b25d-fc87-48df-9c9e-c20008222da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:43.194647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b25d-fc87-48df-9c9e-c20008222da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:43.194647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b25d-fc87-48df-9c9e-c20008222da8 admin admin] PATH_INFO: `/v3/users/66b82a8cc61a430fbdb40a2253d48c2f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:43.198402 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753b25d-fc87-48df-9c9e-c20008222da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b82a8cc61a430fbdb40a2253d48c2f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:43.203850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753b25d-fc87-48df-9c9e-c20008222da8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:43.205096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fce08-5846-4be1-858a-6180966058a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:43.205808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fce08-5846-4be1-858a-6180966058a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:43.206090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fce08-5846-4be1-858a-6180966058a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:43.206374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fce08-5846-4be1-858a-6180966058a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:43.212627 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fce08-5846-4be1-858a-6180966058a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:43.214251 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fce08-5846-4be1-858a-6180966058a4 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:43.245201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 869/1731] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:43.247472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fce08-5846-4be1-858a-6180966058a4 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:43.272342 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fce08-5846-4be1-858a-6180966058a4 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:43.284679 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af638c2e-581b-4d40-90b0-f89c0f579d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:43.286530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af638c2e-581b-4d40-90b0-f89c0f579d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:43.286819 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af638c2e-581b-4d40-90b0-f89c0f579d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:43.287088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af638c2e-581b-4d40-90b0-f89c0f579d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:43.291972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af638c2e-581b-4d40-90b0-f89c0f579d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:43.298038 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af638c2e-581b-4d40-90b0-f89c0f579d2a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:43.321818 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 870/1732] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:43.326570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af638c2e-581b-4d40-90b0-f89c0f579d2a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:43.347596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af638c2e-581b-4d40-90b0-f89c0f579d2a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:43.353364 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fba4b-d2a3-4465-8aec-bf30df6526cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:43.354337 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fba4b-d2a3-4465-8aec-bf30df6526cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:43.356070 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fba4b-d2a3-4465-8aec-bf30df6526cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:43.356070 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fba4b-d2a3-4465-8aec-bf30df6526cc admin admin] PATH_INFO: `/v3/projects/bb5d4f6832ac48a1a5b41f45cead3064/users/d273326dd0174a6397ab96d34ff13867/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:43.386354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fba4b-d2a3-4465-8aec-bf30df6526cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5d4f6832ac48a1a5b41f45cead3064, user_id=d273326dd0174a6397ab96d34ff13867, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:43.393384 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fba4b-d2a3-4465-8aec-bf30df6526cc admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:43.475263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0753b25d-fc87-48df-9c9e-c20008222da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b82a8cc61a430fbdb40a2253d48c2f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:43.477457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0753b25d-fc87-48df-9c9e-c20008222da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b82a8cc61a430fbdb40a2253d48c2f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:43.480013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0753b25d-fc87-48df-9c9e-c20008222da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b82a8cc61a430fbdb40a2253d48c2f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:43.521559 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 871/1733] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:43 2022] PUT /identity/v3/projects/bb5d4f6832ac48a1a5b41f45cead3064/users/d273326dd0174a6397ab96d34ff13867/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:43.528360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40b6ea-08a0-49f0-9244-64368cd227c3 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:43.528806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40b6ea-08a0-49f0-9244-64368cd227c3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:43.529246 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40b6ea-08a0-49f0-9244-64368cd227c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:43.575425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5c40b6ea-08a0-49f0-9244-64368cd227c3 None None] MFA Rules not processed for user `d273326dd0174a6397ab96d34ff13867`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:43.578025 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5c40b6ea-08a0-49f0-9244-64368cd227c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:43.591900 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0753b25d-fc87-48df-9c9e-c20008222da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b82a8cc61a430fbdb40a2253d48c2f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:43.613864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0753b25d-fc87-48df-9c9e-c20008222da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b82a8cc61a430fbdb40a2253d48c2f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:43.698215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 863/1734] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:08:43 2022] DELETE /identity/v3/users/66b82a8cc61a430fbdb40a2253d48c2f => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:08:43.703059 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f854d7-d8dc-4913-aa07-f7b66c5f4fee None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:43.703059 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f854d7-d8dc-4913-aa07-f7b66c5f4fee None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:43.703235 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f854d7-d8dc-4913-aa07-f7b66c5f4fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:43.704547 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 872/1735] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:08:43.770762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40b6ea-08a0-49f0-9244-64368cd227c3 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:43.775184 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5c40b6ea-08a0-49f0-9244-64368cd227c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:43.839854 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a8f854d7-d8dc-4913-aa07-f7b66c5f4fee None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:43.850631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a8f854d7-d8dc-4913-aa07-f7b66c5f4fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:44.066485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40b6ea-08a0-49f0-9244-64368cd227c3 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:44.112563 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 864/1736] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:44.114799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9d76e-e2d6-4db0-a26e-4e31e2883869 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:44.115102 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9d76e-e2d6-4db0-a26e-4e31e2883869 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:44.115598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9d76e-e2d6-4db0-a26e-4e31e2883869 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:44.117415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 865/1737] 10.222.0.62 () {54 vars in 921 bytes} [Wed Apr 6 11:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:08:44.235328 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6522300-840c-446a-bd38-1c20d942627d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:44.236018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6522300-840c-446a-bd38-1c20d942627d service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:44.236297 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6522300-840c-446a-bd38-1c20d942627d service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:44.236576 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6522300-840c-446a-bd38-1c20d942627d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:44.346215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461ff2-f45e-4c4c-b97e-d0d2c9074079 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:44.346422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461ff2-f45e-4c4c-b97e-d0d2c9074079 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:44.346935 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461ff2-f45e-4c4c-b97e-d0d2c9074079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:44.385353 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b0461ff2-f45e-4c4c-b97e-d0d2c9074079 None None] MFA Rules not processed for user `650c5809116e4bcd808044236c06dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:44.390070 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b0461ff2-f45e-4c4c-b97e-d0d2c9074079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:44.455240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6522300-840c-446a-bd38-1c20d942627d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:44.455240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6522300-840c-446a-bd38-1c20d942627d service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:44.500731 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 873/1738] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:44.504973 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6522300-840c-446a-bd38-1c20d942627d service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:44.526222 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d6522300-840c-446a-bd38-1c20d942627d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:44.569433 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 866/1739] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Apr 6 11:08:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:44.684691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6522300-840c-446a-bd38-1c20d942627d service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:44.697193 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570ccc5-7b8d-462e-bfce-bccd3b8e299c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:44.698014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570ccc5-7b8d-462e-bfce-bccd3b8e299c service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:44.698310 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570ccc5-7b8d-462e-bfce-bccd3b8e299c service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:44.698645 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570ccc5-7b8d-462e-bfce-bccd3b8e299c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:44.748945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570ccc5-7b8d-462e-bfce-bccd3b8e299c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:44.752980 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570ccc5-7b8d-462e-bfce-bccd3b8e299c service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:44.794270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 874/1740] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:45.235462 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461ff2-f45e-4c4c-b97e-d0d2c9074079 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:45.238177 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b0461ff2-f45e-4c4c-b97e-d0d2c9074079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:45.277528 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461ff2-f45e-4c4c-b97e-d0d2c9074079 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:45.292795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc896c9-686d-4aad-8880-b5160382f793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:45.297144 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc896c9-686d-4aad-8880-b5160382f793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:45.297647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc896c9-686d-4aad-8880-b5160382f793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:45.298071 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc896c9-686d-4aad-8880-b5160382f793 admin admin] PATH_INFO: `/v3/projects/3bd6b2408be545af977f6b913d730af8` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:45.303592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc896c9-686d-4aad-8880-b5160382f793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd6b2408be545af977f6b913d730af8)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:45.313148 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc896c9-686d-4aad-8880-b5160382f793 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:45.539224 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dbc896c9-686d-4aad-8880-b5160382f793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd6b2408be545af977f6b913d730af8', 'request_id': 'req-dbc896c9-686d-4aad-8880-b5160382f793'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:45.553910 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dbc896c9-686d-4aad-8880-b5160382f793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd6b2408be545af977f6b913d730af8', 'request_id': 'req-dbc896c9-686d-4aad-8880-b5160382f793'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:45.563511 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dbc896c9-686d-4aad-8880-b5160382f793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd6b2408be545af977f6b913d730af8', 'request_id': 'req-dbc896c9-686d-4aad-8880-b5160382f793'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:45.626412 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570ccc5-7b8d-462e-bfce-bccd3b8e299c service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:45.628470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2570ccc5-7b8d-462e-bfce-bccd3b8e299c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:45.666500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570ccc5-7b8d-462e-bfce-bccd3b8e299c service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:45.693939 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dbc896c9-686d-4aad-8880-b5160382f793 admin admin] The token cache is being invalidate because project 3bd6b2408be545af977f6b913d730af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:08:45.694613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dbc896c9-686d-4aad-8880-b5160382f793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:45.695980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dbc896c9-686d-4aad-8880-b5160382f793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:45.697958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 867/1741] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:08:45 2022] DELETE /identity/v3/projects/3bd6b2408be545af977f6b913d730af8 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:45.702735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af9589-ea9f-4181-8190-114530cebb91 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:45.706164 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af9589-ea9f-4181-8190-114530cebb91 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:45.706732 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af9589-ea9f-4181-8190-114530cebb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:45.762407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-40af9589-ea9f-4181-8190-114530cebb91 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:45.793850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-40af9589-ea9f-4181-8190-114530cebb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:45.819836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e7ef9-f731-4ef8-aae0-8dfba75a7f12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:45.822599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e7ef9-f731-4ef8-aae0-8dfba75a7f12 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:45.823171 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e7ef9-f731-4ef8-aae0-8dfba75a7f12 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:45.824659 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e7ef9-f731-4ef8-aae0-8dfba75a7f12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:45.829250 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4f4e7ef9-f731-4ef8-aae0-8dfba75a7f12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:45.863062 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e7ef9-f731-4ef8-aae0-8dfba75a7f12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:45.866676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e7ef9-f731-4ef8-aae0-8dfba75a7f12 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:45.904480 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 875/1742] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:08:45.963757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 868/1743] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:45.974676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87317b-40a4-4739-ac2e-60a586cded83 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:45.976913 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87317b-40a4-4739-ac2e-60a586cded83 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:45.978157 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87317b-40a4-4739-ac2e-60a586cded83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:46.021299 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-fb87317b-40a4-4739-ac2e-60a586cded83 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:46.023994 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fb87317b-40a4-4739-ac2e-60a586cded83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:46.036158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 876/1744] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:46.040162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af9589-ea9f-4181-8190-114530cebb91 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:46.068178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af9589-ea9f-4181-8190-114530cebb91 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:46.085826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba1704-c6ac-442c-8da6-84437c4f35d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:46.086519 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba1704-c6ac-442c-8da6-84437c4f35d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:46.086804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba1704-c6ac-442c-8da6-84437c4f35d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:46.087087 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba1704-c6ac-442c-8da6-84437c4f35d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:46.093989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba1704-c6ac-442c-8da6-84437c4f35d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:46.094319 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba1704-c6ac-442c-8da6-84437c4f35d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:46.096119 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba1704-c6ac-442c-8da6-84437c4f35d8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:46.158390 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 869/1745] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:08:46.159360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87317b-40a4-4739-ac2e-60a586cded83 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:46.172200 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87317b-40a4-4739-ac2e-60a586cded83 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:46.184746 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2d3f8-6549-407c-95c3-40247f938787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:46.185534 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2d3f8-6549-407c-95c3-40247f938787 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:46.185887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2d3f8-6549-407c-95c3-40247f938787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:46.186303 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2d3f8-6549-407c-95c3-40247f938787 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:46.187070 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2d3f8-6549-407c-95c3-40247f938787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:46.193291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2d3f8-6549-407c-95c3-40247f938787 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:46.296427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 877/1746] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:46 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:46.296619 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba1704-c6ac-442c-8da6-84437c4f35d8 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:46.307374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba1704-c6ac-442c-8da6-84437c4f35d8 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:46.629149 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021fc49-42e6-4c22-bb42-337ea56debde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:46.630457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021fc49-42e6-4c22-bb42-337ea56debde admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:46.631943 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021fc49-42e6-4c22-bb42-337ea56debde admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:46.632470 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021fc49-42e6-4c22-bb42-337ea56debde admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:46.633199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021fc49-42e6-4c22-bb42-337ea56debde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:46.669040 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021fc49-42e6-4c22-bb42-337ea56debde admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:46.769672 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 870/1747] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:46 2022] POST /identity/v3/users => generated 294 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:08:46.771532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2d3f8-6549-407c-95c3-40247f938787 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:46.786903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2d3f8-6549-407c-95c3-40247f938787 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:46.798281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9af1f-685b-4365-909e-5e0174398f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:46.799299 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9af1f-685b-4365-909e-5e0174398f27 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:46.799838 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9af1f-685b-4365-909e-5e0174398f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:46.800186 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9af1f-685b-4365-909e-5e0174398f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:46.801667 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9af1f-685b-4365-909e-5e0174398f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:46.806062 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9af1f-685b-4365-909e-5e0174398f27 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:46.827336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021fc49-42e6-4c22-bb42-337ea56debde admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:46.829511 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e021fc49-42e6-4c22-bb42-337ea56debde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:46.831140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 878/1748] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:46.835748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9af1f-685b-4365-909e-5e0174398f27 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:46.853678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021fc49-42e6-4c22-bb42-337ea56debde admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:46.856625 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9af1f-685b-4365-909e-5e0174398f27 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:46.870137 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:46.871042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:46.871314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:46.871736 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] PATH_INFO: `/v3/projects/b52d484a15ca45559bff66140efa410b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:46.874501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437c5c4-5832-4ddd-8b64-17cabb866ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:46.875416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437c5c4-5832-4ddd-8b64-17cabb866ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:46.875992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437c5c4-5832-4ddd-8b64-17cabb866ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:46.876344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437c5c4-5832-4ddd-8b64-17cabb866ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:46.877192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437c5c4-5832-4ddd-8b64-17cabb866ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:46.879507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437c5c4-5832-4ddd-8b64-17cabb866ec4 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:46.900625 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 879/1749] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:46.905644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437c5c4-5832-4ddd-8b64-17cabb866ec4 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:46.908391 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52d484a15ca45559bff66140efa410b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:46.910982 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:46.935199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437c5c4-5832-4ddd-8b64-17cabb866ec4 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:46.940814 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6478b0-7a0c-4936-8152-6d5a9fad1cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:46.942886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6478b0-7a0c-4936-8152-6d5a9fad1cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:46.943249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6478b0-7a0c-4936-8152-6d5a9fad1cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:46.943607 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6478b0-7a0c-4936-8152-6d5a9fad1cd5 admin admin] PATH_INFO: `/v3/projects/4ac307a514134a4eb93a4bd9b939d7a1/users/0d49668747704f44ad8931eece7f8178/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:46.976175 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6478b0-7a0c-4936-8152-6d5a9fad1cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac307a514134a4eb93a4bd9b939d7a1, user_id=0d49668747704f44ad8931eece7f8178, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:46.978992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6478b0-7a0c-4936-8152-6d5a9fad1cd5 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:47.081675 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 880/1750] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:46 2022] PUT /identity/v3/projects/4ac307a514134a4eb93a4bd9b939d7a1/users/0d49668747704f44ad8931eece7f8178/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:47.090990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52d484a15ca45559bff66140efa410b', 'request_id': 'req-8a089d92-1986-4c1f-9bd0-10a6d1142240'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:47.103724 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52d484a15ca45559bff66140efa410b', 'request_id': 'req-8a089d92-1986-4c1f-9bd0-10a6d1142240'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:47.104982 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5cf81-a3b2-4efe-addd-27a40028b3ef None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:47.105335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5cf81-a3b2-4efe-addd-27a40028b3ef None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:47.105618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5cf81-a3b2-4efe-addd-27a40028b3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:47.132047 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52d484a15ca45559bff66140efa410b', 'request_id': 'req-8a089d92-1986-4c1f-9bd0-10a6d1142240'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:47.148195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a8a5cf81-a3b2-4efe-addd-27a40028b3ef None None] MFA Rules not processed for user `0d49668747704f44ad8931eece7f8178`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:47.150290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a8a5cf81-a3b2-4efe-addd-27a40028b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:47.195950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] The token cache is being invalidate because project b52d484a15ca45559bff66140efa410b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:08:47.196096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:47.197481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:47.201706 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 871/1751] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:08:46 2022] DELETE /identity/v3/projects/b52d484a15ca45559bff66140efa410b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:47.207096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:47.209159 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:47.369593 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 881/1752] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:47.370921 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5cf81-a3b2-4efe-addd-27a40028b3ef None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:47.375559 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a8a5cf81-a3b2-4efe-addd-27a40028b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:47.404837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5cf81-a3b2-4efe-addd-27a40028b3ef None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:47.423142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a089d92-1986-4c1f-9bd0-10a6d1142240 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:47.426825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87ecf4-315b-48b8-8860-f6b36dc714cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:47.427508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87ecf4-315b-48b8-8860-f6b36dc714cd admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:47.427794 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87ecf4-315b-48b8-8860-f6b36dc714cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:47.428121 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87ecf4-315b-48b8-8860-f6b36dc714cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:47.428760 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87ecf4-315b-48b8-8860-f6b36dc714cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:47.431379 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87ecf4-315b-48b8-8860-f6b36dc714cd admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:47.467075 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a653e81-3a33-4cb4-9fa6-2b11baf7c43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:47.474873 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a653e81-3a33-4cb4-9fa6-2b11baf7c43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:47.476131 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a653e81-3a33-4cb4-9fa6-2b11baf7c43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:47.477974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a653e81-3a33-4cb4-9fa6-2b11baf7c43d admin admin] PATH_INFO: `/v3/users/81be1c08e8d34a6c9e2459fc30c1fe66` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:47.480528 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a653e81-3a33-4cb4-9fa6-2b11baf7c43d admin admin] RBAC: Authorizing `identity:delete_user(user_id=81be1c08e8d34a6c9e2459fc30c1fe66)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:47.482759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a653e81-3a33-4cb4-9fa6-2b11baf7c43d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:47.563991 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 882/1753] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:47 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:47.567985 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87ecf4-315b-48b8-8860-f6b36dc714cd admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:47.715507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87ecf4-315b-48b8-8860-f6b36dc714cd admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:47.731259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b9384-d075-4c32-a19e-06285713ea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:47.735104 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b9384-d075-4c32-a19e-06285713ea69 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:47.736837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b9384-d075-4c32-a19e-06285713ea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:47.737528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b9384-d075-4c32-a19e-06285713ea69 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:47.740072 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b9384-d075-4c32-a19e-06285713ea69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:47.747632 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b9384-d075-4c32-a19e-06285713ea69 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:47.751448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a653e81-3a33-4cb4-9fa6-2b11baf7c43d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81be1c08e8d34a6c9e2459fc30c1fe66'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:47.753525 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a653e81-3a33-4cb4-9fa6-2b11baf7c43d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81be1c08e8d34a6c9e2459fc30c1fe66'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:47.757128 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a653e81-3a33-4cb4-9fa6-2b11baf7c43d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81be1c08e8d34a6c9e2459fc30c1fe66'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:47.826568 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a653e81-3a33-4cb4-9fa6-2b11baf7c43d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81be1c08e8d34a6c9e2459fc30c1fe66'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:47.851228 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a653e81-3a33-4cb4-9fa6-2b11baf7c43d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81be1c08e8d34a6c9e2459fc30c1fe66'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:47.900535 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 883/1754] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:47 2022] POST /identity/v3/users => generated 300 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:08:47.904941 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b9384-d075-4c32-a19e-06285713ea69 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:47.908998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ce6b9384-d075-4c32-a19e-06285713ea69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:47.929283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 872/1755] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:08:47 2022] DELETE /identity/v3/users/81be1c08e8d34a6c9e2459fc30c1fe66 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:47.938044 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b9384-d075-4c32-a19e-06285713ea69 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:48.045630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac91b4-e83a-458e-97a4-108b489a057a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:48.046676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac91b4-e83a-458e-97a4-108b489a057a admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:48.047194 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac91b4-e83a-458e-97a4-108b489a057a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:48.047931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac91b4-e83a-458e-97a4-108b489a057a admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:48.052107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac91b4-e83a-458e-97a4-108b489a057a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:48.052107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac91b4-e83a-458e-97a4-108b489a057a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:48.069473 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 884/1756] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:48.070918 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a653e81-3a33-4cb4-9fa6-2b11baf7c43d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:48.085258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a653e81-3a33-4cb4-9fa6-2b11baf7c43d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:48.097604 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d9857-bffc-47ff-838a-1d8a06133c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:48.098634 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d9857-bffc-47ff-838a-1d8a06133c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:48.098924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d9857-bffc-47ff-838a-1d8a06133c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:48.099204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d9857-bffc-47ff-838a-1d8a06133c20 admin admin] PATH_INFO: `/v3/projects/4be621d6b0444b8281c6c4e42e259fc4/users/d809f0f96ce44c3abd685fdf4259ad2a/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:48.139404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d9857-bffc-47ff-838a-1d8a06133c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be621d6b0444b8281c6c4e42e259fc4, user_id=d809f0f96ce44c3abd685fdf4259ad2a, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:48.142284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d9857-bffc-47ff-838a-1d8a06133c20 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:48.219173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 873/1757] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:48 2022] PUT /identity/v3/projects/4be621d6b0444b8281c6c4e42e259fc4/users/d809f0f96ce44c3abd685fdf4259ad2a/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:08:48.220192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac91b4-e83a-458e-97a4-108b489a057a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:48.233105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac91b4-e83a-458e-97a4-108b489a057a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:48.363591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4991ae-e294-4f96-8561-61c1b2db4fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:48.364597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4991ae-e294-4f96-8561-61c1b2db4fff admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:48.365046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4991ae-e294-4f96-8561-61c1b2db4fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:48.365613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4991ae-e294-4f96-8561-61c1b2db4fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:48.366570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4991ae-e294-4f96-8561-61c1b2db4fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:48.368472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4991ae-e294-4f96-8561-61c1b2db4fff admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:48.403083 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 885/1758] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:48.404402 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d9857-bffc-47ff-838a-1d8a06133c20 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:48.423510 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d9857-bffc-47ff-838a-1d8a06133c20 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:48.431123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdadd19-3e7c-4105-991b-32e74744b76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:48.432195 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdadd19-3e7c-4105-991b-32e74744b76a admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:48.434790 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdadd19-3e7c-4105-991b-32e74744b76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:48.435446 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdadd19-3e7c-4105-991b-32e74744b76a admin admin] PATH_INFO: `/v3/projects/4be621d6b0444b8281c6c4e42e259fc4/users/d809f0f96ce44c3abd685fdf4259ad2a/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:48.442046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdadd19-3e7c-4105-991b-32e74744b76a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be621d6b0444b8281c6c4e42e259fc4, user_id=d809f0f96ce44c3abd685fdf4259ad2a, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:48.460032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdadd19-3e7c-4105-991b-32e74744b76a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:48.486812 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 874/1759] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:48 2022] PUT /identity/v3/projects/4be621d6b0444b8281c6c4e42e259fc4/users/d809f0f96ce44c3abd685fdf4259ad2a/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:48.499555 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60204705-6468-4945-bfea-b703e4456002 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:48.499946 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60204705-6468-4945-bfea-b703e4456002 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:48.500327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60204705-6468-4945-bfea-b703e4456002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:48.575398 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-60204705-6468-4945-bfea-b703e4456002 None None] MFA Rules not processed for user `d809f0f96ce44c3abd685fdf4259ad2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:48.589931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-60204705-6468-4945-bfea-b703e4456002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:48.834907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 886/1760] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:48.892001 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdadd19-3e7c-4105-991b-32e74744b76a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:48.894780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-bbdadd19-3e7c-4105-991b-32e74744b76a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:49.064372 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdadd19-3e7c-4105-991b-32e74744b76a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:49.083827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bd397-5c2c-44c6-b04a-e2ce8d6e64a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:49.083827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd397-5c2c-44c6-b04a-e2ce8d6e64a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:49.084356 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd397-5c2c-44c6-b04a-e2ce8d6e64a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:49.084983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd397-5c2c-44c6-b04a-e2ce8d6e64a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:49.105110 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bd397-5c2c-44c6-b04a-e2ce8d6e64a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:49.106414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bd397-5c2c-44c6-b04a-e2ce8d6e64a8 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:49.121312 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 875/1761] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:08:49.423074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60204705-6468-4945-bfea-b703e4456002 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:49.661779 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60204705-6468-4945-bfea-b703e4456002 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:49.669807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f63ffb-0805-4465-b6d0-37f820c7c4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:49.671123 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f63ffb-0805-4465-b6d0-37f820c7c4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:49.671613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f63ffb-0805-4465-b6d0-37f820c7c4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:49.672120 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f63ffb-0805-4465-b6d0-37f820c7c4a9 admin admin] PATH_INFO: `/v3/users/0d49668747704f44ad8931eece7f8178` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:49.674392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f63ffb-0805-4465-b6d0-37f820c7c4a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d49668747704f44ad8931eece7f8178)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:49.677772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f63ffb-0805-4465-b6d0-37f820c7c4a9 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:49.846916 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a2de7-3937-4563-93b9-efcecb5e25c6 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:49.847893 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a2de7-3937-4563-93b9-efcecb5e25c6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:49.848323 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a2de7-3937-4563-93b9-efcecb5e25c6 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:49.850286 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 876/1762] 10.222.0.62 () {54 vars in 921 bytes} [Wed Apr 6 11:08:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:08:49.871059 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-28f63ffb-0805-4465-b6d0-37f820c7c4a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d49668747704f44ad8931eece7f8178'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:49.881308 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-28f63ffb-0805-4465-b6d0-37f820c7c4a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d49668747704f44ad8931eece7f8178'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:49.882376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-28f63ffb-0805-4465-b6d0-37f820c7c4a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d49668747704f44ad8931eece7f8178'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:49.897483 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432ccf7-814c-4344-ac1b-6dbb1e768ff8 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:49.897771 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432ccf7-814c-4344-ac1b-6dbb1e768ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:49.898068 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432ccf7-814c-4344-ac1b-6dbb1e768ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:49.911488 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-28f63ffb-0805-4465-b6d0-37f820c7c4a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d49668747704f44ad8931eece7f8178'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:49.933099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-28f63ffb-0805-4465-b6d0-37f820c7c4a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d49668747704f44ad8931eece7f8178'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:49.933942 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8432ccf7-814c-4344-ac1b-6dbb1e768ff8 None None] MFA Rules not processed for user `650c5809116e4bcd808044236c06dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:49.936461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8432ccf7-814c-4344-ac1b-6dbb1e768ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:50.040810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 887/1763] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:08:49 2022] DELETE /identity/v3/users/0d49668747704f44ad8931eece7f8178 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:50.046242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a8f32-0b07-4377-a0f1-2dc4db4240ef None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:50.046726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a8f32-0b07-4377-a0f1-2dc4db4240ef None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:50.047357 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a8f32-0b07-4377-a0f1-2dc4db4240ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:50.083609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 877/1764] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Apr 6 11:08:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:50.091931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-b86a8f32-0b07-4377-a0f1-2dc4db4240ef None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:50.093391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b86a8f32-0b07-4377-a0f1-2dc4db4240ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:50.130469 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432ccf7-814c-4344-ac1b-6dbb1e768ff8 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:50.132498 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8432ccf7-814c-4344-ac1b-6dbb1e768ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:50.163340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432ccf7-814c-4344-ac1b-6dbb1e768ff8 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:50.294834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 888/1765] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:50.381543 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a8f32-0b07-4377-a0f1-2dc4db4240ef None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:50.389847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b86a8f32-0b07-4377-a0f1-2dc4db4240ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:50.398151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bcba54-a56b-4a9c-95eb-afa5e0964b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:50.399216 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcba54-a56b-4a9c-95eb-afa5e0964b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:50.399503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcba54-a56b-4a9c-95eb-afa5e0964b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:50.399831 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcba54-a56b-4a9c-95eb-afa5e0964b86 admin admin] PATH_INFO: `/v3/projects/5b2f63e8394c4ae7b8627c550fe27a89` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:50.406739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bcba54-a56b-4a9c-95eb-afa5e0964b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2f63e8394c4ae7b8627c550fe27a89)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:50.412109 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bcba54-a56b-4a9c-95eb-afa5e0964b86 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:50.668691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a8f32-0b07-4377-a0f1-2dc4db4240ef None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:50.706609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc83754-f548-4c54-b72c-a6927aea2864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:50.706609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc83754-f548-4c54-b72c-a6927aea2864 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:50.706609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc83754-f548-4c54-b72c-a6927aea2864 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:50.706609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc83754-f548-4c54-b72c-a6927aea2864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:50.707295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc83754-f548-4c54-b72c-a6927aea2864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:50.707295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc83754-f548-4c54-b72c-a6927aea2864 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:50.716147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-79bcba54-a56b-4a9c-95eb-afa5e0964b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2f63e8394c4ae7b8627c550fe27a89', 'request_id': 'req-79bcba54-a56b-4a9c-95eb-afa5e0964b86'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:50.731141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-79bcba54-a56b-4a9c-95eb-afa5e0964b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2f63e8394c4ae7b8627c550fe27a89', 'request_id': 'req-79bcba54-a56b-4a9c-95eb-afa5e0964b86'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:50.732817 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 889/1766] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:50.733883 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc83754-f548-4c54-b72c-a6927aea2864 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:50.737034 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0bc83754-f548-4c54-b72c-a6927aea2864 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:50.747432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-79bcba54-a56b-4a9c-95eb-afa5e0964b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2f63e8394c4ae7b8627c550fe27a89', 'request_id': 'req-79bcba54-a56b-4a9c-95eb-afa5e0964b86'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:50.924896 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc83754-f548-4c54-b72c-a6927aea2864 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:51.122238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395714f-92ed-4d53-a58b-be57ac8374ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:51.127062 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395714f-92ed-4d53-a58b-be57ac8374ca service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:51.128508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395714f-92ed-4d53-a58b-be57ac8374ca service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:51.129196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395714f-92ed-4d53-a58b-be57ac8374ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:51.166299 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395714f-92ed-4d53-a58b-be57ac8374ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:51.168064 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395714f-92ed-4d53-a58b-be57ac8374ca service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:51.197121 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 890/1767] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:51.939789 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-79bcba54-a56b-4a9c-95eb-afa5e0964b86 admin admin] The token cache is being invalidate because project 5b2f63e8394c4ae7b8627c550fe27a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:08:51.945671 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-79bcba54-a56b-4a9c-95eb-afa5e0964b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:51.945671 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-79bcba54-a56b-4a9c-95eb-afa5e0964b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:51.945671 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 878/1768] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:08:50 2022] DELETE /identity/v3/projects/5b2f63e8394c4ae7b8627c550fe27a89 => generated 0 bytes in 1813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:51.947262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc9f44-9fa1-4a5a-bde3-271b2af44346 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:51.947711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc9f44-9fa1-4a5a-bde3-271b2af44346 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:51.947815 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc9f44-9fa1-4a5a-bde3-271b2af44346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:51.966120 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5efc9f44-9fa1-4a5a-bde3-271b2af44346 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:51.967322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5efc9f44-9fa1-4a5a-bde3-271b2af44346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:52.044477 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 891/1769] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:52.052588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95e8f6-4091-4b76-9082-1de17f930bc3 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:52.052873 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95e8f6-4091-4b76-9082-1de17f930bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:52.053187 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95e8f6-4091-4b76-9082-1de17f930bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:52.078937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ee95e8f6-4091-4b76-9082-1de17f930bc3 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:52.092084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ee95e8f6-4091-4b76-9082-1de17f930bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:52.107363 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 879/1770] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:52.108548 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc9f44-9fa1-4a5a-bde3-271b2af44346 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:52.120721 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc9f44-9fa1-4a5a-bde3-271b2af44346 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:52.126491 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e72ea-d85f-4b40-88d2-6ca57b8bb396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:52.127634 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e72ea-d85f-4b40-88d2-6ca57b8bb396 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:52.127812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e72ea-d85f-4b40-88d2-6ca57b8bb396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:52.128174 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e72ea-d85f-4b40-88d2-6ca57b8bb396 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:52.130634 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e72ea-d85f-4b40-88d2-6ca57b8bb396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:52.133832 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e72ea-d85f-4b40-88d2-6ca57b8bb396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:52.133832 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e72ea-d85f-4b40-88d2-6ca57b8bb396 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:52.152675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95e8f6-4091-4b76-9082-1de17f930bc3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:52.166187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 892/1771] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 11:08:52.170188 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95e8f6-4091-4b76-9082-1de17f930bc3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:52.178991 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb37c1b-816a-48bf-9ac4-42be1c16f923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:52.179769 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb37c1b-816a-48bf-9ac4-42be1c16f923 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:52.180060 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb37c1b-816a-48bf-9ac4-42be1c16f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:52.180338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb37c1b-816a-48bf-9ac4-42be1c16f923 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:52.181298 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb37c1b-816a-48bf-9ac4-42be1c16f923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:52.184011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb37c1b-816a-48bf-9ac4-42be1c16f923 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:52.389077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 880/1772] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:52 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:52.393028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e72ea-d85f-4b40-88d2-6ca57b8bb396 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:52.403685 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e72ea-d85f-4b40-88d2-6ca57b8bb396 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:52.418235 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb37c1b-816a-48bf-9ac4-42be1c16f923 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:52.420377 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9bb37c1b-816a-48bf-9ac4-42be1c16f923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:52.526988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb37c1b-816a-48bf-9ac4-42be1c16f923 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:52.532357 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:52.533513 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:52.534036 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:52.534530 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] PATH_INFO: `/v3/projects/4ac307a514134a4eb93a4bd9b939d7a1` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:52.537125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac307a514134a4eb93a4bd9b939d7a1)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:52.539382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:52.547830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d96201-8648-4f6a-8647-a6b76e928692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:52.549235 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d96201-8648-4f6a-8647-a6b76e928692 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:52.549530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d96201-8648-4f6a-8647-a6b76e928692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:52.549807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d96201-8648-4f6a-8647-a6b76e928692 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:52.550934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d96201-8648-4f6a-8647-a6b76e928692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:52.553657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d96201-8648-4f6a-8647-a6b76e928692 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:52.646194 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 893/1773] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:52 2022] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:52.648408 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d96201-8648-4f6a-8647-a6b76e928692 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:52.660541 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d96201-8648-4f6a-8647-a6b76e928692 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:52.687538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308a88f-67c0-4540-b51b-8638fed48968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:52.689768 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308a88f-67c0-4540-b51b-8638fed48968 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:52.690050 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308a88f-67c0-4540-b51b-8638fed48968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:52.690321 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308a88f-67c0-4540-b51b-8638fed48968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:52.693539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308a88f-67c0-4540-b51b-8638fed48968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:52.695376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308a88f-67c0-4540-b51b-8638fed48968 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:52.702960 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac307a514134a4eb93a4bd9b939d7a1', 'request_id': 'req-54125258-ccce-4c00-982b-6a20ed7bfc61'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:52.710981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac307a514134a4eb93a4bd9b939d7a1', 'request_id': 'req-54125258-ccce-4c00-982b-6a20ed7bfc61'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:52.719945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac307a514134a4eb93a4bd9b939d7a1', 'request_id': 'req-54125258-ccce-4c00-982b-6a20ed7bfc61'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:52.720798 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 894/1774] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:08:52.726179 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308a88f-67c0-4540-b51b-8638fed48968 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:52.746141 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308a88f-67c0-4540-b51b-8638fed48968 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:52.815071 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] The token cache is being invalidate because project 4ac307a514134a4eb93a4bd9b939d7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:08:52.815554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:52.817481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:52.819783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 881/1775] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:08:52 2022] DELETE /identity/v3/projects/4ac307a514134a4eb93a4bd9b939d7a1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:08:52.825346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:52.831111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:52.887881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6597c69-774d-483c-be31-1ad9d39a1271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:52.888541 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6597c69-774d-483c-be31-1ad9d39a1271 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:52.888835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6597c69-774d-483c-be31-1ad9d39a1271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:52.889753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6597c69-774d-483c-be31-1ad9d39a1271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:52.890497 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6597c69-774d-483c-be31-1ad9d39a1271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:52.892154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6597c69-774d-483c-be31-1ad9d39a1271 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:52.903311 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 895/1776] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:52.907689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6597c69-774d-483c-be31-1ad9d39a1271 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:52.909485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e6597c69-774d-483c-be31-1ad9d39a1271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:52.924701 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6597c69-774d-483c-be31-1ad9d39a1271 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:52.945255 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54125258-ccce-4c00-982b-6a20ed7bfc61 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:52.945894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89de58-221c-4cf6-a0c4-65fb5f13c175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:52.945894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89de58-221c-4cf6-a0c4-65fb5f13c175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:52.945894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89de58-221c-4cf6-a0c4-65fb5f13c175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:52.945894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89de58-221c-4cf6-a0c4-65fb5f13c175 admin admin] PATH_INFO: `/v3/projects/3d81241b691c4f708c42bdaf55847e12/users/3202cb142984479a8a251c0264c346ba/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:52.947173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b37732-9357-4aa2-a206-7f18ab1dd805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:52.949009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37732-9357-4aa2-a206-7f18ab1dd805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:52.949389 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37732-9357-4aa2-a206-7f18ab1dd805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:52.949673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37732-9357-4aa2-a206-7f18ab1dd805 admin admin] PATH_INFO: `/v3/users/d809f0f96ce44c3abd685fdf4259ad2a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:52.951104 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b37732-9357-4aa2-a206-7f18ab1dd805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d809f0f96ce44c3abd685fdf4259ad2a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:52.953102 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b37732-9357-4aa2-a206-7f18ab1dd805 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:52.967026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89de58-221c-4cf6-a0c4-65fb5f13c175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d81241b691c4f708c42bdaf55847e12, user_id=3202cb142984479a8a251c0264c346ba, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:52.970148 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89de58-221c-4cf6-a0c4-65fb5f13c175 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:53.034178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 896/1777] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:52 2022] PUT /identity/v3/projects/3d81241b691c4f708c42bdaf55847e12/users/3202cb142984479a8a251c0264c346ba/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:08:53.044931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37953b76-efd5-44ab-8821-19ad3e2d9548 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:53.045425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37953b76-efd5-44ab-8821-19ad3e2d9548 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:53.045876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37953b76-efd5-44ab-8821-19ad3e2d9548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:53.080057 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-37953b76-efd5-44ab-8821-19ad3e2d9548 None None] MFA Rules not processed for user `3202cb142984479a8a251c0264c346ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:53.081498 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-37953b76-efd5-44ab-8821-19ad3e2d9548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:53.148907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 897/1778] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:08:53.159339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-15b37732-9357-4aa2-a206-7f18ab1dd805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd809f0f96ce44c3abd685fdf4259ad2a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:53.160030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-15b37732-9357-4aa2-a206-7f18ab1dd805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd809f0f96ce44c3abd685fdf4259ad2a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:53.161253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-15b37732-9357-4aa2-a206-7f18ab1dd805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd809f0f96ce44c3abd685fdf4259ad2a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:53.162419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37953b76-efd5-44ab-8821-19ad3e2d9548 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:53.163926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-37953b76-efd5-44ab-8821-19ad3e2d9548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:53.237238 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-15b37732-9357-4aa2-a206-7f18ab1dd805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd809f0f96ce44c3abd685fdf4259ad2a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:53.241659 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37953b76-efd5-44ab-8821-19ad3e2d9548 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:53.245544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d401c57-a4a8-4c4e-8bc5-bfd98fb161b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:53.246569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401c57-a4a8-4c4e-8bc5-bfd98fb161b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:53.246859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401c57-a4a8-4c4e-8bc5-bfd98fb161b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:53.247138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401c57-a4a8-4c4e-8bc5-bfd98fb161b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:53.249082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8d401c57-a4a8-4c4e-8bc5-bfd98fb161b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:53.250539 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-15b37732-9357-4aa2-a206-7f18ab1dd805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd809f0f96ce44c3abd685fdf4259ad2a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:53.262828 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d401c57-a4a8-4c4e-8bc5-bfd98fb161b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:53.263445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d401c57-a4a8-4c4e-8bc5-bfd98fb161b1 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:53.266603 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 882/1779] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:08:52 2022] DELETE /identity/v3/users/d809f0f96ce44c3abd685fdf4259ad2a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:53.274748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 898/1780] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:53.292592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b37732-9357-4aa2-a206-7f18ab1dd805 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:53.294014 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-15b37732-9357-4aa2-a206-7f18ab1dd805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:53.373347 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b37732-9357-4aa2-a206-7f18ab1dd805 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:53.378138 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24212-e1d3-4087-8800-9a31c2d1c76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:53.379600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24212-e1d3-4087-8800-9a31c2d1c76c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:53.379869 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24212-e1d3-4087-8800-9a31c2d1c76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:53.380146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24212-e1d3-4087-8800-9a31c2d1c76c admin admin] PATH_INFO: `/v3/users/3202cb142984479a8a251c0264c346ba` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:53.381412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f24212-e1d3-4087-8800-9a31c2d1c76c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3202cb142984479a8a251c0264c346ba)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:53.383471 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f24212-e1d3-4087-8800-9a31c2d1c76c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:53.579140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-40f24212-e1d3-4087-8800-9a31c2d1c76c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3202cb142984479a8a251c0264c346ba'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:53.579952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-40f24212-e1d3-4087-8800-9a31c2d1c76c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3202cb142984479a8a251c0264c346ba'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:53.580636 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-40f24212-e1d3-4087-8800-9a31c2d1c76c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3202cb142984479a8a251c0264c346ba'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:53.655297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-40f24212-e1d3-4087-8800-9a31c2d1c76c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3202cb142984479a8a251c0264c346ba'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:53.669419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-40f24212-e1d3-4087-8800-9a31c2d1c76c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3202cb142984479a8a251c0264c346ba'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:53.686102 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 883/1781] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:08:53 2022] DELETE /identity/v3/users/3202cb142984479a8a251c0264c346ba => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:53.690902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9030b6-1593-4336-a549-f1f98e0d91a1 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:53.690902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9030b6-1593-4336-a549-f1f98e0d91a1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:53.691192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9030b6-1593-4336-a549-f1f98e0d91a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:53.709152 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-ee9030b6-1593-4336-a549-f1f98e0d91a1 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:53.710353 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ee9030b6-1593-4336-a549-f1f98e0d91a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:53.768370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 899/1782] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:53.771669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24212-e1d3-4087-8800-9a31c2d1c76c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:53.780100 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-40f24212-e1d3-4087-8800-9a31c2d1c76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:53.780605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9030b6-1593-4336-a549-f1f98e0d91a1 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:53.782069 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ee9030b6-1593-4336-a549-f1f98e0d91a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:53.804851 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24212-e1d3-4087-8800-9a31c2d1c76c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:53.809522 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81af083-a9ff-4bfe-b26d-791a7969e15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:53.810451 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81af083-a9ff-4bfe-b26d-791a7969e15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:53.810793 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81af083-a9ff-4bfe-b26d-791a7969e15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:53.811133 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81af083-a9ff-4bfe-b26d-791a7969e15b admin admin] PATH_INFO: `/v3/projects/4be621d6b0444b8281c6c4e42e259fc4` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:53.812396 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81af083-a9ff-4bfe-b26d-791a7969e15b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be621d6b0444b8281c6c4e42e259fc4)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:53.814458 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81af083-a9ff-4bfe-b26d-791a7969e15b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:53.853410 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9030b6-1593-4336-a549-f1f98e0d91a1 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:53.857652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ea1d0-045e-425d-83ed-36eac0f6bf2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:53.866195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ea1d0-045e-425d-83ed-36eac0f6bf2f service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:53.866195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ea1d0-045e-425d-83ed-36eac0f6bf2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:53.866195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ea1d0-045e-425d-83ed-36eac0f6bf2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:53.876309 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ea1d0-045e-425d-83ed-36eac0f6bf2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:53.878730 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ea1d0-045e-425d-83ed-36eac0f6bf2f service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:53.894220 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 900/1783] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:08:53.962626 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c81af083-a9ff-4bfe-b26d-791a7969e15b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be621d6b0444b8281c6c4e42e259fc4', 'request_id': 'req-c81af083-a9ff-4bfe-b26d-791a7969e15b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:53.973130 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c81af083-a9ff-4bfe-b26d-791a7969e15b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be621d6b0444b8281c6c4e42e259fc4', 'request_id': 'req-c81af083-a9ff-4bfe-b26d-791a7969e15b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:53.979984 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c81af083-a9ff-4bfe-b26d-791a7969e15b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be621d6b0444b8281c6c4e42e259fc4', 'request_id': 'req-c81af083-a9ff-4bfe-b26d-791a7969e15b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:54.099809 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c81af083-a9ff-4bfe-b26d-791a7969e15b admin admin] The token cache is being invalidate because project 4be621d6b0444b8281c6c4e42e259fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:08:54.100326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c81af083-a9ff-4bfe-b26d-791a7969e15b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:54.103382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c81af083-a9ff-4bfe-b26d-791a7969e15b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:54.105389 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 884/1784] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:08:53 2022] DELETE /identity/v3/projects/4be621d6b0444b8281c6c4e42e259fc4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:54.111102 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99f2f0-e98c-4bfd-b07d-b9df162f801b None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:54.111578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99f2f0-e98c-4bfd-b07d-b9df162f801b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:54.111670 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99f2f0-e98c-4bfd-b07d-b9df162f801b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:54.139679 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5b99f2f0-e98c-4bfd-b07d-b9df162f801b None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:54.140988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5b99f2f0-e98c-4bfd-b07d-b9df162f801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:54.226618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 901/1785] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:54.234587 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a623a77-a422-4211-9128-8b7081e84c70 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:54.235188 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a623a77-a422-4211-9128-8b7081e84c70 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:54.235297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a623a77-a422-4211-9128-8b7081e84c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:54.266366 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8a623a77-a422-4211-9128-8b7081e84c70 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:54.266366 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8a623a77-a422-4211-9128-8b7081e84c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:54.273524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 885/1786] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:54.277359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99f2f0-e98c-4bfd-b07d-b9df162f801b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:54.288508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99f2f0-e98c-4bfd-b07d-b9df162f801b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:54.294213 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8b199-3fc3-4916-8d32-796da43e944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:54.294895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b199-3fc3-4916-8d32-796da43e944b admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:54.295179 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b199-3fc3-4916-8d32-796da43e944b admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:54.295457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b199-3fc3-4916-8d32-796da43e944b admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:54.296281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8b199-3fc3-4916-8d32-796da43e944b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:54.296549 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8b199-3fc3-4916-8d32-796da43e944b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:54.298224 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8b199-3fc3-4916-8d32-796da43e944b admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:54.317236 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 902/1787] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 11:08:54.322421 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a623a77-a422-4211-9128-8b7081e84c70 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:54.333150 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a623a77-a422-4211-9128-8b7081e84c70 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:54.339437 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aedd7-c779-478e-a3e1-97a10a210c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:54.345279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aedd7-c779-478e-a3e1-97a10a210c3f admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:54.345279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aedd7-c779-478e-a3e1-97a10a210c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:54.345279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aedd7-c779-478e-a3e1-97a10a210c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:54.345279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297aedd7-c779-478e-a3e1-97a10a210c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:54.345279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297aedd7-c779-478e-a3e1-97a10a210c3f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:54.486551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 886/1788] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:54 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:54.490367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8b199-3fc3-4916-8d32-796da43e944b admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:54.501098 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8b199-3fc3-4916-8d32-796da43e944b admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:54.567844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b1c34-7ac5-4f2d-99e4-29426990a94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:54.568794 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b1c34-7ac5-4f2d-99e4-29426990a94a admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:54.569276 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b1c34-7ac5-4f2d-99e4-29426990a94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:54.569555 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b1c34-7ac5-4f2d-99e4-29426990a94a admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:54.570551 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b1c34-7ac5-4f2d-99e4-29426990a94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:54.573332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b1c34-7ac5-4f2d-99e4-29426990a94a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:54.691009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aedd7-c779-478e-a3e1-97a10a210c3f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:54.698497 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 903/1789] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:54 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:54.700919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b1c34-7ac5-4f2d-99e4-29426990a94a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:54.704056 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aedd7-c779-478e-a3e1-97a10a210c3f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:54.706407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e39b1c34-7ac5-4f2d-99e4-29426990a94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:54.715674 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ceaa14-58c8-43bc-8c6b-b55d7f7d0e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:54.716803 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ceaa14-58c8-43bc-8c6b-b55d7f7d0e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:54.718517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ceaa14-58c8-43bc-8c6b-b55d7f7d0e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:54.719662 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ceaa14-58c8-43bc-8c6b-b55d7f7d0e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:54.722139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ceaa14-58c8-43bc-8c6b-b55d7f7d0e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:54.727528 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ceaa14-58c8-43bc-8c6b-b55d7f7d0e98 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:54.737845 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b1c34-7ac5-4f2d-99e4-29426990a94a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:54.754522 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 887/1790] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:54.756361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ceaa14-58c8-43bc-8c6b-b55d7f7d0e98 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:54.760916 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12b145-11af-4ef2-9868-c5b397f5cfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:54.761856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b145-11af-4ef2-9868-c5b397f5cfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:54.762182 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b145-11af-4ef2-9868-c5b397f5cfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:54.762986 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b145-11af-4ef2-9868-c5b397f5cfa8 admin admin] PATH_INFO: `/v3/projects/3d81241b691c4f708c42bdaf55847e12` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:54.765105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12b145-11af-4ef2-9868-c5b397f5cfa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d81241b691c4f708c42bdaf55847e12)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:54.767729 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12b145-11af-4ef2-9868-c5b397f5cfa8 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:54.771676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ceaa14-58c8-43bc-8c6b-b55d7f7d0e98 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:54.777533 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba7b2d-749a-4002-b134-24a9138aec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:54.778335 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7b2d-749a-4002-b134-24a9138aec35 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:54.778693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7b2d-749a-4002-b134-24a9138aec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:54.779043 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7b2d-749a-4002-b134-24a9138aec35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:54.779858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba7b2d-749a-4002-b134-24a9138aec35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:54.781613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba7b2d-749a-4002-b134-24a9138aec35 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:54.800517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 888/1791] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:54.800517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba7b2d-749a-4002-b134-24a9138aec35 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:54.828147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba7b2d-749a-4002-b134-24a9138aec35 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:54.846519 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e76cfa-1650-4e8b-baf7-ff3e521e80d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:54.848302 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76cfa-1650-4e8b-baf7-ff3e521e80d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:54.853744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76cfa-1650-4e8b-baf7-ff3e521e80d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:54.853744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76cfa-1650-4e8b-baf7-ff3e521e80d9 admin admin] PATH_INFO: `/v3/projects/744760f0e19c4d6fa0f1a797525daa16/users/c554235dd6564167a040f60d1e873ef5/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:54.868577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e76cfa-1650-4e8b-baf7-ff3e521e80d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=744760f0e19c4d6fa0f1a797525daa16, user_id=c554235dd6564167a040f60d1e873ef5, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:54.879115 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e76cfa-1650-4e8b-baf7-ff3e521e80d9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:54.904427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4a12b145-11af-4ef2-9868-c5b397f5cfa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d81241b691c4f708c42bdaf55847e12', 'request_id': 'req-4a12b145-11af-4ef2-9868-c5b397f5cfa8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:54.981095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 889/1792] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:54 2022] PUT /identity/v3/projects/744760f0e19c4d6fa0f1a797525daa16/users/c554235dd6564167a040f60d1e873ef5/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:54.986748 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151931-4ea2-4bfc-970e-035526b47831 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:54.987151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151931-4ea2-4bfc-970e-035526b47831 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:54.987529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151931-4ea2-4bfc-970e-035526b47831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:55.026426 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4a12b145-11af-4ef2-9868-c5b397f5cfa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d81241b691c4f708c42bdaf55847e12', 'request_id': 'req-4a12b145-11af-4ef2-9868-c5b397f5cfa8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:55.043857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4a12b145-11af-4ef2-9868-c5b397f5cfa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d81241b691c4f708c42bdaf55847e12', 'request_id': 'req-4a12b145-11af-4ef2-9868-c5b397f5cfa8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:55.048535 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e3151931-4ea2-4bfc-970e-035526b47831 None None] MFA Rules not processed for user `c554235dd6564167a040f60d1e873ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:55.052774 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e3151931-4ea2-4bfc-970e-035526b47831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:55.071867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4a12b145-11af-4ef2-9868-c5b397f5cfa8 admin admin] The token cache is being invalidate because project 3d81241b691c4f708c42bdaf55847e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:08:55.072482 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4a12b145-11af-4ef2-9868-c5b397f5cfa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:55.073405 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4a12b145-11af-4ef2-9868-c5b397f5cfa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:55.077103 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 904/1793] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:08:54 2022] DELETE /identity/v3/projects/3d81241b691c4f708c42bdaf55847e12 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:55.082272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57759b15-8586-4969-95a8-74f591394c44 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:55.082816 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57759b15-8586-4969-95a8-74f591394c44 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:55.083290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57759b15-8586-4969-95a8-74f591394c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:55.122688 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-57759b15-8586-4969-95a8-74f591394c44 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:55.124088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-57759b15-8586-4969-95a8-74f591394c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:55.147178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 890/1794] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:55.156468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3151931-4ea2-4bfc-970e-035526b47831 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:55.156468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e3151931-4ea2-4bfc-970e-035526b47831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:55.265597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3151931-4ea2-4bfc-970e-035526b47831 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:55.274264 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 905/1795] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:55.282763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc56c8-946d-45ba-835c-45b42d45c5d3 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:55.283062 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc56c8-946d-45ba-835c-45b42d45c5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:55.283341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc56c8-946d-45ba-835c-45b42d45c5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:55.285219 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88209453-50b3-4053-afc0-8ed0f02202ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:55.287687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209453-50b3-4053-afc0-8ed0f02202ce admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:55.290878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209453-50b3-4053-afc0-8ed0f02202ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:55.290878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209453-50b3-4053-afc0-8ed0f02202ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:55.299428 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88209453-50b3-4053-afc0-8ed0f02202ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:55.302893 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88209453-50b3-4053-afc0-8ed0f02202ce admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:55.336396 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-79fc56c8-946d-45ba-835c-45b42d45c5d3 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:55.338542 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-79fc56c8-946d-45ba-835c-45b42d45c5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:55.359984 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 906/1796] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:08:55.365272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc56c8-946d-45ba-835c-45b42d45c5d3 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:55.390475 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc56c8-946d-45ba-835c-45b42d45c5d3 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:55.398947 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48829ea-485a-4c87-9c4b-89ada632ec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:55.400104 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48829ea-485a-4c87-9c4b-89ada632ec33 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:55.400689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48829ea-485a-4c87-9c4b-89ada632ec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:55.404181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48829ea-485a-4c87-9c4b-89ada632ec33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:55.404181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48829ea-485a-4c87-9c4b-89ada632ec33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:55.404181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48829ea-485a-4c87-9c4b-89ada632ec33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:55.414046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48829ea-485a-4c87-9c4b-89ada632ec33 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:55.434484 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 891/1797] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:55 2022] POST /identity/v3/projects => generated 377 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:55.437776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 907/1798] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 11:08:55.442338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88209453-50b3-4053-afc0-8ed0f02202ce admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:55.442888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48829ea-485a-4c87-9c4b-89ada632ec33 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:55.460856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48829ea-485a-4c87-9c4b-89ada632ec33 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:55.608168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc87814-bf3f-4cb9-a02d-459f3c3679ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:55.609151 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc87814-bf3f-4cb9-a02d-459f3c3679ed admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:55.609151 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc87814-bf3f-4cb9-a02d-459f3c3679ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:55.609488 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc87814-bf3f-4cb9-a02d-459f3c3679ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:55.610192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc87814-bf3f-4cb9-a02d-459f3c3679ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:55.613594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc87814-bf3f-4cb9-a02d-459f3c3679ed admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:55.617189 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88209453-50b3-4053-afc0-8ed0f02202ce admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:55.621343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262edb83-c3de-4dfb-a06d-3b2ae498e19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:55.622529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262edb83-c3de-4dfb-a06d-3b2ae498e19b admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:55.623069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262edb83-c3de-4dfb-a06d-3b2ae498e19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:55.623440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262edb83-c3de-4dfb-a06d-3b2ae498e19b admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:55.624291 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262edb83-c3de-4dfb-a06d-3b2ae498e19b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:55.627730 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262edb83-c3de-4dfb-a06d-3b2ae498e19b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:55.735902 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 892/1799] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:55 2022] POST /identity/v3/users => generated 289 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:55.736347 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262edb83-c3de-4dfb-a06d-3b2ae498e19b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:55.764079 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 908/1800] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:55 2022] POST /identity/v3/projects => generated 359 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:08:55.767632 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc87814-bf3f-4cb9-a02d-459f3c3679ed admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:55.769315 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262edb83-c3de-4dfb-a06d-3b2ae498e19b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:55.885637 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a838d-f1ec-4efd-b920-7d4b4a076284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:55.886332 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a838d-f1ec-4efd-b920-7d4b4a076284 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:55.886614 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a838d-f1ec-4efd-b920-7d4b4a076284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:55.886890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a838d-f1ec-4efd-b920-7d4b4a076284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:55.887630 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a838d-f1ec-4efd-b920-7d4b4a076284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:55.895639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a838d-f1ec-4efd-b920-7d4b4a076284 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:55.901913 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc87814-bf3f-4cb9-a02d-459f3c3679ed admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:55.915190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b29e11-df7d-475c-99be-8faa0d48082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:55.916281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b29e11-df7d-475c-99be-8faa0d48082f admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:55.916671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b29e11-df7d-475c-99be-8faa0d48082f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:55.916957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b29e11-df7d-475c-99be-8faa0d48082f admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:55.917698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b29e11-df7d-475c-99be-8faa0d48082f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:55.919675 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b29e11-df7d-475c-99be-8faa0d48082f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:55.922685 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 893/1801] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:55.927308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a838d-f1ec-4efd-b920-7d4b4a076284 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:55.956613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a838d-f1ec-4efd-b920-7d4b4a076284 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:55.968976 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3396d8-a9a2-4feb-b94c-838c223a0731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:55.969707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3396d8-a9a2-4feb-b94c-838c223a0731 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:55.971473 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3396d8-a9a2-4feb-b94c-838c223a0731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:55.971473 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3396d8-a9a2-4feb-b94c-838c223a0731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:55.971473 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3396d8-a9a2-4feb-b94c-838c223a0731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:55.975576 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3396d8-a9a2-4feb-b94c-838c223a0731 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:55.993252 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 894/1802] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:08:55.996502 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3396d8-a9a2-4feb-b94c-838c223a0731 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:56.023459 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3396d8-a9a2-4feb-b94c-838c223a0731 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:56.035605 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22ac97-002a-4b6e-bffa-5b2ca37c2b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:56.036720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22ac97-002a-4b6e-bffa-5b2ca37c2b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:56.037008 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22ac97-002a-4b6e-bffa-5b2ca37c2b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:56.037306 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22ac97-002a-4b6e-bffa-5b2ca37c2b01 admin admin] PATH_INFO: `/v3/projects/44966f0ef23e4fc1bd73636603a3bb67/users/f1f699a619364e8bab1215115df5433e/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:56.076214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 909/1803] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:55 2022] POST /identity/v3/users => generated 280 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:08:56.078196 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22ac97-002a-4b6e-bffa-5b2ca37c2b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44966f0ef23e4fc1bd73636603a3bb67, user_id=f1f699a619364e8bab1215115df5433e, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:56.080088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b29e11-df7d-475c-99be-8faa0d48082f admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:56.083139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22ac97-002a-4b6e-bffa-5b2ca37c2b01 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:56.096691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b29e11-df7d-475c-99be-8faa0d48082f admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:56.101730 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba3732-06d8-4e4b-9167-b9aa4aff8b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:56.102372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3732-06d8-4e4b-9167-b9aa4aff8b39 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:56.102658 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3732-06d8-4e4b-9167-b9aa4aff8b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:56.102935 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3732-06d8-4e4b-9167-b9aa4aff8b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:56.103659 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba3732-06d8-4e4b-9167-b9aa4aff8b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:56.106536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba3732-06d8-4e4b-9167-b9aa4aff8b39 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:56.122641 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 910/1804] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:08:56.126709 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba3732-06d8-4e4b-9167-b9aa4aff8b39 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:56.140488 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba3732-06d8-4e4b-9167-b9aa4aff8b39 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:56.146427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5de24-7a8c-4700-9ccc-f71222a416f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:56.147102 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5de24-7a8c-4700-9ccc-f71222a416f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:56.147413 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5de24-7a8c-4700-9ccc-f71222a416f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:56.147692 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5de24-7a8c-4700-9ccc-f71222a416f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:56.148503 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5de24-7a8c-4700-9ccc-f71222a416f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:56.150582 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5de24-7a8c-4700-9ccc-f71222a416f8 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:56.165761 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 895/1805] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:55 2022] PUT /identity/v3/projects/44966f0ef23e4fc1bd73636603a3bb67/users/f1f699a619364e8bab1215115df5433e/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:56.171954 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 911/1806] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:08:56.179039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22ac97-002a-4b6e-bffa-5b2ca37c2b01 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:56.183294 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4487a3-c97c-4c23-905e-856c52ad6d11 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:56.183587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4487a3-c97c-4c23-905e-856c52ad6d11 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:56.183863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4487a3-c97c-4c23-905e-856c52ad6d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:56.221468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4d4487a3-c97c-4c23-905e-856c52ad6d11 None None] MFA Rules not processed for user `f1f699a619364e8bab1215115df5433e`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:56.223168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4d4487a3-c97c-4c23-905e-856c52ad6d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:56.320476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22ac97-002a-4b6e-bffa-5b2ca37c2b01 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:56.322823 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 912/1807] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:56.331077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4487a3-c97c-4c23-905e-856c52ad6d11 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:56.333547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f5af5-e659-40ea-84e8-10f3692380d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:56.335051 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f5af5-e659-40ea-84e8-10f3692380d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:56.335051 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f5af5-e659-40ea-84e8-10f3692380d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:56.335051 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f5af5-e659-40ea-84e8-10f3692380d7 admin admin] PATH_INFO: `/v3/projects/efc0174d445d4a1b9a359f7bf35d9c1a/users/38a3063edb0d45648303ce325f9f12d8/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:56.345754 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4487a3-c97c-4c23-905e-856c52ad6d11 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:56.351000 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f385d0-c71e-4bbc-b57f-4761852de1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:56.351977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f385d0-c71e-4bbc-b57f-4761852de1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:56.352212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f385d0-c71e-4bbc-b57f-4761852de1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:56.352538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f385d0-c71e-4bbc-b57f-4761852de1a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:56.353407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f385d0-c71e-4bbc-b57f-4761852de1a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:56.355331 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f385d0-c71e-4bbc-b57f-4761852de1a4 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:56.364683 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f5af5-e659-40ea-84e8-10f3692380d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc0174d445d4a1b9a359f7bf35d9c1a, user_id=38a3063edb0d45648303ce325f9f12d8, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:56.369812 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f5af5-e659-40ea-84e8-10f3692380d7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:56.445501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 913/1808] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:56 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:56.446584 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f385d0-c71e-4bbc-b57f-4761852de1a4 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:56.448179 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-27f385d0-c71e-4bbc-b57f-4761852de1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:56.463322 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 896/1809] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:56 2022] PUT /identity/v3/projects/efc0174d445d4a1b9a359f7bf35d9c1a/users/38a3063edb0d45648303ce325f9f12d8/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:56.463322 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f5af5-e659-40ea-84e8-10f3692380d7 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:56.510828 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f385d0-c71e-4bbc-b57f-4761852de1a4 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:56.524675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f5af5-e659-40ea-84e8-10f3692380d7 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:56.529437 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa6752-5ec8-4d8d-948b-1c0518157a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:56.534760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa6752-5ec8-4d8d-948b-1c0518157a8e admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:56.534760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa6752-5ec8-4d8d-948b-1c0518157a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:56.534760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa6752-5ec8-4d8d-948b-1c0518157a8e admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:56.534760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa6752-5ec8-4d8d-948b-1c0518157a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:56.534760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa6752-5ec8-4d8d-948b-1c0518157a8e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:56.567977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2df50-3c2b-4551-9cf8-5f569f217b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:56.568861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2df50-3c2b-4551-9cf8-5f569f217b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:56.569166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2df50-3c2b-4551-9cf8-5f569f217b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:56.569442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2df50-3c2b-4551-9cf8-5f569f217b08 admin admin] PATH_INFO: `/v3/users/d3fafd9cb21f4d0cb042ea983310aaf8` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:56.570697 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2df50-3c2b-4551-9cf8-5f569f217b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3fafd9cb21f4d0cb042ea983310aaf8)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:56.572628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2df50-3c2b-4551-9cf8-5f569f217b08 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:56.622607 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 897/1810] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:56 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:56.623939 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cddde1-4e6a-408e-a043-4b2c49328de8 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:56.624230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cddde1-4e6a-408e-a043-4b2c49328de8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:56.624505 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cddde1-4e6a-408e-a043-4b2c49328de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:56.653689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-03cddde1-4e6a-408e-a043-4b2c49328de8 None None] MFA Rules not processed for user `38a3063edb0d45648303ce325f9f12d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:56.654918 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-03cddde1-4e6a-408e-a043-4b2c49328de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:56.756483 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 898/1811] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:56 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:56.757459 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cddde1-4e6a-408e-a043-4b2c49328de8 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:56.773845 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cddde1-4e6a-408e-a043-4b2c49328de8 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:56.776012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a6bb2-3f74-4086-9f90-5ad4a1d3820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:56.776683 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a6bb2-3f74-4086-9f90-5ad4a1d3820d admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:56.776967 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a6bb2-3f74-4086-9f90-5ad4a1d3820d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:56.777270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a6bb2-3f74-4086-9f90-5ad4a1d3820d admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:56.777990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a6bb2-3f74-4086-9f90-5ad4a1d3820d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:56.783360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a6bb2-3f74-4086-9f90-5ad4a1d3820d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:56.794085 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 899/1812] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:56.794085 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a6bb2-3f74-4086-9f90-5ad4a1d3820d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:56.797258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-613a6bb2-3f74-4086-9f90-5ad4a1d3820d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:56.801996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-8bc2df50-3c2b-4551-9cf8-5f569f217b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3fafd9cb21f4d0cb042ea983310aaf8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:56.802693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-8bc2df50-3c2b-4551-9cf8-5f569f217b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3fafd9cb21f4d0cb042ea983310aaf8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:56.803307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-8bc2df50-3c2b-4551-9cf8-5f569f217b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3fafd9cb21f4d0cb042ea983310aaf8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:56.815765 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-8bc2df50-3c2b-4551-9cf8-5f569f217b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3fafd9cb21f4d0cb042ea983310aaf8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:56.823795 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-8bc2df50-3c2b-4551-9cf8-5f569f217b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3fafd9cb21f4d0cb042ea983310aaf8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:56.860730 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a6bb2-3f74-4086-9f90-5ad4a1d3820d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:56.867634 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b4d13-c2a5-4bb4-898b-50166e124279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:56.867634 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4d13-c2a5-4bb4-898b-50166e124279 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:56.867634 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4d13-c2a5-4bb4-898b-50166e124279 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:56.867634 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4d13-c2a5-4bb4-898b-50166e124279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:56.868547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e32b4d13-c2a5-4bb4-898b-50166e124279 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:56.879878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b4d13-c2a5-4bb4-898b-50166e124279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:56.881452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b4d13-c2a5-4bb4-898b-50166e124279 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:56.888847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 914/1813] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:08:56 2022] DELETE /identity/v3/users/d3fafd9cb21f4d0cb042ea983310aaf8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:56.889822 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2df50-3c2b-4551-9cf8-5f569f217b08 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:56.896425 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 900/1814] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:56 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:56.896845 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8bc2df50-3c2b-4551-9cf8-5f569f217b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:56.899980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b573d9-4c70-463c-83ce-ce3563cc185e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:56.900288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b573d9-4c70-463c-83ce-ce3563cc185e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:56.900553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b573d9-4c70-463c-83ce-ce3563cc185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:56.917714 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-10b573d9-4c70-463c-83ce-ce3563cc185e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:56.918913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-10b573d9-4c70-463c-83ce-ce3563cc185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:56.964877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2df50-3c2b-4551-9cf8-5f569f217b08 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:56.969883 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb147a-5c95-4c12-a07d-605df7b1611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:56.970777 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb147a-5c95-4c12-a07d-605df7b1611a admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:56.971057 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb147a-5c95-4c12-a07d-605df7b1611a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:56.971332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb147a-5c95-4c12-a07d-605df7b1611a admin admin] PATH_INFO: `/v3/projects/8a51ae77a04845bea783241af36148a2/users/767b01fc02bf4823beb6ea80db226c55/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:56.981020 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 901/1815] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:56.981985 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b573d9-4c70-463c-83ce-ce3563cc185e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:56.987554 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb147a-5c95-4c12-a07d-605df7b1611a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a51ae77a04845bea783241af36148a2, user_id=767b01fc02bf4823beb6ea80db226c55, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:56.990338 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb147a-5c95-4c12-a07d-605df7b1611a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:56.991105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-10b573d9-4c70-463c-83ce-ce3563cc185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:57.002802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b573d9-4c70-463c-83ce-ce3563cc185e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:57.007533 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb90b4-8c1a-4ce6-a736-96a855a133d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:57.008400 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb90b4-8c1a-4ce6-a736-96a855a133d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:57.008682 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb90b4-8c1a-4ce6-a736-96a855a133d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:57.008954 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb90b4-8c1a-4ce6-a736-96a855a133d4 admin admin] PATH_INFO: `/v3/users/38a3063edb0d45648303ce325f9f12d8` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:57.010201 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb90b4-8c1a-4ce6-a736-96a855a133d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a3063edb0d45648303ce325f9f12d8)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:57.012142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb90b4-8c1a-4ce6-a736-96a855a133d4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:57.065952 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 915/1816] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:56 2022] PUT /identity/v3/projects/8a51ae77a04845bea783241af36148a2/users/767b01fc02bf4823beb6ea80db226c55/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:57.066710 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb147a-5c95-4c12-a07d-605df7b1611a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:57.068426 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f8fb147a-5c95-4c12-a07d-605df7b1611a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:57.138327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb147a-5c95-4c12-a07d-605df7b1611a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:57.145471 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d73137-91ae-4e39-9168-13b9be0b5b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:57.146171 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d73137-91ae-4e39-9168-13b9be0b5b89 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:57.146457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d73137-91ae-4e39-9168-13b9be0b5b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:57.146733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d73137-91ae-4e39-9168-13b9be0b5b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:57.211643 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3fb90b4-8c1a-4ce6-a736-96a855a133d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a3063edb0d45648303ce325f9f12d8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:57.212509 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3fb90b4-8c1a-4ce6-a736-96a855a133d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a3063edb0d45648303ce325f9f12d8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:57.213335 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3fb90b4-8c1a-4ce6-a736-96a855a133d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a3063edb0d45648303ce325f9f12d8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:57.221327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d73137-91ae-4e39-9168-13b9be0b5b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:57.223413 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d73137-91ae-4e39-9168-13b9be0b5b89 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:57.233763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 916/1817] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:57.234673 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d73137-91ae-4e39-9168-13b9be0b5b89 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:57.244261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d73137-91ae-4e39-9168-13b9be0b5b89 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:57.249234 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140b174-6141-452f-9b9f-a67059d1e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:57.249909 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140b174-6141-452f-9b9f-a67059d1e190 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:57.250194 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140b174-6141-452f-9b9f-a67059d1e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:57.251823 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140b174-6141-452f-9b9f-a67059d1e190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:57.251823 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140b174-6141-452f-9b9f-a67059d1e190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:57.253145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140b174-6141-452f-9b9f-a67059d1e190 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:57.266422 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 917/1818] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:57.271140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140b174-6141-452f-9b9f-a67059d1e190 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:57.273570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c140b174-6141-452f-9b9f-a67059d1e190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:57.286728 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140b174-6141-452f-9b9f-a67059d1e190 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:57.291944 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901f6c6-c224-46b2-9017-55a215e33b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:57.292823 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f6c6-c224-46b2-9017-55a215e33b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:57.293134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f6c6-c224-46b2-9017-55a215e33b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:57.293414 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f6c6-c224-46b2-9017-55a215e33b58 admin admin] PATH_INFO: `/v3/projects/8a51ae77a04845bea783241af36148a2/users/767b01fc02bf4823beb6ea80db226c55/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:57.296143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901f6c6-c224-46b2-9017-55a215e33b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a51ae77a04845bea783241af36148a2, user_id=767b01fc02bf4823beb6ea80db226c55, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:57.299210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901f6c6-c224-46b2-9017-55a215e33b58 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:57.300915 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3fb90b4-8c1a-4ce6-a736-96a855a133d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a3063edb0d45648303ce325f9f12d8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:57.320942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 918/1819] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:57 2022] PUT /identity/v3/projects/8a51ae77a04845bea783241af36148a2/users/767b01fc02bf4823beb6ea80db226c55/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:57.322807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5c96d-019e-4457-8305-b5e4b99cbe33 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:57.322807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5c96d-019e-4457-8305-b5e4b99cbe33 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:57.323091 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5c96d-019e-4457-8305-b5e4b99cbe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:57.325906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3fb90b4-8c1a-4ce6-a736-96a855a133d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a3063edb0d45648303ce325f9f12d8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:57.351505 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 902/1820] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:08:56 2022] DELETE /identity/v3/users/38a3063edb0d45648303ce325f9f12d8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:57.357999 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-12a5c96d-019e-4457-8305-b5e4b99cbe33 None None] MFA Rules not processed for user `767b01fc02bf4823beb6ea80db226c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:57.360403 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45a9cc-b94d-46d6-a7f0-5dcd3c72c6de None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:57.360655 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-12a5c96d-019e-4457-8305-b5e4b99cbe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:57.361407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45a9cc-b94d-46d6-a7f0-5dcd3c72c6de None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:57.362495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45a9cc-b94d-46d6-a7f0-5dcd3c72c6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:57.386758 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0c45a9cc-b94d-46d6-a7f0-5dcd3c72c6de None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:57.388411 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0c45a9cc-b94d-46d6-a7f0-5dcd3c72c6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:57.460357 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 903/1821] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:57.470923 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45a9cc-b94d-46d6-a7f0-5dcd3c72c6de None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:57.472650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0c45a9cc-b94d-46d6-a7f0-5dcd3c72c6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:57.476885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 919/1822] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:57.488974 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5c96d-019e-4457-8305-b5e4b99cbe33 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:57.491747 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-12a5c96d-019e-4457-8305-b5e4b99cbe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:57.565669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45a9cc-b94d-46d6-a7f0-5dcd3c72c6de None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:57.568918 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5c96d-019e-4457-8305-b5e4b99cbe33 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:57.572749 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabd683-1d47-40fe-a423-7a727e0fdbdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:57.573084 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0d6cb-da8d-4e9c-aef1-64fe8ddf9217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:57.573802 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0d6cb-da8d-4e9c-aef1-64fe8ddf9217 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:57.573929 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabd683-1d47-40fe-a423-7a727e0fdbdc service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:57.574091 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0d6cb-da8d-4e9c-aef1-64fe8ddf9217 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:57.574334 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabd683-1d47-40fe-a423-7a727e0fdbdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:57.574440 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0d6cb-da8d-4e9c-aef1-64fe8ddf9217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:57.575863 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabd683-1d47-40fe-a423-7a727e0fdbdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:57.587326 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0d6cb-da8d-4e9c-aef1-64fe8ddf9217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:57.588792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0d6cb-da8d-4e9c-aef1-64fe8ddf9217 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:57.589628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabd683-1d47-40fe-a423-7a727e0fdbdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:57.591329 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabd683-1d47-40fe-a423-7a727e0fdbdc service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:57.602902 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 904/1823] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:08:57.610062 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 920/1824] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:57.727405 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabd683-1d47-40fe-a423-7a727e0fdbdc service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:57.737153 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabd683-1d47-40fe-a423-7a727e0fdbdc service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:57.741001 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd73a22-e64b-4696-8e2c-8794d70bcfd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:57.741687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd73a22-e64b-4696-8e2c-8794d70bcfd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:57.741970 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd73a22-e64b-4696-8e2c-8794d70bcfd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:57.742249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd73a22-e64b-4696-8e2c-8794d70bcfd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:57.745467 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8dd73a22-e64b-4696-8e2c-8794d70bcfd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:57.806857 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd73a22-e64b-4696-8e2c-8794d70bcfd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:57.808345 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd73a22-e64b-4696-8e2c-8794d70bcfd3 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:57.817371 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 905/1825] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:08:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:08:57.873261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0d6cb-da8d-4e9c-aef1-64fe8ddf9217 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:57.874722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-46c0d6cb-da8d-4e9c-aef1-64fe8ddf9217 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:57.903833 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0d6cb-da8d-4e9c-aef1-64fe8ddf9217 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:57.909867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:57.911348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:57.911628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:57.911904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] PATH_INFO: `/v3/projects/ad0b07f55e734216814626b2ad995c2d` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:57.917423 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad0b07f55e734216814626b2ad995c2d)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:57.922630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:58.074818 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad0b07f55e734216814626b2ad995c2d', 'request_id': 'req-48484789-97fc-4da7-98c3-cf01acc06c1d'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.180121 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad0b07f55e734216814626b2ad995c2d', 'request_id': 'req-48484789-97fc-4da7-98c3-cf01acc06c1d'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.186982 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad0b07f55e734216814626b2ad995c2d', 'request_id': 'req-48484789-97fc-4da7-98c3-cf01acc06c1d'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.197676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] The token cache is being invalidate because project ad0b07f55e734216814626b2ad995c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:08:58.197971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.198653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.200234 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 921/1826] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:08:57 2022] DELETE /identity/v3/projects/ad0b07f55e734216814626b2ad995c2d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:58.204456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd73a22-e64b-4696-8e2c-8794d70bcfd3 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:58.217187 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd73a22-e64b-4696-8e2c-8794d70bcfd3 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:58.218684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:58.222141 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:58.278075 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf0bf5-bcd1-452f-a297-927d9dc7cac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:58.279309 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0bf5-bcd1-452f-a297-927d9dc7cac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:58.279588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0bf5-bcd1-452f-a297-927d9dc7cac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:58.279863 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0bf5-bcd1-452f-a297-927d9dc7cac3 admin admin] PATH_INFO: `/v3/users/08e20d8f2de24f50a31be5b8d17571fe` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:58.281044 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf0bf5-bcd1-452f-a297-927d9dc7cac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e20d8f2de24f50a31be5b8d17571fe)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:58.283151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf0bf5-bcd1-452f-a297-927d9dc7cac3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:58.293808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48484789-97fc-4da7-98c3-cf01acc06c1d admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:58.299059 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a973843-dffb-4843-acab-bdf9ed48e515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:58.300015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a973843-dffb-4843-acab-bdf9ed48e515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:58.300292 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a973843-dffb-4843-acab-bdf9ed48e515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:58.300564 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a973843-dffb-4843-acab-bdf9ed48e515 admin admin] PATH_INFO: `/v3/projects/efc0174d445d4a1b9a359f7bf35d9c1a` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:58.302392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a973843-dffb-4843-acab-bdf9ed48e515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc0174d445d4a1b9a359f7bf35d9c1a)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:58.304363 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a973843-dffb-4843-acab-bdf9ed48e515 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:58.399220 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-9a973843-dffb-4843-acab-bdf9ed48e515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc0174d445d4a1b9a359f7bf35d9c1a', 'request_id': 'req-9a973843-dffb-4843-acab-bdf9ed48e515'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.478742 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e8bf0bf5-bcd1-452f-a297-927d9dc7cac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e20d8f2de24f50a31be5b8d17571fe'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.479397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e8bf0bf5-bcd1-452f-a297-927d9dc7cac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e20d8f2de24f50a31be5b8d17571fe'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.480001 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e8bf0bf5-bcd1-452f-a297-927d9dc7cac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e20d8f2de24f50a31be5b8d17571fe'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.488301 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-9a973843-dffb-4843-acab-bdf9ed48e515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc0174d445d4a1b9a359f7bf35d9c1a', 'request_id': 'req-9a973843-dffb-4843-acab-bdf9ed48e515'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.495306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-9a973843-dffb-4843-acab-bdf9ed48e515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc0174d445d4a1b9a359f7bf35d9c1a', 'request_id': 'req-9a973843-dffb-4843-acab-bdf9ed48e515'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.505522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-9a973843-dffb-4843-acab-bdf9ed48e515 admin admin] The token cache is being invalidate because project efc0174d445d4a1b9a359f7bf35d9c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:08:58.505806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-9a973843-dffb-4843-acab-bdf9ed48e515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.506456 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-9a973843-dffb-4843-acab-bdf9ed48e515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.508044 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 922/1827] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:08:58 2022] DELETE /identity/v3/projects/efc0174d445d4a1b9a359f7bf35d9c1a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:58.512719 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82566111-b684-4d09-901e-1cac9ff03d57 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:58.513007 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82566111-b684-4d09-901e-1cac9ff03d57 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:58.513330 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82566111-b684-4d09-901e-1cac9ff03d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:58.531107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-82566111-b684-4d09-901e-1cac9ff03d57 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:58.532490 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-82566111-b684-4d09-901e-1cac9ff03d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:58.562614 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e8bf0bf5-bcd1-452f-a297-927d9dc7cac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e20d8f2de24f50a31be5b8d17571fe'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.577142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e8bf0bf5-bcd1-452f-a297-927d9dc7cac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e20d8f2de24f50a31be5b8d17571fe'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:58.591534 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 906/1828] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:08:58 2022] DELETE /identity/v3/users/08e20d8f2de24f50a31be5b8d17571fe => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:08:58.597128 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 923/1829] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:08:58.605311 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27c2a6-1144-4737-9043-453f4e5b7253 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:58.605603 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27c2a6-1144-4737-9043-453f4e5b7253 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:58.605886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27c2a6-1144-4737-9043-453f4e5b7253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:58.625214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-bb27c2a6-1144-4737-9043-453f4e5b7253 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:58.626685 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-bb27c2a6-1144-4737-9043-453f4e5b7253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:58.697285 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 907/1830] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:58.701592 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82566111-b684-4d09-901e-1cac9ff03d57 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:58.716592 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82566111-b684-4d09-901e-1cac9ff03d57 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:58.722320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6e289-62d9-4664-9649-749e27d7c2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:58.725315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e289-62d9-4664-9649-749e27d7c2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:58.726081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e289-62d9-4664-9649-749e27d7c2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:58.726662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e289-62d9-4664-9649-749e27d7c2c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:58.727577 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6e289-62d9-4664-9649-749e27d7c2c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:58.728522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6e289-62d9-4664-9649-749e27d7c2c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:58.735232 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6e289-62d9-4664-9649-749e27d7c2c0 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:58.749166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 924/1831] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:08:58.751441 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27c2a6-1144-4737-9043-453f4e5b7253 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:58.763879 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27c2a6-1144-4737-9043-453f4e5b7253 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:58.771896 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46010f-38ce-43ee-9d9d-7de7c6502522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:58.772558 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46010f-38ce-43ee-9d9d-7de7c6502522 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:58.773045 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46010f-38ce-43ee-9d9d-7de7c6502522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:58.773367 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46010f-38ce-43ee-9d9d-7de7c6502522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:58.774108 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46010f-38ce-43ee-9d9d-7de7c6502522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:58.776161 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46010f-38ce-43ee-9d9d-7de7c6502522 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:58.908345 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 908/1832] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:58 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:58.909543 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6e289-62d9-4664-9649-749e27d7c2c0 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:58.920592 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6e289-62d9-4664-9649-749e27d7c2c0 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:58.984874 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6d2a-ab7b-4046-a464-451ddfb86745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:58.985748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6d2a-ab7b-4046-a464-451ddfb86745 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:58.986105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6d2a-ab7b-4046-a464-451ddfb86745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:58.989485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6d2a-ab7b-4046-a464-451ddfb86745 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:58.989485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6d2a-ab7b-4046-a464-451ddfb86745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:58.989485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6d2a-ab7b-4046-a464-451ddfb86745 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:59.116424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 925/1833] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:58 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:59.117660 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46010f-38ce-43ee-9d9d-7de7c6502522 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:59.127763 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46010f-38ce-43ee-9d9d-7de7c6502522 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:59.133346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6644a-e7bd-401f-9472-d0ea5d7da8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:59.134122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6644a-e7bd-401f-9472-d0ea5d7da8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.137353 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6644a-e7bd-401f-9472-d0ea5d7da8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.138044 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6644a-e7bd-401f-9472-d0ea5d7da8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.138858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6644a-e7bd-401f-9472-d0ea5d7da8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:59.140569 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6644a-e7bd-401f-9472-d0ea5d7da8a7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:59.153362 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 909/1834] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:59.157029 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6d2a-ab7b-4046-a464-451ddfb86745 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:59.167609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6d2a-ab7b-4046-a464-451ddfb86745 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:59.172396 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786655f-b397-4197-9b3d-38ff431eb943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:59.173157 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786655f-b397-4197-9b3d-38ff431eb943 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.173506 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786655f-b397-4197-9b3d-38ff431eb943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.174102 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786655f-b397-4197-9b3d-38ff431eb943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.174951 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786655f-b397-4197-9b3d-38ff431eb943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:59.177228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786655f-b397-4197-9b3d-38ff431eb943 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:59.188465 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 926/1835] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:08:59.196988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6644a-e7bd-401f-9472-d0ea5d7da8a7 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:59.207297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6644a-e7bd-401f-9472-d0ea5d7da8a7 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:59.216481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d8bc1-fbca-4676-9c9f-6255a878721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:59.217847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d8bc1-fbca-4676-9c9f-6255a878721b admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.218131 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d8bc1-fbca-4676-9c9f-6255a878721b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.218415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d8bc1-fbca-4676-9c9f-6255a878721b admin admin] PATH_INFO: `/v3/projects/88ffafbb07fd4990b9a019c6f54b10e4/users/5087bb57b9304e6c9009e4c593abaaaf/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.243649 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d8bc1-fbca-4676-9c9f-6255a878721b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ffafbb07fd4990b9a019c6f54b10e4, user_id=5087bb57b9304e6c9009e4c593abaaaf, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:59.254151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d8bc1-fbca-4676-9c9f-6255a878721b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:59.369881 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 910/1836] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:59 2022] PUT /identity/v3/projects/88ffafbb07fd4990b9a019c6f54b10e4/users/5087bb57b9304e6c9009e4c593abaaaf/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:59.370512 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786655f-b397-4197-9b3d-38ff431eb943 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:59.372349 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b786655f-b397-4197-9b3d-38ff431eb943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:59.382320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122931c-4fbb-4345-b407-dac3276c082e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.386586 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786655f-b397-4197-9b3d-38ff431eb943 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:59.387080 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122931c-4fbb-4345-b407-dac3276c082e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.387466 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122931c-4fbb-4345-b407-dac3276c082e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.420977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a122931c-4fbb-4345-b407-dac3276c082e None None] MFA Rules not processed for user `5087bb57b9304e6c9009e4c593abaaaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:59.422436 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a122931c-4fbb-4345-b407-dac3276c082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:59.443780 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:59.444654 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.444937 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.445243 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f admin admin] PATH_INFO: `/v3/projects/3a2e53cd8e0840a3b515d4052da436a2` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.446429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2e53cd8e0840a3b515d4052da436a2)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:59.448347 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:59.486147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 911/1837] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:08:59.490744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122931c-4fbb-4345-b407-dac3276c082e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:59.500680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122931c-4fbb-4345-b407-dac3276c082e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:59.505754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e0230-26b0-40f2-88db-1c97be8f2827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:59.506371 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e0230-26b0-40f2-88db-1c97be8f2827 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.506649 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e0230-26b0-40f2-88db-1c97be8f2827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.506918 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e0230-26b0-40f2-88db-1c97be8f2827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.507588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e0230-26b0-40f2-88db-1c97be8f2827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:59.509529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e0230-26b0-40f2-88db-1c97be8f2827 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:59.545491 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2e53cd8e0840a3b515d4052da436a2', 'request_id': 'req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:59.575310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 912/1838] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:59 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:08:59.579173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e0230-26b0-40f2-88db-1c97be8f2827 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:59.614682 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2e53cd8e0840a3b515d4052da436a2', 'request_id': 'req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:59.621287 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2e53cd8e0840a3b515d4052da436a2', 'request_id': 'req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:59.632062 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f admin admin] The token cache is being invalidate because project 3a2e53cd8e0840a3b515d4052da436a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:08:59.632350 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:59.632990 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f8ea7afd-4b5c-4d24-b168-4ce92dfb088f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:08:59.634581 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 927/1839] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:08:59 2022] DELETE /identity/v3/projects/3a2e53cd8e0840a3b515d4052da436a2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:08:59.638053 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e0230-26b0-40f2-88db-1c97be8f2827 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:59.640115 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72300649-e700-4ed4-a190-0201e0a43a2b None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.640400 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72300649-e700-4ed4-a190-0201e0a43a2b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.640676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72300649-e700-4ed4-a190-0201e0a43a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.643087 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ad284-fe20-4170-a6d1-0e1dc82fcc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:59.643760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ad284-fe20-4170-a6d1-0e1dc82fcc83 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.644041 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ad284-fe20-4170-a6d1-0e1dc82fcc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.644317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ad284-fe20-4170-a6d1-0e1dc82fcc83 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.645003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ad284-fe20-4170-a6d1-0e1dc82fcc83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:59.647036 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ad284-fe20-4170-a6d1-0e1dc82fcc83 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:59.659538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-72300649-e700-4ed4-a190-0201e0a43a2b None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:59.660748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-72300649-e700-4ed4-a190-0201e0a43a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:59.668836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 928/1840] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:08:59.677305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa38b79-78d8-4dca-b0ff-c34700d8f687 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.677599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa38b79-78d8-4dca-b0ff-c34700d8f687 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.677871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa38b79-78d8-4dca-b0ff-c34700d8f687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.695866 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-daa38b79-78d8-4dca-b0ff-c34700d8f687 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:08:59.697070 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-daa38b79-78d8-4dca-b0ff-c34700d8f687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:59.705012 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 929/1841] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:08:59.708918 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa38b79-78d8-4dca-b0ff-c34700d8f687 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:59.717686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa38b79-78d8-4dca-b0ff-c34700d8f687 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:59.722464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede2f02-5bfc-4e9f-bf2c-07dd7f754679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:59.723176 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2f02-5bfc-4e9f-bf2c-07dd7f754679 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.723614 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 913/1842] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:59 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:59.723745 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2f02-5bfc-4e9f-bf2c-07dd7f754679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.723862 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2f02-5bfc-4e9f-bf2c-07dd7f754679 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.724645 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede2f02-5bfc-4e9f-bf2c-07dd7f754679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:08:59.724976 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede2f02-5bfc-4e9f-bf2c-07dd7f754679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:59.726609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede2f02-5bfc-4e9f-bf2c-07dd7f754679 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:59.732686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ad284-fe20-4170-a6d1-0e1dc82fcc83 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:59.734544 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4b1ad284-fe20-4170-a6d1-0e1dc82fcc83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:08:59.739041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 930/1843] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 11:08:59.742873 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede2f02-5bfc-4e9f-bf2c-07dd7f754679 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:59.747035 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ad284-fe20-4170-a6d1-0e1dc82fcc83 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:59.751819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5c78d-2439-4539-a5e3-139678ea1421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:59.752403 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede2f02-5bfc-4e9f-bf2c-07dd7f754679 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:59.752519 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5c78d-2439-4539-a5e3-139678ea1421 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.752738 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5c78d-2439-4539-a5e3-139678ea1421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.753013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5c78d-2439-4539-a5e3-139678ea1421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.754450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5c78d-2439-4539-a5e3-139678ea1421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:59.757141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5c78d-2439-4539-a5e3-139678ea1421 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:59.757831 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca7990-bb8b-49b9-9120-24122f41fa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:59.758734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca7990-bb8b-49b9-9120-24122f41fa13 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.758854 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca7990-bb8b-49b9-9120-24122f41fa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.759137 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca7990-bb8b-49b9-9120-24122f41fa13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.759827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca7990-bb8b-49b9-9120-24122f41fa13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:59.761788 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca7990-bb8b-49b9-9120-24122f41fa13 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:59.770049 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 914/1844] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:08:59.773885 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5c78d-2439-4539-a5e3-139678ea1421 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:59.786741 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5c78d-2439-4539-a5e3-139678ea1421 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:59.791659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08205923-3206-4447-9aa0-c0587c8bf110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:59.792361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08205923-3206-4447-9aa0-c0587c8bf110 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.793223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08205923-3206-4447-9aa0-c0587c8bf110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.793223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08205923-3206-4447-9aa0-c0587c8bf110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.794282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08205923-3206-4447-9aa0-c0587c8bf110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:59.796706 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08205923-3206-4447-9aa0-c0587c8bf110 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:59.808831 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 915/1845] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:08:59.814946 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08205923-3206-4447-9aa0-c0587c8bf110 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:59.849587 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08205923-3206-4447-9aa0-c0587c8bf110 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:59.862647 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 931/1846] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:08:59 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:08:59.863339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12650571-39ca-4682-a114-e7411af131a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:59.864442 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12650571-39ca-4682-a114-e7411af131a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.885259 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12650571-39ca-4682-a114-e7411af131a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.885259 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12650571-39ca-4682-a114-e7411af131a9 admin admin] PATH_INFO: `/v3/projects/87f665ad42984fddb4254f2a49c7b67d/users/367af99c844c4854be33b9521f37111c/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.885259 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12650571-39ca-4682-a114-e7411af131a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f665ad42984fddb4254f2a49c7b67d, user_id=367af99c844c4854be33b9521f37111c, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:59.886676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12650571-39ca-4682-a114-e7411af131a9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:59.888355 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca7990-bb8b-49b9-9120-24122f41fa13 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:08:59.957203 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca7990-bb8b-49b9-9120-24122f41fa13 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:08:59.963435 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc728c8-7349-4795-a674-322603c284e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:08:59.965152 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc728c8-7349-4795-a674-322603c284e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.965447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc728c8-7349-4795-a674-322603c284e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.965731 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc728c8-7349-4795-a674-322603c284e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:08:59.966597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc728c8-7349-4795-a674-322603c284e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:08:59.969309 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc728c8-7349-4795-a674-322603c284e0 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:08:59.978731 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 916/1847] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:08:59 2022] PUT /identity/v3/projects/87f665ad42984fddb4254f2a49c7b67d/users/367af99c844c4854be33b9521f37111c/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:08:59.982406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715396-3663-4444-924c-15483fed73cf None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:08:59.982406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715396-3663-4444-924c-15483fed73cf None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:08:59.982406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715396-3663-4444-924c-15483fed73cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:00.016758 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5b715396-3663-4444-924c-15483fed73cf None None] MFA Rules not processed for user `367af99c844c4854be33b9521f37111c`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:00.016758 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5b715396-3663-4444-924c-15483fed73cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:00.077925 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 932/1848] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:08:59 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:00.082336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc728c8-7349-4795-a674-322603c284e0 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:00.103973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 917/1849] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:08:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:09:00.105364 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715396-3663-4444-924c-15483fed73cf None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:00.108477 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc728c8-7349-4795-a674-322603c284e0 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:00.205640 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715396-3663-4444-924c-15483fed73cf None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:00.221017 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d03ff0-ff95-47f6-a408-1aff3bcf73bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:00.223809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a9420-1c38-4c18-bfe5-6a4d7404dc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:00.225165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a9420-1c38-4c18-bfe5-6a4d7404dc1c admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:00.225165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a9420-1c38-4c18-bfe5-6a4d7404dc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:00.225452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a9420-1c38-4c18-bfe5-6a4d7404dc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:00.226193 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a9420-1c38-4c18-bfe5-6a4d7404dc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:00.228581 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a9420-1c38-4c18-bfe5-6a4d7404dc1c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:00.230943 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d03ff0-ff95-47f6-a408-1aff3bcf73bf admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:00.242965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d03ff0-ff95-47f6-a408-1aff3bcf73bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:00.242965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d03ff0-ff95-47f6-a408-1aff3bcf73bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:00.242965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d03ff0-ff95-47f6-a408-1aff3bcf73bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:00.243299 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 933/1850] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:00.244726 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d03ff0-ff95-47f6-a408-1aff3bcf73bf admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:00.245183 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a9420-1c38-4c18-bfe5-6a4d7404dc1c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:00.257707 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a9420-1c38-4c18-bfe5-6a4d7404dc1c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:00.264203 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aa9d8-2e63-4622-b77e-e44ff8a202d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:00.271644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aa9d8-2e63-4622-b77e-e44ff8a202d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:00.271644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aa9d8-2e63-4622-b77e-e44ff8a202d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:00.271644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aa9d8-2e63-4622-b77e-e44ff8a202d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:00.271644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307aa9d8-2e63-4622-b77e-e44ff8a202d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:00.271644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307aa9d8-2e63-4622-b77e-e44ff8a202d6 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:00.284604 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 934/1851] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:00.288505 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aa9d8-2e63-4622-b77e-e44ff8a202d6 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:00.302176 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aa9d8-2e63-4622-b77e-e44ff8a202d6 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:00.309017 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ba7d7-1423-4980-adab-ba22e0321330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:00.321291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ba7d7-1423-4980-adab-ba22e0321330 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:00.326552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ba7d7-1423-4980-adab-ba22e0321330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:00.326552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ba7d7-1423-4980-adab-ba22e0321330 admin admin] PATH_INFO: `/v3/projects/b8aa1750add44ca8a70bc6a11cbb7c5d/users/9a38f4a1da9c4b0286aaa5a027d918c3/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:00.346333 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ba7d7-1423-4980-adab-ba22e0321330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8aa1750add44ca8a70bc6a11cbb7c5d, user_id=9a38f4a1da9c4b0286aaa5a027d918c3, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:00.349220 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ba7d7-1423-4980-adab-ba22e0321330 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:00.387039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 918/1852] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:00 2022] POST /identity/v3/projects => generated 381 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:09:00.387039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d03ff0-ff95-47f6-a408-1aff3bcf73bf admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:00.387649 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-40d03ff0-ff95-47f6-a408-1aff3bcf73bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:00.426653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 935/1853] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:00 2022] PUT /identity/v3/projects/b8aa1750add44ca8a70bc6a11cbb7c5d/users/9a38f4a1da9c4b0286aaa5a027d918c3/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:00.427720 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ba7d7-1423-4980-adab-ba22e0321330 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:00.481665 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d03ff0-ff95-47f6-a408-1aff3bcf73bf admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:00.528733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ba7d7-1423-4980-adab-ba22e0321330 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:00.534381 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad1530-0032-482f-950a-bec2bf232fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:00.535288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad1530-0032-482f-950a-bec2bf232fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:00.535704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad1530-0032-482f-950a-bec2bf232fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:00.536331 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad1530-0032-482f-950a-bec2bf232fcc admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:00.537226 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad1530-0032-482f-950a-bec2bf232fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:00.539340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad1530-0032-482f-950a-bec2bf232fcc admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:00.561716 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4edd71-6732-4d73-83e8-0fa65f2ea589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:00.563631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4edd71-6732-4d73-83e8-0fa65f2ea589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:00.563631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4edd71-6732-4d73-83e8-0fa65f2ea589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:00.563631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4edd71-6732-4d73-83e8-0fa65f2ea589 admin admin] PATH_INFO: `/v3/users/d273326dd0174a6397ab96d34ff13867` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:00.565037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4edd71-6732-4d73-83e8-0fa65f2ea589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d273326dd0174a6397ab96d34ff13867)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:00.568192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4edd71-6732-4d73-83e8-0fa65f2ea589 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:00.628264 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 936/1854] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:00 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:00.631187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1d023-f1ca-4862-83cc-878303b7873c None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:00.631187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1d023-f1ca-4862-83cc-878303b7873c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:00.631187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1d023-f1ca-4862-83cc-878303b7873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:00.686120 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e3a1d023-f1ca-4862-83cc-878303b7873c None None] MFA Rules not processed for user `9a38f4a1da9c4b0286aaa5a027d918c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:00.687370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e3a1d023-f1ca-4862-83cc-878303b7873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:00.755360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7a4edd71-6732-4d73-83e8-0fa65f2ea589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd273326dd0174a6397ab96d34ff13867'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:00.756040 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7a4edd71-6732-4d73-83e8-0fa65f2ea589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd273326dd0174a6397ab96d34ff13867'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:00.756671 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7a4edd71-6732-4d73-83e8-0fa65f2ea589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd273326dd0174a6397ab96d34ff13867'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:00.776117 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 937/1855] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:00.777106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1d023-f1ca-4862-83cc-878303b7873c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:00.808455 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1d023-f1ca-4862-83cc-878303b7873c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:00.808455 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851f910-aa5b-4766-87e2-1953d996506a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:00.808455 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851f910-aa5b-4766-87e2-1953d996506a admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:00.808455 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851f910-aa5b-4766-87e2-1953d996506a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:00.812926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851f910-aa5b-4766-87e2-1953d996506a admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:00.812926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851f910-aa5b-4766-87e2-1953d996506a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:00.812926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851f910-aa5b-4766-87e2-1953d996506a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:00.827138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 938/1856] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:00.827833 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851f910-aa5b-4766-87e2-1953d996506a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:00.832709 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7a4edd71-6732-4d73-83e8-0fa65f2ea589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd273326dd0174a6397ab96d34ff13867'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:00.835655 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3851f910-aa5b-4766-87e2-1953d996506a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:00.848860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7a4edd71-6732-4d73-83e8-0fa65f2ea589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd273326dd0174a6397ab96d34ff13867'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:00.874139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 919/1857] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:00 2022] DELETE /identity/v3/users/d273326dd0174a6397ab96d34ff13867 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:00.875569 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4edd71-6732-4d73-83e8-0fa65f2ea589 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:00.880485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7a4edd71-6732-4d73-83e8-0fa65f2ea589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:00.880843 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851f910-aa5b-4766-87e2-1953d996506a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:00.995590 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02240b6-3718-44f7-b957-062f8aad0a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:00.996315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02240b6-3718-44f7-b957-062f8aad0a79 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:00.996603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02240b6-3718-44f7-b957-062f8aad0a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:00.996873 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02240b6-3718-44f7-b957-062f8aad0a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:00.997738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02240b6-3718-44f7-b957-062f8aad0a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:01.000764 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02240b6-3718-44f7-b957-062f8aad0a79 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:01.006265 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4edd71-6732-4d73-83e8-0fa65f2ea589 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:01.011700 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bce63f-f3c4-4b2c-be68-1a660b20c3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:01.013253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bce63f-f3c4-4b2c-be68-1a660b20c3ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:01.013542 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bce63f-f3c4-4b2c-be68-1a660b20c3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:01.013821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bce63f-f3c4-4b2c-be68-1a660b20c3ab admin admin] PATH_INFO: `/v3/projects/282e6c2d857842b8bdc6d6aeb861b25e/users/1c5557bde4c94b44848f030c06d992e4/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:01.030933 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bce63f-f3c4-4b2c-be68-1a660b20c3ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=282e6c2d857842b8bdc6d6aeb861b25e, user_id=1c5557bde4c94b44848f030c06d992e4, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:01.038777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bce63f-f3c4-4b2c-be68-1a660b20c3ab admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:01.086295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 939/1858] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:00 2022] POST /identity/v3/projects => generated 367 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:01.086295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142d4b4-b8b7-47bd-885c-054dcc455a6f None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:01.086295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142d4b4-b8b7-47bd-885c-054dcc455a6f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:01.086295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142d4b4-b8b7-47bd-885c-054dcc455a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:01.104145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0142d4b4-b8b7-47bd-885c-054dcc455a6f None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:01.105728 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0142d4b4-b8b7-47bd-885c-054dcc455a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:01.124138 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 920/1859] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:00 2022] PUT /identity/v3/projects/282e6c2d857842b8bdc6d6aeb861b25e/users/1c5557bde4c94b44848f030c06d992e4/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:01.124485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bce63f-f3c4-4b2c-be68-1a660b20c3ab admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:01.194029 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 940/1860] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:01.195297 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142d4b4-b8b7-47bd-885c-054dcc455a6f None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:01.207946 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142d4b4-b8b7-47bd-885c-054dcc455a6f None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:01.239000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bce63f-f3c4-4b2c-be68-1a660b20c3ab admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:01.249244 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fffbc5-f32f-4ec4-bab8-b412d2f49758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:01.250062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fffbc5-f32f-4ec4-bab8-b412d2f49758 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:01.250501 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fffbc5-f32f-4ec4-bab8-b412d2f49758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:01.250999 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fffbc5-f32f-4ec4-bab8-b412d2f49758 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:01.251709 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fffbc5-f32f-4ec4-bab8-b412d2f49758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:01.254919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fffbc5-f32f-4ec4-bab8-b412d2f49758 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:01.290660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fc7e2-799e-4a60-9cc1-ebc67b2c4e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:01.292386 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fc7e2-799e-4a60-9cc1-ebc67b2c4e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:01.292485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fc7e2-799e-4a60-9cc1-ebc67b2c4e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:01.293331 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fc7e2-799e-4a60-9cc1-ebc67b2c4e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:01.294219 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fc7e2-799e-4a60-9cc1-ebc67b2c4e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:01.296190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fc7e2-799e-4a60-9cc1-ebc67b2c4e05 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:01.307733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 941/1861] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:01.310486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fc7e2-799e-4a60-9cc1-ebc67b2c4e05 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:01.311650 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b26fc7e2-799e-4a60-9cc1-ebc67b2c4e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:01.363273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 921/1862] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:01 2022] POST /identity/v3/users => generated 290 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:01.364147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fffbc5-f32f-4ec4-bab8-b412d2f49758 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:01.368183 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fc7e2-799e-4a60-9cc1-ebc67b2c4e05 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:01.371941 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f09d8-0689-441f-8e98-81ce9c0e628b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:01.372595 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f09d8-0689-441f-8e98-81ce9c0e628b service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:01.372880 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f09d8-0689-441f-8e98-81ce9c0e628b service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:01.373192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f09d8-0689-441f-8e98-81ce9c0e628b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:01.375773 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fffbc5-f32f-4ec4-bab8-b412d2f49758 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:01.381470 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56063e7b-d4a4-4110-8d53-f5744155a062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:01.382752 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56063e7b-d4a4-4110-8d53-f5744155a062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:01.382752 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56063e7b-d4a4-4110-8d53-f5744155a062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:01.382922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f09d8-0689-441f-8e98-81ce9c0e628b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:01.383004 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56063e7b-d4a4-4110-8d53-f5744155a062 admin admin] PATH_INFO: `/v3/projects/282e6c2d857842b8bdc6d6aeb861b25e/users/1c5557bde4c94b44848f030c06d992e4/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:01.384203 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f09d8-0689-441f-8e98-81ce9c0e628b service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:01.384891 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56063e7b-d4a4-4110-8d53-f5744155a062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=282e6c2d857842b8bdc6d6aeb861b25e, user_id=1c5557bde4c94b44848f030c06d992e4, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:01.387611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56063e7b-d4a4-4110-8d53-f5744155a062 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:01.393806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 942/1863] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:01.395077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f09d8-0689-441f-8e98-81ce9c0e628b service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:01.401873 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 922/1864] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:01 2022] PUT /identity/v3/projects/282e6c2d857842b8bdc6d6aeb861b25e/users/1c5557bde4c94b44848f030c06d992e4/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:01.408746 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f09d8-0689-441f-8e98-81ce9c0e628b service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:01.418404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ded72a-01f1-4bf8-af5b-4415b4e71ce3 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:01.418696 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ded72a-01f1-4bf8-af5b-4415b4e71ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:01.418976 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ded72a-01f1-4bf8-af5b-4415b4e71ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:01.448958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-26ded72a-01f1-4bf8-af5b-4415b4e71ce3 None None] MFA Rules not processed for user `1c5557bde4c94b44848f030c06d992e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:01.450112 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-26ded72a-01f1-4bf8-af5b-4415b4e71ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:01.484280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b4444-e62e-4e8a-8183-185a1387a7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:01.484966 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b4444-e62e-4e8a-8183-185a1387a7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:01.485285 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b4444-e62e-4e8a-8183-185a1387a7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:01.485569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b4444-e62e-4e8a-8183-185a1387a7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:01.486302 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b4444-e62e-4e8a-8183-185a1387a7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:01.487936 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b4444-e62e-4e8a-8183-185a1387a7c9 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:01.499822 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 943/1865] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:01.503869 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b4444-e62e-4e8a-8183-185a1387a7c9 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:01.513999 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b4444-e62e-4e8a-8183-185a1387a7c9 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:01.523962 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f6ce2-4c27-4ab1-a7b4-fde06638009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:01.525241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f6ce2-4c27-4ab1-a7b4-fde06638009d admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:01.525723 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f6ce2-4c27-4ab1-a7b4-fde06638009d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:01.526179 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f6ce2-4c27-4ab1-a7b4-fde06638009d admin admin] PATH_INFO: `/v3/projects/ab496976ebaa4d28aff793cce9bab253/users/865fcbe7839d4a70a3bca4adc3fecfd8/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:01.545271 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 923/1866] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:01.546907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f6ce2-4c27-4ab1-a7b4-fde06638009d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab496976ebaa4d28aff793cce9bab253, user_id=865fcbe7839d4a70a3bca4adc3fecfd8, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:01.550295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f6ce2-4c27-4ab1-a7b4-fde06638009d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:01.557009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ded72a-01f1-4bf8-af5b-4415b4e71ce3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:01.558411 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-26ded72a-01f1-4bf8-af5b-4415b4e71ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:01.628518 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ded72a-01f1-4bf8-af5b-4415b4e71ce3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:01.634160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2830ab-12f2-4e1c-b8ad-9ec1c3ecc1d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:01.635831 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2830ab-12f2-4e1c-b8ad-9ec1c3ecc1d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:01.635831 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2830ab-12f2-4e1c-b8ad-9ec1c3ecc1d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:01.636012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2830ab-12f2-4e1c-b8ad-9ec1c3ecc1d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:01.638286 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6e2830ab-12f2-4e1c-b8ad-9ec1c3ecc1d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:01.648824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 944/1867] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:01 2022] PUT /identity/v3/projects/ab496976ebaa4d28aff793cce9bab253/users/865fcbe7839d4a70a3bca4adc3fecfd8/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:01.652748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f6ce2-4c27-4ab1-a7b4-fde06638009d admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:01.733934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2830ab-12f2-4e1c-b8ad-9ec1c3ecc1d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:01.735435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2830ab-12f2-4e1c-b8ad-9ec1c3ecc1d9 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:01.742961 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f6ce2-4c27-4ab1-a7b4-fde06638009d admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:01.745894 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 924/1868] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:09:01.750207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b27be9-6526-445d-8777-2e3661dd9460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:01.750890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b27be9-6526-445d-8777-2e3661dd9460 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:01.751244 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b27be9-6526-445d-8777-2e3661dd9460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:01.751440 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b27be9-6526-445d-8777-2e3661dd9460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:01.752201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b27be9-6526-445d-8777-2e3661dd9460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:01.754424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b27be9-6526-445d-8777-2e3661dd9460 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:01.768061 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 945/1869] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:01.773143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2830ab-12f2-4e1c-b8ad-9ec1c3ecc1d9 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:01.790980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2830ab-12f2-4e1c-b8ad-9ec1c3ecc1d9 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:01.800192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f203e3-bef1-4e09-86c3-35af8716003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:01.800192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f203e3-bef1-4e09-86c3-35af8716003f admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:01.800192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f203e3-bef1-4e09-86c3-35af8716003f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:01.800192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f203e3-bef1-4e09-86c3-35af8716003f admin admin] PATH_INFO: `/v3/projects/ab496976ebaa4d28aff793cce9bab253/users/865fcbe7839d4a70a3bca4adc3fecfd8/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:01.801493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f203e3-bef1-4e09-86c3-35af8716003f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab496976ebaa4d28aff793cce9bab253, user_id=865fcbe7839d4a70a3bca4adc3fecfd8, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:01.804227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f203e3-bef1-4e09-86c3-35af8716003f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:01.816146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 925/1870] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:01 2022] PUT /identity/v3/projects/ab496976ebaa4d28aff793cce9bab253/users/865fcbe7839d4a70a3bca4adc3fecfd8/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:01.831653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc69fdf-6752-4b6c-8275-89d4ede75024 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:01.831653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc69fdf-6752-4b6c-8275-89d4ede75024 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:01.831653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc69fdf-6752-4b6c-8275-89d4ede75024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:01.857104 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-adc69fdf-6752-4b6c-8275-89d4ede75024 None None] MFA Rules not processed for user `865fcbe7839d4a70a3bca4adc3fecfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:01.859937 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-adc69fdf-6752-4b6c-8275-89d4ede75024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:01.885315 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f203e3-bef1-4e09-86c3-35af8716003f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:01.887989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-70f203e3-bef1-4e09-86c3-35af8716003f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:01.951232 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 946/1871] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:01.972010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f203e3-bef1-4e09-86c3-35af8716003f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:01.980802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:01.981692 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:01.981974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:01.982245 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc admin admin] PATH_INFO: `/v3/projects/bb5d4f6832ac48a1a5b41f45cead3064` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:01.983653 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5d4f6832ac48a1a5b41f45cead3064)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:01.986362 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:01.987421 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc69fdf-6752-4b6c-8275-89d4ede75024 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:01.989964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-adc69fdf-6752-4b6c-8275-89d4ede75024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:02.063164 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc69fdf-6752-4b6c-8275-89d4ede75024 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:02.066872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a9b67-640c-4dee-9386-92dd8521fd63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:02.067522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9b67-640c-4dee-9386-92dd8521fd63 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:02.067805 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9b67-640c-4dee-9386-92dd8521fd63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:02.068088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9b67-640c-4dee-9386-92dd8521fd63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:02.077210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a9b67-640c-4dee-9386-92dd8521fd63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:02.078581 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a9b67-640c-4dee-9386-92dd8521fd63 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:02.089462 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 947/1872] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:02.202527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5d4f6832ac48a1a5b41f45cead3064', 'request_id': 'req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:02.210085 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5d4f6832ac48a1a5b41f45cead3064', 'request_id': 'req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:02.216748 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5d4f6832ac48a1a5b41f45cead3064', 'request_id': 'req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:02.306569 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc admin admin] The token cache is being invalidate because project bb5d4f6832ac48a1a5b41f45cead3064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:02.309705 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:02.309705 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-be2103ca-f8c1-46eb-b93a-c3ee6bc4dffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:02.309705 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 926/1873] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:01 2022] DELETE /identity/v3/projects/bb5d4f6832ac48a1a5b41f45cead3064 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:02.314403 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f3d5d-bf5b-44f8-af76-08ba5f2d1d08 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:02.314878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f3d5d-bf5b-44f8-af76-08ba5f2d1d08 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:02.314878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f3d5d-bf5b-44f8-af76-08ba5f2d1d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:02.341275 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7c5f3d5d-bf5b-44f8-af76-08ba5f2d1d08 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:02.342517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7c5f3d5d-bf5b-44f8-af76-08ba5f2d1d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:02.415672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 948/1874] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:02.423335 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ac08b-7f9e-4830-87f8-995b6644a795 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:02.424089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ac08b-7f9e-4830-87f8-995b6644a795 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:02.424495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ac08b-7f9e-4830-87f8-995b6644a795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:02.453503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4f3ac08b-7f9e-4830-87f8-995b6644a795 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:02.454799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4f3ac08b-7f9e-4830-87f8-995b6644a795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:02.477124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 927/1875] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:02.479134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f3d5d-bf5b-44f8-af76-08ba5f2d1d08 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:02.489711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f3d5d-bf5b-44f8-af76-08ba5f2d1d08 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:02.497151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d4caf-a4d5-4a25-91ad-12805940aa29 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:02.497741 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d4caf-a4d5-4a25-91ad-12805940aa29 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:02.498457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d4caf-a4d5-4a25-91ad-12805940aa29 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:02.500329 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 928/1876] 10.222.0.62 () {54 vars in 921 bytes} [Wed Apr 6 11:09:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:09:02.509008 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b9dcf-15a7-47cb-b9b0-6b70282f338d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:02.509515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b9dcf-15a7-47cb-b9b0-6b70282f338d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:02.509983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b9dcf-15a7-47cb-b9b0-6b70282f338d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:02.517870 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36269f0-c6d6-442e-b874-86b7a3df220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:02.517870 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36269f0-c6d6-442e-b874-86b7a3df220a admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:02.517870 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36269f0-c6d6-442e-b874-86b7a3df220a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:02.517870 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36269f0-c6d6-442e-b874-86b7a3df220a admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:02.518345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36269f0-c6d6-442e-b874-86b7a3df220a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:09:02.518345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36269f0-c6d6-442e-b874-86b7a3df220a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:02.518345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36269f0-c6d6-442e-b874-86b7a3df220a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:02.538442 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6f3b9dcf-15a7-47cb-b9b0-6b70282f338d None None] MFA Rules not processed for user `650c5809116e4bcd808044236c06dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:02.545842 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 949/1877] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:09:02.546096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6f3b9dcf-15a7-47cb-b9b0-6b70282f338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:02.546830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36269f0-c6d6-442e-b874-86b7a3df220a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:02.558460 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36269f0-c6d6-442e-b874-86b7a3df220a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:02.563328 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ffe58-4a21-4136-a101-da6ecba81047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:02.563983 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ffe58-4a21-4136-a101-da6ecba81047 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:02.564267 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ffe58-4a21-4136-a101-da6ecba81047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:02.564597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ffe58-4a21-4136-a101-da6ecba81047 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:02.565305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ffe58-4a21-4136-a101-da6ecba81047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:02.568068 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ffe58-4a21-4136-a101-da6ecba81047 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:02.621758 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 929/1878] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Apr 6 11:09:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:02.633943 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b9dcf-15a7-47cb-b9b0-6b70282f338d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:02.635710 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6f3b9dcf-15a7-47cb-b9b0-6b70282f338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:02.656190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b9dcf-15a7-47cb-b9b0-6b70282f338d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:02.667461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d664a6-ef51-42d8-bfb0-61a21ea1a74d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:02.668135 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d664a6-ef51-42d8-bfb0-61a21ea1a74d service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:02.669466 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d664a6-ef51-42d8-bfb0-61a21ea1a74d service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:02.669466 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d664a6-ef51-42d8-bfb0-61a21ea1a74d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:02.680439 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 950/1879] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:02 2022] POST /identity/v3/projects => generated 403 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:02.686396 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ffe58-4a21-4136-a101-da6ecba81047 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:02.687616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d664a6-ef51-42d8-bfb0-61a21ea1a74d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:02.689311 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d664a6-ef51-42d8-bfb0-61a21ea1a74d service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:02.701601 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 930/1880] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:09:02.763979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ffe58-4a21-4136-a101-da6ecba81047 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:02.770015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0bfd3-e424-45fd-81c3-fe0319ec83d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:02.770733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0bfd3-e424-45fd-81c3-fe0319ec83d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:02.771018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0bfd3-e424-45fd-81c3-fe0319ec83d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:02.771596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0bfd3-e424-45fd-81c3-fe0319ec83d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:02.772006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0bfd3-e424-45fd-81c3-fe0319ec83d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:02.774053 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0bfd3-e424-45fd-81c3-fe0319ec83d3 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:02.858439 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 951/1881] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:02 2022] POST /identity/v3/users => generated 302 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:02.859910 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d664a6-ef51-42d8-bfb0-61a21ea1a74d service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:02.870485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d664a6-ef51-42d8-bfb0-61a21ea1a74d service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:02.879644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead741c4-b919-4dca-980e-4018d4051b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:02.879644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead741c4-b919-4dca-980e-4018d4051b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:02.879644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead741c4-b919-4dca-980e-4018d4051b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:02.879644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead741c4-b919-4dca-980e-4018d4051b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:02.880009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead741c4-b919-4dca-980e-4018d4051b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:02.881170 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead741c4-b919-4dca-980e-4018d4051b96 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:02.895450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 931/1882] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:02.898647 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0bfd3-e424-45fd-81c3-fe0319ec83d3 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:02.908703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0bfd3-e424-45fd-81c3-fe0319ec83d3 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:02.913865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61e835-881c-4420-bf82-dc7920099e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:02.914501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61e835-881c-4420-bf82-dc7920099e9a admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:02.914784 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61e835-881c-4420-bf82-dc7920099e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:02.915059 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61e835-881c-4420-bf82-dc7920099e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:02.915781 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61e835-881c-4420-bf82-dc7920099e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:02.917419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61e835-881c-4420-bf82-dc7920099e9a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:02.931594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 952/1883] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:02.935726 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead741c4-b919-4dca-980e-4018d4051b96 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:02.945625 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead741c4-b919-4dca-980e-4018d4051b96 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:02.950264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9874559-8288-475b-a7c5-e92250d4dcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:02.951195 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9874559-8288-475b-a7c5-e92250d4dcc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:02.951483 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9874559-8288-475b-a7c5-e92250d4dcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:02.951894 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9874559-8288-475b-a7c5-e92250d4dcc6 admin admin] PATH_INFO: `/v3/projects/4ef4cebded9a44338f0e8116f7c426a2/users/8a3a3b4ebaf24b859aa2964467ac3bfc/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:02.966465 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9874559-8288-475b-a7c5-e92250d4dcc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef4cebded9a44338f0e8116f7c426a2, user_id=8a3a3b4ebaf24b859aa2964467ac3bfc, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:02.969190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9874559-8288-475b-a7c5-e92250d4dcc6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:03.059264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 932/1884] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:02 2022] PUT /identity/v3/projects/4ef4cebded9a44338f0e8116f7c426a2/users/8a3a3b4ebaf24b859aa2964467ac3bfc/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:03.061366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5f572-236f-4e3e-9d38-a5d1e1e409ca None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:03.061609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5f572-236f-4e3e-9d38-a5d1e1e409ca None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:03.061891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5f572-236f-4e3e-9d38-a5d1e1e409ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:03.092375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-97e5f572-236f-4e3e-9d38-a5d1e1e409ca None None] MFA Rules not processed for user `8a3a3b4ebaf24b859aa2964467ac3bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:03.093652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-97e5f572-236f-4e3e-9d38-a5d1e1e409ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:03.164756 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 953/1885] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:03.169357 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9874559-8288-475b-a7c5-e92250d4dcc6 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:03.233775 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9874559-8288-475b-a7c5-e92250d4dcc6 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:03.239242 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412d57f-1ac1-41b5-8628-e9213b35d162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:03.239902 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412d57f-1ac1-41b5-8628-e9213b35d162 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:03.240268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412d57f-1ac1-41b5-8628-e9213b35d162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:03.240549 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412d57f-1ac1-41b5-8628-e9213b35d162 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:03.241289 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412d57f-1ac1-41b5-8628-e9213b35d162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:03.243232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412d57f-1ac1-41b5-8628-e9213b35d162 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:03.378496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 933/1886] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:03 2022] POST /identity/v3/projects => generated 403 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:03.380750 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5f572-236f-4e3e-9d38-a5d1e1e409ca None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:03.392355 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5f572-236f-4e3e-9d38-a5d1e1e409ca None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:03.451181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a5371-f831-4575-ba90-fa61e1cbac11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:03.451859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a5371-f831-4575-ba90-fa61e1cbac11 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:03.452144 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a5371-f831-4575-ba90-fa61e1cbac11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:03.452424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a5371-f831-4575-ba90-fa61e1cbac11 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:03.453140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a5371-f831-4575-ba90-fa61e1cbac11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:03.455137 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a5371-f831-4575-ba90-fa61e1cbac11 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:03.480889 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412d57f-1ac1-41b5-8628-e9213b35d162 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:03.482667 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4412d57f-1ac1-41b5-8628-e9213b35d162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:03.495240 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412d57f-1ac1-41b5-8628-e9213b35d162 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:03.500265 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e857505-2e39-4b74-b5d3-98537b829779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:03.501224 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e857505-2e39-4b74-b5d3-98537b829779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:03.501509 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e857505-2e39-4b74-b5d3-98537b829779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:03.501785 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e857505-2e39-4b74-b5d3-98537b829779 admin admin] PATH_INFO: `/v3/users/c554235dd6564167a040f60d1e873ef5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:03.503135 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e857505-2e39-4b74-b5d3-98537b829779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c554235dd6564167a040f60d1e873ef5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:03.505240 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e857505-2e39-4b74-b5d3-98537b829779 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:03.586614 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 954/1887] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:03 2022] POST /identity/v3/users => generated 308 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:03.590712 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a5371-f831-4575-ba90-fa61e1cbac11 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:03.601856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a5371-f831-4575-ba90-fa61e1cbac11 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:03.608986 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1205542-451b-4487-a4f5-43098d2406be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:03.608986 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1205542-451b-4487-a4f5-43098d2406be admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:03.611605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1205542-451b-4487-a4f5-43098d2406be admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:03.611904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1205542-451b-4487-a4f5-43098d2406be admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:03.612734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1205542-451b-4487-a4f5-43098d2406be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:03.614406 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1205542-451b-4487-a4f5-43098d2406be admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:03.629246 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 955/1888] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:03.633573 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1205542-451b-4487-a4f5-43098d2406be admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:03.646594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1205542-451b-4487-a4f5-43098d2406be admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:03.653887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82b322-0193-47f2-b674-aee014271c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:03.653887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82b322-0193-47f2-b674-aee014271c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:03.653887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82b322-0193-47f2-b674-aee014271c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:03.653887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82b322-0193-47f2-b674-aee014271c68 admin admin] PATH_INFO: `/v3/projects/f0717cd7d34f4822ba2767cd0380fc51/users/1ae5a5fe66304d7eb516e0f55639adef/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:03.675419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82b322-0193-47f2-b674-aee014271c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0717cd7d34f4822ba2767cd0380fc51, user_id=1ae5a5fe66304d7eb516e0f55639adef, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:03.678461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82b322-0193-47f2-b674-aee014271c68 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:03.708393 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8e857505-2e39-4b74-b5d3-98537b829779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c554235dd6564167a040f60d1e873ef5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:03.709173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8e857505-2e39-4b74-b5d3-98537b829779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c554235dd6564167a040f60d1e873ef5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:03.709947 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8e857505-2e39-4b74-b5d3-98537b829779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c554235dd6564167a040f60d1e873ef5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:03.791433 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8e857505-2e39-4b74-b5d3-98537b829779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c554235dd6564167a040f60d1e873ef5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:03.801257 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 956/1889] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:03 2022] PUT /identity/v3/projects/f0717cd7d34f4822ba2767cd0380fc51/users/1ae5a5fe66304d7eb516e0f55639adef/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:03.802560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82b322-0193-47f2-b674-aee014271c68 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:03.804971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8e857505-2e39-4b74-b5d3-98537b829779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c554235dd6564167a040f60d1e873ef5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:03.805299 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1e82b322-0193-47f2-b674-aee014271c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:03.820373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 934/1890] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:03 2022] DELETE /identity/v3/users/c554235dd6564167a040f60d1e873ef5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:03.825156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ecdd5-fe58-4716-9db4-587271dd5ee4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:03.825467 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ecdd5-fe58-4716-9db4-587271dd5ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:03.860317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ecdd5-fe58-4716-9db4-587271dd5ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:03.860317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-604ecdd5-fe58-4716-9db4-587271dd5ee4 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:03.860317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-604ecdd5-fe58-4716-9db4-587271dd5ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:03.871543 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82b322-0193-47f2-b674-aee014271c68 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:03.902413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 935/1891] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:03.912060 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ecdd5-fe58-4716-9db4-587271dd5ee4 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:03.913490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-604ecdd5-fe58-4716-9db4-587271dd5ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:03.934587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48334c8-d5f4-4062-868f-7fda43ecb08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:03.935334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48334c8-d5f4-4062-868f-7fda43ecb08a admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:03.935621 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48334c8-d5f4-4062-868f-7fda43ecb08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:03.935894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48334c8-d5f4-4062-868f-7fda43ecb08a admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:03.936624 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48334c8-d5f4-4062-868f-7fda43ecb08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:03.938302 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48334c8-d5f4-4062-868f-7fda43ecb08a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:03.957619 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 957/1892] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:03.961704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48334c8-d5f4-4062-868f-7fda43ecb08a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:03.973657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48334c8-d5f4-4062-868f-7fda43ecb08a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:03.979131 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fe5e0-f572-4ae4-b6be-19cf34fcb7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:03.980335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fe5e0-f572-4ae4-b6be-19cf34fcb7bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:03.980626 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fe5e0-f572-4ae4-b6be-19cf34fcb7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:03.980905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fe5e0-f572-4ae4-b6be-19cf34fcb7bd admin admin] PATH_INFO: `/v3/projects/f0717cd7d34f4822ba2767cd0380fc51/users/1ae5a5fe66304d7eb516e0f55639adef/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:03.982978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fe5e0-f572-4ae4-b6be-19cf34fcb7bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0717cd7d34f4822ba2767cd0380fc51, user_id=1ae5a5fe66304d7eb516e0f55639adef, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:03.990752 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fe5e0-f572-4ae4-b6be-19cf34fcb7bd admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:03.990841 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ecdd5-fe58-4716-9db4-587271dd5ee4 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:03.995205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ba238-5976-4c53-be75-8a5fabb233a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:03.996274 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba238-5976-4c53-be75-8a5fabb233a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:03.996854 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba238-5976-4c53-be75-8a5fabb233a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:03.997339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba238-5976-4c53-be75-8a5fabb233a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:04.001975 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 958/1893] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:03 2022] PUT /identity/v3/projects/f0717cd7d34f4822ba2767cd0380fc51/users/1ae5a5fe66304d7eb516e0f55639adef/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:04.010057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ba238-5976-4c53-be75-8a5fabb233a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:04.013223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ba238-5976-4c53-be75-8a5fabb233a8 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:04.023009 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6eb9-8baf-4900-bbfa-66577d9f3dd9 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:04.024474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 936/1894] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:09:04.025483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6eb9-8baf-4900-bbfa-66577d9f3dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:04.026120 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6eb9-8baf-4900-bbfa-66577d9f3dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:04.068635 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a50b6eb9-8baf-4900-bbfa-66577d9f3dd9 None None] MFA Rules not processed for user `1ae5a5fe66304d7eb516e0f55639adef`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:04.071287 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a50b6eb9-8baf-4900-bbfa-66577d9f3dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:04.196530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 959/1895] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:04 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:04.207769 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ba238-5976-4c53-be75-8a5fabb233a8 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:04.209251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9d4ba238-5976-4c53-be75-8a5fabb233a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:04.298868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ba238-5976-4c53-be75-8a5fabb233a8 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:04.376983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01f001-f44c-456d-a5e0-f03c06d512be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:04.377984 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f001-f44c-456d-a5e0-f03c06d512be service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:04.381424 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f001-f44c-456d-a5e0-f03c06d512be service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:04.382522 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f001-f44c-456d-a5e0-f03c06d512be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:04.407407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01f001-f44c-456d-a5e0-f03c06d512be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:04.412527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01f001-f44c-456d-a5e0-f03c06d512be service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:04.426208 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 937/1896] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:04 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:04.643728 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6eb9-8baf-4900-bbfa-66577d9f3dd9 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:04.857923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6eb9-8baf-4900-bbfa-66577d9f3dd9 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:04.868209 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefed0c-3c8f-4700-a2f6-3a749568bf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:04.869162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefed0c-3c8f-4700-a2f6-3a749568bf32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:04.869444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefed0c-3c8f-4700-a2f6-3a749568bf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:04.869716 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefed0c-3c8f-4700-a2f6-3a749568bf32 admin admin] PATH_INFO: `/v3/users/8a3a3b4ebaf24b859aa2964467ac3bfc` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:04.871335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefed0c-3c8f-4700-a2f6-3a749568bf32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3a3b4ebaf24b859aa2964467ac3bfc)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:04.873357 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefed0c-3c8f-4700-a2f6-3a749568bf32 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:04.977511 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01f001-f44c-456d-a5e0-f03c06d512be service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:04.979932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fa01f001-f44c-456d-a5e0-f03c06d512be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:05.016100 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01f001-f44c-456d-a5e0-f03c06d512be service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:05.033957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04458c91-28b5-47b9-81ea-b5a17d80d406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:05.033957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04458c91-28b5-47b9-81ea-b5a17d80d406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:05.033957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04458c91-28b5-47b9-81ea-b5a17d80d406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:05.033957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04458c91-28b5-47b9-81ea-b5a17d80d406 admin admin] PATH_INFO: `/v3/projects/744760f0e19c4d6fa0f1a797525daa16` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:05.034734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04458c91-28b5-47b9-81ea-b5a17d80d406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=744760f0e19c4d6fa0f1a797525daa16)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:05.037778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04458c91-28b5-47b9-81ea-b5a17d80d406 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:05.168070 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7eefed0c-3c8f-4700-a2f6-3a749568bf32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3a3b4ebaf24b859aa2964467ac3bfc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.168345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7eefed0c-3c8f-4700-a2f6-3a749568bf32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3a3b4ebaf24b859aa2964467ac3bfc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.169438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7eefed0c-3c8f-4700-a2f6-3a749568bf32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3a3b4ebaf24b859aa2964467ac3bfc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.186407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7eefed0c-3c8f-4700-a2f6-3a749568bf32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3a3b4ebaf24b859aa2964467ac3bfc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.194430 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7eefed0c-3c8f-4700-a2f6-3a749568bf32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3a3b4ebaf24b859aa2964467ac3bfc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.218342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-04458c91-28b5-47b9-81ea-b5a17d80d406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744760f0e19c4d6fa0f1a797525daa16', 'request_id': 'req-04458c91-28b5-47b9-81ea-b5a17d80d406'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.224900 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-04458c91-28b5-47b9-81ea-b5a17d80d406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744760f0e19c4d6fa0f1a797525daa16', 'request_id': 'req-04458c91-28b5-47b9-81ea-b5a17d80d406'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.232132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-04458c91-28b5-47b9-81ea-b5a17d80d406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744760f0e19c4d6fa0f1a797525daa16', 'request_id': 'req-04458c91-28b5-47b9-81ea-b5a17d80d406'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.300654 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 960/1897] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:04 2022] DELETE /identity/v3/users/8a3a3b4ebaf24b859aa2964467ac3bfc => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:05.304392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefed0c-3c8f-4700-a2f6-3a749568bf32 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:05.305780 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7eefed0c-3c8f-4700-a2f6-3a749568bf32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:05.361558 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefed0c-3c8f-4700-a2f6-3a749568bf32 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:05.365151 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048500f-6271-48e0-9664-ab6610573f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:05.365908 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048500f-6271-48e0-9664-ab6610573f8b service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:05.366170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048500f-6271-48e0-9664-ab6610573f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:05.366436 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048500f-6271-48e0-9664-ab6610573f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:05.368171 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9048500f-6271-48e0-9664-ab6610573f8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:05.402488 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-04458c91-28b5-47b9-81ea-b5a17d80d406 admin admin] The token cache is being invalidate because project 744760f0e19c4d6fa0f1a797525daa16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:05.402953 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-04458c91-28b5-47b9-81ea-b5a17d80d406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.408220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-04458c91-28b5-47b9-81ea-b5a17d80d406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.408220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 938/1898] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:04 2022] DELETE /identity/v3/projects/744760f0e19c4d6fa0f1a797525daa16 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:05.408220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036754e-e585-44da-b730-fefd8c33aba1 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:05.408220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036754e-e585-44da-b730-fefd8c33aba1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:05.408220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036754e-e585-44da-b730-fefd8c33aba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:05.426891 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6036754e-e585-44da-b730-fefd8c33aba1 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:05.428094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6036754e-e585-44da-b730-fefd8c33aba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:05.429729 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048500f-6271-48e0-9664-ab6610573f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:05.431099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048500f-6271-48e0-9664-ab6610573f8b service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:05.440988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 961/1899] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:05.448444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048500f-6271-48e0-9664-ab6610573f8b service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:05.448444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9048500f-6271-48e0-9664-ab6610573f8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:05.490101 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 939/1900] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:05.500474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036754e-e585-44da-b730-fefd8c33aba1 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:05.501955 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6036754e-e585-44da-b730-fefd8c33aba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:05.509840 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048500f-6271-48e0-9664-ab6610573f8b service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:05.516404 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fad22-59cd-4f88-b38f-9c9bda4a212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:05.517316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fad22-59cd-4f88-b38f-9c9bda4a212b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:05.517593 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fad22-59cd-4f88-b38f-9c9bda4a212b admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:05.517861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fad22-59cd-4f88-b38f-9c9bda4a212b admin admin] PATH_INFO: `/v3/users/f1f699a619364e8bab1215115df5433e` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:05.521463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fad22-59cd-4f88-b38f-9c9bda4a212b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f699a619364e8bab1215115df5433e)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:05.525812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fad22-59cd-4f88-b38f-9c9bda4a212b admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:05.563296 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036754e-e585-44da-b730-fefd8c33aba1 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:05.567729 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ffae5-3140-4313-a0f7-d1763f56fac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:05.568377 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ffae5-3140-4313-a0f7-d1763f56fac0 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:05.568659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ffae5-3140-4313-a0f7-d1763f56fac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:05.568933 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ffae5-3140-4313-a0f7-d1763f56fac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:05.577962 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ffae5-3140-4313-a0f7-d1763f56fac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:05.587273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ffae5-3140-4313-a0f7-d1763f56fac0 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:05.588809 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 940/1901] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:09:05.698214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ffae5-3140-4313-a0f7-d1763f56fac0 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:05.699730 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c21ffae5-3140-4313-a0f7-d1763f56fac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:05.712296 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ffae5-3140-4313-a0f7-d1763f56fac0 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:05.716938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385854d-43ee-455c-934f-e66c6216e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:05.717866 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385854d-43ee-455c-934f-e66c6216e389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:05.718149 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385854d-43ee-455c-934f-e66c6216e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:05.718429 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385854d-43ee-455c-934f-e66c6216e389 admin admin] PATH_INFO: `/v3/users/9a38f4a1da9c4b0286aaa5a027d918c3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:05.719599 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385854d-43ee-455c-934f-e66c6216e389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a38f4a1da9c4b0286aaa5a027d918c3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:05.721623 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385854d-43ee-455c-934f-e66c6216e389 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:05.783842 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4b2fad22-59cd-4f88-b38f-9c9bda4a212b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f699a619364e8bab1215115df5433e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.784539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4b2fad22-59cd-4f88-b38f-9c9bda4a212b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f699a619364e8bab1215115df5433e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.785382 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4b2fad22-59cd-4f88-b38f-9c9bda4a212b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f699a619364e8bab1215115df5433e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.798059 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4b2fad22-59cd-4f88-b38f-9c9bda4a212b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f699a619364e8bab1215115df5433e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.806271 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4b2fad22-59cd-4f88-b38f-9c9bda4a212b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f699a619364e8bab1215115df5433e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.912305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 962/1902] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:05 2022] DELETE /identity/v3/users/f1f699a619364e8bab1215115df5433e => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:05.921254 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4385854d-43ee-455c-934f-e66c6216e389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a38f4a1da9c4b0286aaa5a027d918c3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.922226 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4385854d-43ee-455c-934f-e66c6216e389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a38f4a1da9c4b0286aaa5a027d918c3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.925357 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4385854d-43ee-455c-934f-e66c6216e389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a38f4a1da9c4b0286aaa5a027d918c3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:05.997588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4385854d-43ee-455c-934f-e66c6216e389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a38f4a1da9c4b0286aaa5a027d918c3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.012070 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4385854d-43ee-455c-934f-e66c6216e389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a38f4a1da9c4b0286aaa5a027d918c3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.025908 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 941/1903] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:05 2022] DELETE /identity/v3/users/9a38f4a1da9c4b0286aaa5a027d918c3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:06.030215 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1914-d47f-458f-94e3-7a945ddc79d8 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:06.031215 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1914-d47f-458f-94e3-7a945ddc79d8 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:06.031614 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1914-d47f-458f-94e3-7a945ddc79d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:06.050290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-26ce1914-d47f-458f-94e3-7a945ddc79d8 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:06.052490 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-26ce1914-d47f-458f-94e3-7a945ddc79d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:06.116060 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 963/1904] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:06.126632 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385854d-43ee-455c-934f-e66c6216e389 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:06.128058 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4385854d-43ee-455c-934f-e66c6216e389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:06.189139 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce1914-d47f-458f-94e3-7a945ddc79d8 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:06.192106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-26ce1914-d47f-458f-94e3-7a945ddc79d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:06.217218 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce1914-d47f-458f-94e3-7a945ddc79d8 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:06.224354 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385854d-43ee-455c-934f-e66c6216e389 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:06.226158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:06.227055 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:06.227425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:06.227663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] PATH_INFO: `/v3/projects/4ef4cebded9a44338f0e8116f7c426a2` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:06.230500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef4cebded9a44338f0e8116f7c426a2)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:06.233016 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:06.237259 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a73e44-baba-4e01-acff-c123256234d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:06.240475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a73e44-baba-4e01-acff-c123256234d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:06.240944 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a73e44-baba-4e01-acff-c123256234d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:06.241448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a73e44-baba-4e01-acff-c123256234d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:06.288463 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a73e44-baba-4e01-acff-c123256234d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:06.292369 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a73e44-baba-4e01-acff-c123256234d5 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:06.310969 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 942/1905] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:06.381641 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef4cebded9a44338f0e8116f7c426a2', 'request_id': 'req-2665cf64-dddc-44f3-98be-58e00c5c6332'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.511839 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef4cebded9a44338f0e8116f7c426a2', 'request_id': 'req-2665cf64-dddc-44f3-98be-58e00c5c6332'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.525411 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef4cebded9a44338f0e8116f7c426a2', 'request_id': 'req-2665cf64-dddc-44f3-98be-58e00c5c6332'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.527593 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a73e44-baba-4e01-acff-c123256234d5 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:06.529156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e6a73e44-baba-4e01-acff-c123256234d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:06.538525 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] The token cache is being invalidate because project 4ef4cebded9a44338f0e8116f7c426a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:06.539015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.543402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.544648 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a73e44-baba-4e01-acff-c123256234d5 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:06.547443 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 964/1906] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:06 2022] DELETE /identity/v3/projects/4ef4cebded9a44338f0e8116f7c426a2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:06.551771 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:06.553362 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:06.618412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:06.619736 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:06.620148 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:06.620554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] PATH_INFO: `/v3/projects/44966f0ef23e4fc1bd73636603a3bb67` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:06.622310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44966f0ef23e4fc1bd73636603a3bb67)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:06.625518 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:06.628368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665cf64-dddc-44f3-98be-58e00c5c6332 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:06.633918 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893ebd2-bb0c-412e-8fee-6a09bd3450ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:06.636974 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893ebd2-bb0c-412e-8fee-6a09bd3450ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:06.636974 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893ebd2-bb0c-412e-8fee-6a09bd3450ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:06.636974 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893ebd2-bb0c-412e-8fee-6a09bd3450ff admin admin] PATH_INFO: `/v3/users/1ae5a5fe66304d7eb516e0f55639adef` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:06.636974 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893ebd2-bb0c-412e-8fee-6a09bd3450ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae5a5fe66304d7eb516e0f55639adef)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:06.639015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893ebd2-bb0c-412e-8fee-6a09bd3450ff admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:06.822160 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f893ebd2-bb0c-412e-8fee-6a09bd3450ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae5a5fe66304d7eb516e0f55639adef'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.822793 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44966f0ef23e4fc1bd73636603a3bb67', 'request_id': 'req-bb084130-16e5-4fe5-9c74-b87ec9817887'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.822920 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f893ebd2-bb0c-412e-8fee-6a09bd3450ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae5a5fe66304d7eb516e0f55639adef'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.823441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f893ebd2-bb0c-412e-8fee-6a09bd3450ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae5a5fe66304d7eb516e0f55639adef'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.828706 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44966f0ef23e4fc1bd73636603a3bb67', 'request_id': 'req-bb084130-16e5-4fe5-9c74-b87ec9817887'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.834221 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44966f0ef23e4fc1bd73636603a3bb67', 'request_id': 'req-bb084130-16e5-4fe5-9c74-b87ec9817887'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.835282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f893ebd2-bb0c-412e-8fee-6a09bd3450ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae5a5fe66304d7eb516e0f55639adef'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.846715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f893ebd2-bb0c-412e-8fee-6a09bd3450ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae5a5fe66304d7eb516e0f55639adef'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.956480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] The token cache is being invalidate because project 44966f0ef23e4fc1bd73636603a3bb67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:06.956699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.957452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:06.959023 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 943/1907] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:06 2022] DELETE /identity/v3/projects/44966f0ef23e4fc1bd73636603a3bb67 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:06.963013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:06.964356 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:07.010898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 965/1908] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:06 2022] DELETE /identity/v3/users/1ae5a5fe66304d7eb516e0f55639adef => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:07.011781 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893ebd2-bb0c-412e-8fee-6a09bd3450ff admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:07.013241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f893ebd2-bb0c-412e-8fee-6a09bd3450ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:07.043843 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb084130-16e5-4fe5-9c74-b87ec9817887 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:07.106133 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893ebd2-bb0c-412e-8fee-6a09bd3450ff admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:07.111818 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6699ad7-2168-46d0-ab1a-525049668a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:07.113140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699ad7-2168-46d0-ab1a-525049668a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:07.113487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699ad7-2168-46d0-ab1a-525049668a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:07.113769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699ad7-2168-46d0-ab1a-525049668a90 admin admin] PATH_INFO: `/v3/users/767b01fc02bf4823beb6ea80db226c55` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:07.115142 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6699ad7-2168-46d0-ab1a-525049668a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=767b01fc02bf4823beb6ea80db226c55)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:07.117463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6699ad7-2168-46d0-ab1a-525049668a90 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:07.124225 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:07.127139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:07.128416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:07.129572 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] PATH_INFO: `/v3/projects/b8aa1750add44ca8a70bc6a11cbb7c5d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:07.130963 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8aa1750add44ca8a70bc6a11cbb7c5d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:07.136986 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:07.356714 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f6699ad7-2168-46d0-ab1a-525049668a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767b01fc02bf4823beb6ea80db226c55'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.357441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f6699ad7-2168-46d0-ab1a-525049668a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767b01fc02bf4823beb6ea80db226c55'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.358294 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f6699ad7-2168-46d0-ab1a-525049668a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767b01fc02bf4823beb6ea80db226c55'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.369856 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8aa1750add44ca8a70bc6a11cbb7c5d', 'request_id': 'req-02ff145e-3b57-4acc-a9b2-22fb63835705'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.374774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f6699ad7-2168-46d0-ab1a-525049668a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767b01fc02bf4823beb6ea80db226c55'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.377825 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8aa1750add44ca8a70bc6a11cbb7c5d', 'request_id': 'req-02ff145e-3b57-4acc-a9b2-22fb63835705'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.384001 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8aa1750add44ca8a70bc6a11cbb7c5d', 'request_id': 'req-02ff145e-3b57-4acc-a9b2-22fb63835705'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.384878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f6699ad7-2168-46d0-ab1a-525049668a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767b01fc02bf4823beb6ea80db226c55'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.476578 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] The token cache is being invalidate because project b8aa1750add44ca8a70bc6a11cbb7c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:07.476945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.477610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.479229 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 944/1909] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:06 2022] DELETE /identity/v3/projects/b8aa1750add44ca8a70bc6a11cbb7c5d => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:07.480023 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:07.481650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:07.531982 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 966/1910] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:07 2022] DELETE /identity/v3/users/767b01fc02bf4823beb6ea80db226c55 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:07.534898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6699ad7-2168-46d0-ab1a-525049668a90 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:07.534898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f6699ad7-2168-46d0-ab1a-525049668a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:07.562048 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff145e-3b57-4acc-a9b2-22fb63835705 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:07.608232 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6699ad7-2168-46d0-ab1a-525049668a90 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:07.624599 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638df3d-6c43-4df9-b391-85e5e7c89857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:07.624878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e7171-1e27-45b9-ae69-007074f9964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:07.625605 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638df3d-6c43-4df9-b391-85e5e7c89857 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:07.625896 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638df3d-6c43-4df9-b391-85e5e7c89857 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:07.626176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638df3d-6c43-4df9-b391-85e5e7c89857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:07.626753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e7171-1e27-45b9-ae69-007074f9964c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:07.627434 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e7171-1e27-45b9-ae69-007074f9964c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:07.628124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d638df3d-6c43-4df9-b391-85e5e7c89857 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:07.628233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e7171-1e27-45b9-ae69-007074f9964c admin admin] PATH_INFO: `/v3/users/865fcbe7839d4a70a3bca4adc3fecfd8` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:07.630906 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e7171-1e27-45b9-ae69-007074f9964c admin admin] RBAC: Authorizing `identity:delete_user(user_id=865fcbe7839d4a70a3bca4adc3fecfd8)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:07.632910 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e7171-1e27-45b9-ae69-007074f9964c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:07.702881 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638df3d-6c43-4df9-b391-85e5e7c89857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:07.704381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638df3d-6c43-4df9-b391-85e5e7c89857 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:07.714906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 945/1911] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:07.715729 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638df3d-6c43-4df9-b391-85e5e7c89857 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:07.717122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d638df3d-6c43-4df9-b391-85e5e7c89857 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:07.730297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638df3d-6c43-4df9-b391-85e5e7c89857 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:07.735039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab1cea-7ca6-4b14-8803-78d764a15c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:07.735903 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1cea-7ca6-4b14-8803-78d764a15c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:07.736186 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1cea-7ca6-4b14-8803-78d764a15c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:07.736504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1cea-7ca6-4b14-8803-78d764a15c9a admin admin] PATH_INFO: `/v3/projects/f0717cd7d34f4822ba2767cd0380fc51` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:07.737724 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab1cea-7ca6-4b14-8803-78d764a15c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0717cd7d34f4822ba2767cd0380fc51)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:07.740271 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab1cea-7ca6-4b14-8803-78d764a15c9a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:07.776567 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-784e7171-1e27-45b9-ae69-007074f9964c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '865fcbe7839d4a70a3bca4adc3fecfd8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.777262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-784e7171-1e27-45b9-ae69-007074f9964c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '865fcbe7839d4a70a3bca4adc3fecfd8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.777888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-784e7171-1e27-45b9-ae69-007074f9964c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '865fcbe7839d4a70a3bca4adc3fecfd8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.789341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-784e7171-1e27-45b9-ae69-007074f9964c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '865fcbe7839d4a70a3bca4adc3fecfd8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.796293 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-784e7171-1e27-45b9-ae69-007074f9964c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '865fcbe7839d4a70a3bca4adc3fecfd8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.860884 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 967/1912] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:07 2022] DELETE /identity/v3/users/865fcbe7839d4a70a3bca4adc3fecfd8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:07.874167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fcab1cea-7ca6-4b14-8803-78d764a15c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0717cd7d34f4822ba2767cd0380fc51', 'request_id': 'req-fcab1cea-7ca6-4b14-8803-78d764a15c9a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.885682 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fcab1cea-7ca6-4b14-8803-78d764a15c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0717cd7d34f4822ba2767cd0380fc51', 'request_id': 'req-fcab1cea-7ca6-4b14-8803-78d764a15c9a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.891660 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fcab1cea-7ca6-4b14-8803-78d764a15c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0717cd7d34f4822ba2767cd0380fc51', 'request_id': 'req-fcab1cea-7ca6-4b14-8803-78d764a15c9a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.951403 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fcab1cea-7ca6-4b14-8803-78d764a15c9a admin admin] The token cache is being invalidate because project f0717cd7d34f4822ba2767cd0380fc51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:07.951702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fcab1cea-7ca6-4b14-8803-78d764a15c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.952422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fcab1cea-7ca6-4b14-8803-78d764a15c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:07.954035 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 946/1913] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:07 2022] DELETE /identity/v3/projects/f0717cd7d34f4822ba2767cd0380fc51 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:07.959412 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75bc01-a563-4a54-81cc-06b29fb06634 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:07.959705 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75bc01-a563-4a54-81cc-06b29fb06634 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:07.959981 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75bc01-a563-4a54-81cc-06b29fb06634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:07.979771 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-3c75bc01-a563-4a54-81cc-06b29fb06634 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:07.981659 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3c75bc01-a563-4a54-81cc-06b29fb06634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:08.040316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 968/1914] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:08.047939 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab0fda-4ec9-41d1-af41-98b91fb42e0d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.048232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab0fda-4ec9-41d1-af41-98b91fb42e0d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.048516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab0fda-4ec9-41d1-af41-98b91fb42e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.068474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-acab0fda-4ec9-41d1-af41-98b91fb42e0d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:08.069709 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-acab0fda-4ec9-41d1-af41-98b91fb42e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:08.077632 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 947/1915] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:08.081747 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75bc01-a563-4a54-81cc-06b29fb06634 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:08.089430 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab0fda-4ec9-41d1-af41-98b91fb42e0d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:08.090886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-acab0fda-4ec9-41d1-af41-98b91fb42e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:08.092564 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75bc01-a563-4a54-81cc-06b29fb06634 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:08.103804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab0fda-4ec9-41d1-af41-98b91fb42e0d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:08.108851 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:08.109823 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.110094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.110315 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63 admin admin] PATH_INFO: `/v3/projects/8a51ae77a04845bea783241af36148a2` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.111512 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a51ae77a04845bea783241af36148a2)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:08.114201 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:08.123579 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867c81d-040b-43ab-8345-c470d283ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:08.124118 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867c81d-040b-43ab-8345-c470d283ece7 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.126306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867c81d-040b-43ab-8345-c470d283ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.126306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867c81d-040b-43ab-8345-c470d283ece7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.126306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867c81d-040b-43ab-8345-c470d283ece7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:09:08.126306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867c81d-040b-43ab-8345-c470d283ece7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:08.127374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867c81d-040b-43ab-8345-c470d283ece7 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:08.141630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 969/1916] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:09:08.145742 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867c81d-040b-43ab-8345-c470d283ece7 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:08.155679 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867c81d-040b-43ab-8345-c470d283ece7 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:08.161086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801263c-d4c3-46df-a622-a9b68e66df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:08.161498 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801263c-d4c3-46df-a622-a9b68e66df27 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.161792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801263c-d4c3-46df-a622-a9b68e66df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.162074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801263c-d4c3-46df-a622-a9b68e66df27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.162762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801263c-d4c3-46df-a622-a9b68e66df27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:08.164669 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801263c-d4c3-46df-a622-a9b68e66df27 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:08.219656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a51ae77a04845bea783241af36148a2', 'request_id': 'req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:08.226530 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a51ae77a04845bea783241af36148a2', 'request_id': 'req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:08.232083 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a51ae77a04845bea783241af36148a2', 'request_id': 'req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:08.290469 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 970/1917] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:08 2022] POST /identity/v3/projects => generated 401 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:09:08.294569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801263c-d4c3-46df-a622-a9b68e66df27 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:08.330546 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63 admin admin] The token cache is being invalidate because project 8a51ae77a04845bea783241af36148a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:08.330850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:08.331669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a02f46fd-d15a-47cd-8ba5-1c31a2524a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:08.341326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 948/1918] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:08 2022] DELETE /identity/v3/projects/8a51ae77a04845bea783241af36148a2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:08.343332 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4a992-2b28-4c03-a805-4063117f3392 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.343623 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4a992-2b28-4c03-a805-4063117f3392 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.343901 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4a992-2b28-4c03-a805-4063117f3392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.367815 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801263c-d4c3-46df-a622-a9b68e66df27 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:08.373861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aac16-ea30-47eb-97cd-e3dfe2d02c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:08.374374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aac16-ea30-47eb-97cd-e3dfe2d02c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.374820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aac16-ea30-47eb-97cd-e3dfe2d02c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.375112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aac16-ea30-47eb-97cd-e3dfe2d02c4d admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.376648 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aac16-ea30-47eb-97cd-e3dfe2d02c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:08.378046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aac16-ea30-47eb-97cd-e3dfe2d02c4d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:08.381372 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-75a4a992-2b28-4c03-a805-4063117f3392 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:08.382753 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-75a4a992-2b28-4c03-a805-4063117f3392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:08.400339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 949/1919] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:08.401311 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4a992-2b28-4c03-a805-4063117f3392 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:08.403355 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-75a4a992-2b28-4c03-a805-4063117f3392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:08.415552 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4a992-2b28-4c03-a805-4063117f3392 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:08.421409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:08.422298 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.422568 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.422921 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] PATH_INFO: `/v3/projects/ab496976ebaa4d28aff793cce9bab253` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.424791 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab496976ebaa4d28aff793cce9bab253)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:08.427654 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:08.464205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 971/1920] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:08 2022] POST /identity/v3/users => generated 301 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:09:08.465856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916e8c8-2a83-41ef-9c39-e1d7581f4d19 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.465974 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916e8c8-2a83-41ef-9c39-e1d7581f4d19 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.466282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916e8c8-2a83-41ef-9c39-e1d7581f4d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.497610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-6916e8c8-2a83-41ef-9c39-e1d7581f4d19 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:08.498920 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6916e8c8-2a83-41ef-9c39-e1d7581f4d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:08.520856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 972/1921] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:08.520856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916e8c8-2a83-41ef-9c39-e1d7581f4d19 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:08.520856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6916e8c8-2a83-41ef-9c39-e1d7581f4d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:08.527973 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916e8c8-2a83-41ef-9c39-e1d7581f4d19 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:08.532698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d526-da01-4b3b-bcbc-25e6164ef6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:08.533437 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d526-da01-4b3b-bcbc-25e6164ef6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.533721 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d526-da01-4b3b-bcbc-25e6164ef6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.533997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d526-da01-4b3b-bcbc-25e6164ef6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.534726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d526-da01-4b3b-bcbc-25e6164ef6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:08.536372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d526-da01-4b3b-bcbc-25e6164ef6e4 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:08.546712 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 973/1922] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:08.547535 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d526-da01-4b3b-bcbc-25e6164ef6e4 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:08.558990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab496976ebaa4d28aff793cce9bab253', 'request_id': 'req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:08.560561 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d526-da01-4b3b-bcbc-25e6164ef6e4 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:08.565736 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab496976ebaa4d28aff793cce9bab253', 'request_id': 'req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:08.573333 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab496976ebaa4d28aff793cce9bab253', 'request_id': 'req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:08.619631 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df54cc-b0f8-40b1-9923-5c015475e330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:08.620412 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df54cc-b0f8-40b1-9923-5c015475e330 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.620708 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df54cc-b0f8-40b1-9923-5c015475e330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.620990 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df54cc-b0f8-40b1-9923-5c015475e330 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.621775 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df54cc-b0f8-40b1-9923-5c015475e330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:09:08.622092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df54cc-b0f8-40b1-9923-5c015475e330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:08.623890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df54cc-b0f8-40b1-9923-5c015475e330 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:08.637021 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 974/1923] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:09:08.637974 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df54cc-b0f8-40b1-9923-5c015475e330 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:08.656780 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df54cc-b0f8-40b1-9923-5c015475e330 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:08.663486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4473a3f-294a-4b2b-bd64-a05436540830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:08.664386 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4473a3f-294a-4b2b-bd64-a05436540830 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.664681 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4473a3f-294a-4b2b-bd64-a05436540830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.665003 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4473a3f-294a-4b2b-bd64-a05436540830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.665773 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4473a3f-294a-4b2b-bd64-a05436540830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:08.667456 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4473a3f-294a-4b2b-bd64-a05436540830 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:08.688550 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] The token cache is being invalidate because project ab496976ebaa4d28aff793cce9bab253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:08.689110 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:08.689951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:08.693489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 975/1924] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:08.693489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4473a3f-294a-4b2b-bd64-a05436540830 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:08.697598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 950/1925] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:08 2022] DELETE /identity/v3/projects/ab496976ebaa4d28aff793cce9bab253 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:08.698199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f4473a3f-294a-4b2b-bd64-a05436540830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:08.698994 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:08.701994 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:08.722260 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b59a8-47bc-40f6-872b-2e7d642eb62c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:08.724096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4473a3f-294a-4b2b-bd64-a05436540830 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:08.730623 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702ff95-7e8d-497d-98b5-cec9899327ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:08.731296 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702ff95-7e8d-497d-98b5-cec9899327ae admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.731594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702ff95-7e8d-497d-98b5-cec9899327ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.732661 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702ff95-7e8d-497d-98b5-cec9899327ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.732661 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702ff95-7e8d-497d-98b5-cec9899327ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:08.733224 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bbaf3-3731-4d52-8f24-7b843c0fccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:08.734531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702ff95-7e8d-497d-98b5-cec9899327ae admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:08.735057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bbaf3-3731-4d52-8f24-7b843c0fccf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.736330 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bbaf3-3731-4d52-8f24-7b843c0fccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.737179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bbaf3-3731-4d52-8f24-7b843c0fccf0 admin admin] PATH_INFO: `/v3/projects/3e583d6cd0354a86aba6e3e89818890b/users/f11699e8a7194fafb53513106cf40b96/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.763072 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bbaf3-3731-4d52-8f24-7b843c0fccf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e583d6cd0354a86aba6e3e89818890b, user_id=f11699e8a7194fafb53513106cf40b96, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:08.769328 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bbaf3-3731-4d52-8f24-7b843c0fccf0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:08.815066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 976/1926] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:08 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:08.815066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde762d-3352-4307-95f9-f157ec83a852 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.815066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde762d-3352-4307-95f9-f157ec83a852 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.815066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde762d-3352-4307-95f9-f157ec83a852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.833479 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0cde762d-3352-4307-95f9-f157ec83a852 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:08.833713 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 951/1927] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:08 2022] PUT /identity/v3/projects/3e583d6cd0354a86aba6e3e89818890b/users/f11699e8a7194fafb53513106cf40b96/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:08.834735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bbaf3-3731-4d52-8f24-7b843c0fccf0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:08.834853 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0cde762d-3352-4307-95f9-f157ec83a852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:08.908026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 977/1928] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:08.908026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b351b61-5fa8-43ea-9dc3-3ec5fca94b90 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.908026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b351b61-5fa8-43ea-9dc3-3ec5fca94b90 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.908026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b351b61-5fa8-43ea-9dc3-3ec5fca94b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.915959 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bbaf3-3731-4d52-8f24-7b843c0fccf0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:08.924716 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654e9dd-362e-4ffa-9142-dea445318152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:08.924716 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654e9dd-362e-4ffa-9142-dea445318152 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.927503 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-6b351b61-5fa8-43ea-9dc3-3ec5fca94b90 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:08.928862 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6b351b61-5fa8-43ea-9dc3-3ec5fca94b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:08.929570 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654e9dd-362e-4ffa-9142-dea445318152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.930375 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654e9dd-362e-4ffa-9142-dea445318152 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.932096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654e9dd-362e-4ffa-9142-dea445318152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:08.934810 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654e9dd-362e-4ffa-9142-dea445318152 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:08.939036 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 978/1929] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:08.943341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633b0a2-49c6-4667-bbf5-bcac9694948b None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:08.943636 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633b0a2-49c6-4667-bbf5-bcac9694948b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:08.943919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633b0a2-49c6-4667-bbf5-bcac9694948b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:08.965472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5633b0a2-49c6-4667-bbf5-bcac9694948b None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:08.966768 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5633b0a2-49c6-4667-bbf5-bcac9694948b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:08.977266 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 979/1930] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:08.977920 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633b0a2-49c6-4667-bbf5-bcac9694948b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:08.979979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5633b0a2-49c6-4667-bbf5-bcac9694948b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:09.020178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 952/1931] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:08 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:09.021112 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654e9dd-362e-4ffa-9142-dea445318152 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:09.031369 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654e9dd-362e-4ffa-9142-dea445318152 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.036856 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e8984-aed4-40af-8ae9-945a047ead3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.037559 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e8984-aed4-40af-8ae9-945a047ead3a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.037840 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e8984-aed4-40af-8ae9-945a047ead3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.038751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e8984-aed4-40af-8ae9-945a047ead3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.039538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e8984-aed4-40af-8ae9-945a047ead3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:09:09.039846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e8984-aed4-40af-8ae9-945a047ead3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.041535 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e8984-aed4-40af-8ae9-945a047ead3a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:09.049240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633b0a2-49c6-4667-bbf5-bcac9694948b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.054083 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7809a-2f77-4f07-895e-4b4d66393f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.054818 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7809a-2f77-4f07-895e-4b4d66393f37 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.058731 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 953/1932] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:09:09.058868 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7809a-2f77-4f07-895e-4b4d66393f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.058868 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7809a-2f77-4f07-895e-4b4d66393f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.059063 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e8984-aed4-40af-8ae9-945a047ead3a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:09.066320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7809a-2f77-4f07-895e-4b4d66393f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.067743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e8984-aed4-40af-8ae9-945a047ead3a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.068025 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7809a-2f77-4f07-895e-4b4d66393f37 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:09.073631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33124d3-1bda-44a1-beb2-c1afb1f7284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.074033 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33124d3-1bda-44a1-beb2-c1afb1f7284d admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.074033 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33124d3-1bda-44a1-beb2-c1afb1f7284d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.074316 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33124d3-1bda-44a1-beb2-c1afb1f7284d admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.075038 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33124d3-1bda-44a1-beb2-c1afb1f7284d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.076658 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33124d3-1bda-44a1-beb2-c1afb1f7284d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:09.078551 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 980/1933] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:09.079258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7809a-2f77-4f07-895e-4b4d66393f37 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:09.094278 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7809a-2f77-4f07-895e-4b4d66393f37 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.098781 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 954/1934] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:09.102922 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33124d3-1bda-44a1-beb2-c1afb1f7284d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:09.103058 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f092ec2-7875-4d4d-bab7-621b03ab4d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.103884 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f092ec2-7875-4d4d-bab7-621b03ab4d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.104171 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f092ec2-7875-4d4d-bab7-621b03ab4d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.104451 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f092ec2-7875-4d4d-bab7-621b03ab4d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.105222 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f092ec2-7875-4d4d-bab7-621b03ab4d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.107111 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f092ec2-7875-4d4d-bab7-621b03ab4d33 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:09.113084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33124d3-1bda-44a1-beb2-c1afb1f7284d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.118282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffef12-5184-421f-87aa-2d5da6163ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.118928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffef12-5184-421f-87aa-2d5da6163ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.119205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffef12-5184-421f-87aa-2d5da6163ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.119504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffef12-5184-421f-87aa-2d5da6163ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.120257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffef12-5184-421f-87aa-2d5da6163ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.121996 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffef12-5184-421f-87aa-2d5da6163ea6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:09.131585 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 955/1935] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:09.135541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffef12-5184-421f-87aa-2d5da6163ea6 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:09.144781 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffef12-5184-421f-87aa-2d5da6163ea6 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.149335 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eade5e9-a512-44ab-bc5c-55019b5cca3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.150799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eade5e9-a512-44ab-bc5c-55019b5cca3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.151144 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eade5e9-a512-44ab-bc5c-55019b5cca3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.151431 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eade5e9-a512-44ab-bc5c-55019b5cca3f admin admin] PATH_INFO: `/v3/projects/27292b91f68742a18b3e0b401d4f0ccd/users/abe5a76b847c4bc5b5bc321b41d848c8/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.165946 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eade5e9-a512-44ab-bc5c-55019b5cca3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27292b91f68742a18b3e0b401d4f0ccd, user_id=abe5a76b847c4bc5b5bc321b41d848c8, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.168641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eade5e9-a512-44ab-bc5c-55019b5cca3f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:09.218917 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 981/1936] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:09 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:09.219966 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f092ec2-7875-4d4d-bab7-621b03ab4d33 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:09.277736 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 956/1937] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:09 2022] PUT /identity/v3/projects/27292b91f68742a18b3e0b401d4f0ccd/users/abe5a76b847c4bc5b5bc321b41d848c8/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:09.288037 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f092ec2-7875-4d4d-bab7-621b03ab4d33 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.290650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76269522-cdfa-4bf1-91bc-768e9af86211 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.290941 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76269522-cdfa-4bf1-91bc-768e9af86211 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.291216 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76269522-cdfa-4bf1-91bc-768e9af86211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.326026 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-76269522-cdfa-4bf1-91bc-768e9af86211 None None] MFA Rules not processed for user `abe5a76b847c4bc5b5bc321b41d848c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:09.327242 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-76269522-cdfa-4bf1-91bc-768e9af86211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:09.352113 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7160d-ec7a-44e9-9f7a-959dedc1cfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.352902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7160d-ec7a-44e9-9f7a-959dedc1cfca admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.353281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7160d-ec7a-44e9-9f7a-959dedc1cfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.353560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7160d-ec7a-44e9-9f7a-959dedc1cfca admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.354257 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7160d-ec7a-44e9-9f7a-959dedc1cfca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.356229 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7160d-ec7a-44e9-9f7a-959dedc1cfca admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:09.406416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 957/1938] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:09:09.410588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76269522-cdfa-4bf1-91bc-768e9af86211 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:09.425137 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76269522-cdfa-4bf1-91bc-768e9af86211 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.429044 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cc31b-ae72-4832-9555-773ad0dbef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.429737 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cc31b-ae72-4832-9555-773ad0dbef34 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.430150 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cc31b-ae72-4832-9555-773ad0dbef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.430507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cc31b-ae72-4832-9555-773ad0dbef34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.431205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cc31b-ae72-4832-9555-773ad0dbef34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.433188 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cc31b-ae72-4832-9555-773ad0dbef34 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:09.449823 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 982/1939] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:09 2022] POST /identity/v3/users => generated 285 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:09.453897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7160d-ec7a-44e9-9f7a-959dedc1cfca admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:09.464112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7160d-ec7a-44e9-9f7a-959dedc1cfca admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.468790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932240e-fb52-4618-88cd-4a2883e48419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.469476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932240e-fb52-4618-88cd-4a2883e48419 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.469816 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932240e-fb52-4618-88cd-4a2883e48419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.470135 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932240e-fb52-4618-88cd-4a2883e48419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.470857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932240e-fb52-4618-88cd-4a2883e48419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.473120 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932240e-fb52-4618-88cd-4a2883e48419 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:09.483258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 983/1940] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:09.487418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932240e-fb52-4618-88cd-4a2883e48419 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:09.498870 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932240e-fb52-4618-88cd-4a2883e48419 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.506453 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1960ab-4f41-4400-a965-1da41f39af71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.507322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1960ab-4f41-4400-a965-1da41f39af71 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.507603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1960ab-4f41-4400-a965-1da41f39af71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.507884 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1960ab-4f41-4400-a965-1da41f39af71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.508757 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1960ab-4f41-4400-a965-1da41f39af71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.510798 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1960ab-4f41-4400-a965-1da41f39af71 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:09.528692 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 958/1941] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:09 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:09.534420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cc31b-ae72-4832-9555-773ad0dbef34 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:09.539259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 984/1942] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:09.540205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1960ab-4f41-4400-a965-1da41f39af71 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:09.575481 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1960ab-4f41-4400-a965-1da41f39af71 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.614340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cc31b-ae72-4832-9555-773ad0dbef34 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.620070 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42229e84-8a39-4851-818e-7af7d2a2c3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.620761 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229e84-8a39-4851-818e-7af7d2a2c3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.621034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229e84-8a39-4851-818e-7af7d2a2c3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.621346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229e84-8a39-4851-818e-7af7d2a2c3a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.622047 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42229e84-8a39-4851-818e-7af7d2a2c3a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.624248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42229e84-8a39-4851-818e-7af7d2a2c3a4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:09.638521 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ae611-43a6-4cb0-bc18-79bb286e7103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.639697 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ae611-43a6-4cb0-bc18-79bb286e7103 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.640123 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ae611-43a6-4cb0-bc18-79bb286e7103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.640528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ae611-43a6-4cb0-bc18-79bb286e7103 admin admin] PATH_INFO: `/v3/projects/d52e7e5611a743529ff106c4f4ca58fb/users/1463e87cd3944dd2bfb3f8407301f2cf/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.666825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ae611-43a6-4cb0-bc18-79bb286e7103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52e7e5611a743529ff106c4f4ca58fb, user_id=1463e87cd3944dd2bfb3f8407301f2cf, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.670078 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ae611-43a6-4cb0-bc18-79bb286e7103 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:09.724150 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 959/1943] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:09 2022] POST /identity/v3/users => generated 299 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:09.725381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42229e84-8a39-4851-818e-7af7d2a2c3a4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:09.737684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42229e84-8a39-4851-818e-7af7d2a2c3a4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.751359 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e130c76-faec-4a22-b092-f8a837229a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.751545 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 985/1944] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:09 2022] PUT /identity/v3/projects/d52e7e5611a743529ff106c4f4ca58fb/users/1463e87cd3944dd2bfb3f8407301f2cf/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:09.757916 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e130c76-faec-4a22-b092-f8a837229a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.758273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e130c76-faec-4a22-b092-f8a837229a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.758610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e130c76-faec-4a22-b092-f8a837229a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.759444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e130c76-faec-4a22-b092-f8a837229a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.761626 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e130c76-faec-4a22-b092-f8a837229a3e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:09.765578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1e14f-4ee3-4070-b423-7d0f7da37ede None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.765578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1e14f-4ee3-4070-b423-7d0f7da37ede None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.765578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1e14f-4ee3-4070-b423-7d0f7da37ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.783861 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 960/1945] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:09.788122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e130c76-faec-4a22-b092-f8a837229a3e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:09.804948 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e130c76-faec-4a22-b092-f8a837229a3e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.815342 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-63f1e14f-4ee3-4070-b423-7d0f7da37ede None None] MFA Rules not processed for user `1463e87cd3944dd2bfb3f8407301f2cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:09.820678 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-63f1e14f-4ee3-4070-b423-7d0f7da37ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:09.898327 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc5cc9-dfe3-44da-a38e-abcba052f16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.899921 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc5cc9-dfe3-44da-a38e-abcba052f16d admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.900214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc5cc9-dfe3-44da-a38e-abcba052f16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.901333 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc5cc9-dfe3-44da-a38e-abcba052f16d admin admin] PATH_INFO: `/v3/projects/cd4fd98f47bb471cbf9d3e50f1c52395/users/4c2789ea6bbb4fd38c2cb8009166e37e/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.914450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 986/1946] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:09:09.915522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1e14f-4ee3-4070-b423-7d0f7da37ede None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:09.929407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc5cc9-dfe3-44da-a38e-abcba052f16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4fd98f47bb471cbf9d3e50f1c52395, user_id=4c2789ea6bbb4fd38c2cb8009166e37e, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.931587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1e14f-4ee3-4070-b423-7d0f7da37ede None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:09.933015 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc5cc9-dfe3-44da-a38e-abcba052f16d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:09.938069 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c851888-56c1-4e62-931d-42a15821a0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:09.939014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c851888-56c1-4e62-931d-42a15821a0bd admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:09.939430 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c851888-56c1-4e62-931d-42a15821a0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:09.940751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c851888-56c1-4e62-931d-42a15821a0bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:09.942123 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c851888-56c1-4e62-931d-42a15821a0bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:09.944146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c851888-56c1-4e62-931d-42a15821a0bd admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:10.024019 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 961/1947] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:09 2022] PUT /identity/v3/projects/cd4fd98f47bb471cbf9d3e50f1c52395/users/4c2789ea6bbb4fd38c2cb8009166e37e/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:10.027999 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc5cc9-dfe3-44da-a38e-abcba052f16d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:10.053451 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 987/1948] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:09 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:09:10.058242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c851888-56c1-4e62-931d-42a15821a0bd admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:10.095799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc5cc9-dfe3-44da-a38e-abcba052f16d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:10.128037 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c851888-56c1-4e62-931d-42a15821a0bd admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:10.133395 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b74cc1-ebbc-43d3-a6fd-871043aeee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:10.134074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b74cc1-ebbc-43d3-a6fd-871043aeee36 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:10.134358 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b74cc1-ebbc-43d3-a6fd-871043aeee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:10.134636 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b74cc1-ebbc-43d3-a6fd-871043aeee36 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:10.135335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b74cc1-ebbc-43d3-a6fd-871043aeee36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:10.137338 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b74cc1-ebbc-43d3-a6fd-871043aeee36 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:10.155146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9edbe-ffb6-4e91-a44b-c42a9d7a8702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:10.155808 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9edbe-ffb6-4e91-a44b-c42a9d7a8702 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:10.156090 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9edbe-ffb6-4e91-a44b-c42a9d7a8702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:10.156370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9edbe-ffb6-4e91-a44b-c42a9d7a8702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:10.160657 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9edbe-ffb6-4e91-a44b-c42a9d7a8702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:10.160657 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9edbe-ffb6-4e91-a44b-c42a9d7a8702 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:10.171888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 962/1949] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:10.173170 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9edbe-ffb6-4e91-a44b-c42a9d7a8702 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:10.183604 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9edbe-ffb6-4e91-a44b-c42a9d7a8702 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:10.188294 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e91dc4-f85b-4eb6-a46b-7c4876c95550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:10.189221 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e91dc4-f85b-4eb6-a46b-7c4876c95550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:10.189506 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e91dc4-f85b-4eb6-a46b-7c4876c95550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:10.189784 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e91dc4-f85b-4eb6-a46b-7c4876c95550 admin admin] PATH_INFO: `/v3/projects/cd4fd98f47bb471cbf9d3e50f1c52395/users/4c2789ea6bbb4fd38c2cb8009166e37e/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:10.192386 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e91dc4-f85b-4eb6-a46b-7c4876c95550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4fd98f47bb471cbf9d3e50f1c52395, user_id=4c2789ea6bbb4fd38c2cb8009166e37e, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:10.195343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e91dc4-f85b-4eb6-a46b-7c4876c95550 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:10.205890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 963/1950] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:10 2022] PUT /identity/v3/projects/cd4fd98f47bb471cbf9d3e50f1c52395/users/4c2789ea6bbb4fd38c2cb8009166e37e/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:10.216442 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb919746-7f88-48d2-ba1f-1f5f56522746 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:10.216802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb919746-7f88-48d2-ba1f-1f5f56522746 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:10.217120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb919746-7f88-48d2-ba1f-1f5f56522746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:10.234086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 988/1951] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:10 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:09:10.238531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b74cc1-ebbc-43d3-a6fd-871043aeee36 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:10.249670 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b74cc1-ebbc-43d3-a6fd-871043aeee36 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:10.252240 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-fb919746-7f88-48d2-ba1f-1f5f56522746 None None] MFA Rules not processed for user `4c2789ea6bbb4fd38c2cb8009166e37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:10.254258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fb919746-7f88-48d2-ba1f-1f5f56522746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:10.314189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcd4a9-245f-4fe6-9436-b5578383491e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:10.314794 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd4a9-245f-4fe6-9436-b5578383491e admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:10.315088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd4a9-245f-4fe6-9436-b5578383491e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:10.315368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd4a9-245f-4fe6-9436-b5578383491e admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:10.316169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcd4a9-245f-4fe6-9436-b5578383491e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:10.318938 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcd4a9-245f-4fe6-9436-b5578383491e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:10.329036 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 964/1952] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:10.330125 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 989/1953] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:10.337560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb919746-7f88-48d2-ba1f-1f5f56522746 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:10.344779 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcd4a9-245f-4fe6-9436-b5578383491e admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:10.346655 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8edcd4a9-245f-4fe6-9436-b5578383491e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:10.348454 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb919746-7f88-48d2-ba1f-1f5f56522746 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:10.353432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e3149-a32e-4fc7-aaa4-c44134bcc4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:10.355990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e3149-a32e-4fc7-aaa4-c44134bcc4fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:10.355990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e3149-a32e-4fc7-aaa4-c44134bcc4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:10.355990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e3149-a32e-4fc7-aaa4-c44134bcc4fd admin admin] PATH_INFO: `/v3/projects/1123f1587a5e43f6910ee6e76f000cac/users/3f5e64ba5a164815986ebf5c2fbda021/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:10.370681 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e3149-a32e-4fc7-aaa4-c44134bcc4fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1123f1587a5e43f6910ee6e76f000cac, user_id=3f5e64ba5a164815986ebf5c2fbda021, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:10.373480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e3149-a32e-4fc7-aaa4-c44134bcc4fd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:10.409263 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcd4a9-245f-4fe6-9436-b5578383491e admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:10.413835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37792034-b1c5-44da-829b-187d6fd0b982 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:10.414489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37792034-b1c5-44da-829b-187d6fd0b982 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:10.414777 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37792034-b1c5-44da-829b-187d6fd0b982 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:10.415055 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37792034-b1c5-44da-829b-187d6fd0b982 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:10.425616 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37792034-b1c5-44da-829b-187d6fd0b982 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:10.427562 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37792034-b1c5-44da-829b-187d6fd0b982 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:10.438551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 965/1954] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:10 2022] PUT /identity/v3/projects/1123f1587a5e43f6910ee6e76f000cac/users/3f5e64ba5a164815986ebf5c2fbda021/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:10.440150 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 990/1955] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:10.442208 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e3149-a32e-4fc7-aaa4-c44134bcc4fd admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:10.506093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e3149-a32e-4fc7-aaa4-c44134bcc4fd admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:10.510616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af370ece-f144-42aa-b04c-92564006b485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:10.511285 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af370ece-f144-42aa-b04c-92564006b485 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:10.511596 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af370ece-f144-42aa-b04c-92564006b485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:10.511954 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af370ece-f144-42aa-b04c-92564006b485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:10.512846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af370ece-f144-42aa-b04c-92564006b485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:10.514520 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af370ece-f144-42aa-b04c-92564006b485 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:10.524790 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 966/1956] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:10.528806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37792034-b1c5-44da-829b-187d6fd0b982 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:10.539914 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37792034-b1c5-44da-829b-187d6fd0b982 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:10.544566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96fa68-f2cf-4973-a74d-aae0199ed511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:10.545546 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96fa68-f2cf-4973-a74d-aae0199ed511 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:10.546866 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96fa68-f2cf-4973-a74d-aae0199ed511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:10.546866 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96fa68-f2cf-4973-a74d-aae0199ed511 admin admin] PATH_INFO: `/v3/projects/1123f1587a5e43f6910ee6e76f000cac/users/3f5e64ba5a164815986ebf5c2fbda021/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:10.548324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96fa68-f2cf-4973-a74d-aae0199ed511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1123f1587a5e43f6910ee6e76f000cac, user_id=3f5e64ba5a164815986ebf5c2fbda021, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:10.552078 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96fa68-f2cf-4973-a74d-aae0199ed511 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:10.564273 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 991/1957] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:10 2022] PUT /identity/v3/projects/1123f1587a5e43f6910ee6e76f000cac/users/3f5e64ba5a164815986ebf5c2fbda021/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:10.575673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2f5d2-0d2a-4f1b-8eab-729eca588ee0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:10.575964 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2f5d2-0d2a-4f1b-8eab-729eca588ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:10.576244 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2f5d2-0d2a-4f1b-8eab-729eca588ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:10.609946 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4cf2f5d2-0d2a-4f1b-8eab-729eca588ee0 None None] MFA Rules not processed for user `3f5e64ba5a164815986ebf5c2fbda021`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:10.611809 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4cf2f5d2-0d2a-4f1b-8eab-729eca588ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:10.707700 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 967/1958] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:10.715472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96fa68-f2cf-4973-a74d-aae0199ed511 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:10.725566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbc0b7-ceda-45c8-a132-6f0a0c8f1a58 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:10.725744 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0c96fa68-f2cf-4973-a74d-aae0199ed511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:10.726277 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbc0b7-ceda-45c8-a132-6f0a0c8f1a58 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:10.726782 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbc0b7-ceda-45c8-a132-6f0a0c8f1a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:10.756784 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6bdbc0b7-ceda-45c8-a132-6f0a0c8f1a58 None None] MFA Rules not processed for user `f11699e8a7194fafb53513106cf40b96`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:10.758135 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6bdbc0b7-ceda-45c8-a132-6f0a0c8f1a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:10.812342 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96fa68-f2cf-4973-a74d-aae0199ed511 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:10.819162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ef738-5c7b-4726-83f2-c843bd09e3ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:10.820177 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ef738-5c7b-4726-83f2-c843bd09e3ad service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:10.820544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ef738-5c7b-4726-83f2-c843bd09e3ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:10.820926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ef738-5c7b-4726-83f2-c843bd09e3ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:10.834544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ef738-5c7b-4726-83f2-c843bd09e3ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:10.836207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ef738-5c7b-4726-83f2-c843bd09e3ad service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:10.852047 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 992/1959] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:10.863807 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 968/1960] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:09:10.868473 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ef738-5c7b-4726-83f2-c843bd09e3ad service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:10.993912 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ef738-5c7b-4726-83f2-c843bd09e3ad service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:10.998165 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbc0b7-ceda-45c8-a132-6f0a0c8f1a58 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:11.002336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb237-61ed-4af6-a7c1-0cce4e92a4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:11.003249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb237-61ed-4af6-a7c1-0cce4e92a4ae admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:11.004279 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb237-61ed-4af6-a7c1-0cce4e92a4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:11.004566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb237-61ed-4af6-a7c1-0cce4e92a4ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:11.005332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfb237-61ed-4af6-a7c1-0cce4e92a4ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:11.007493 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfb237-61ed-4af6-a7c1-0cce4e92a4ae admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:11.013894 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbc0b7-ceda-45c8-a132-6f0a0c8f1a58 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:11.025421 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80676f78-5ff7-4725-adcc-a2ae5e9bc6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:11.026741 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80676f78-5ff7-4725-adcc-a2ae5e9bc6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:11.027098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80676f78-5ff7-4725-adcc-a2ae5e9bc6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:11.027524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80676f78-5ff7-4725-adcc-a2ae5e9bc6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:11.110086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 993/1961] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:10 2022] POST /identity/v3/projects => generated 405 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:11.112269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb237-61ed-4af6-a7c1-0cce4e92a4ae admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:11.164323 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80676f78-5ff7-4725-adcc-a2ae5e9bc6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:11.165874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80676f78-5ff7-4725-adcc-a2ae5e9bc6a1 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:11.177009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 969/1962] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:09:11.201415 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb237-61ed-4af6-a7c1-0cce4e92a4ae admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:11.208452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef642182-f239-4b2c-9e58-7dba6160c687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:11.209432 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef642182-f239-4b2c-9e58-7dba6160c687 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:11.209677 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef642182-f239-4b2c-9e58-7dba6160c687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:11.210971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef642182-f239-4b2c-9e58-7dba6160c687 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:11.210971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef642182-f239-4b2c-9e58-7dba6160c687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:11.212749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef642182-f239-4b2c-9e58-7dba6160c687 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:11.312798 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 994/1963] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:11 2022] POST /identity/v3/users => generated 309 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:11.317276 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80676f78-5ff7-4725-adcc-a2ae5e9bc6a1 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:11.340160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80676f78-5ff7-4725-adcc-a2ae5e9bc6a1 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:11.345482 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f7218-a17b-4e7a-8b8c-9be69d021c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:11.346169 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f7218-a17b-4e7a-8b8c-9be69d021c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:11.346448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f7218-a17b-4e7a-8b8c-9be69d021c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:11.346724 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f7218-a17b-4e7a-8b8c-9be69d021c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:11.348142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f7218-a17b-4e7a-8b8c-9be69d021c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:11.349858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f7218-a17b-4e7a-8b8c-9be69d021c56 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:11.361544 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 970/1964] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:11.366461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef642182-f239-4b2c-9e58-7dba6160c687 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:11.380872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef642182-f239-4b2c-9e58-7dba6160c687 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:11.388470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e20ff-64bc-41b2-8613-2d8a05f9a624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:11.390057 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e20ff-64bc-41b2-8613-2d8a05f9a624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:11.390346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e20ff-64bc-41b2-8613-2d8a05f9a624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:11.390630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e20ff-64bc-41b2-8613-2d8a05f9a624 admin admin] PATH_INFO: `/v3/projects/8162a14d4e714ae3ab6afa53108956be/users/cd0734f459394294a7b59ce2741df679/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:11.454280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e20ff-64bc-41b2-8613-2d8a05f9a624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8162a14d4e714ae3ab6afa53108956be, user_id=cd0734f459394294a7b59ce2741df679, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:11.458151 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e20ff-64bc-41b2-8613-2d8a05f9a624 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:11.541464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 995/1965] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:11 2022] PUT /identity/v3/projects/8162a14d4e714ae3ab6afa53108956be/users/cd0734f459394294a7b59ce2741df679/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:11.545492 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f7218-a17b-4e7a-8b8c-9be69d021c56 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:11.577283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f7218-a17b-4e7a-8b8c-9be69d021c56 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:11.639668 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f00a5-7353-4706-81ce-d7de3f9691b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:11.640381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f00a5-7353-4706-81ce-d7de3f9691b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:11.640703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f00a5-7353-4706-81ce-d7de3f9691b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:11.640952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f00a5-7353-4706-81ce-d7de3f9691b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:11.641804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f00a5-7353-4706-81ce-d7de3f9691b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:11.643515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f00a5-7353-4706-81ce-d7de3f9691b5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:11.653875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 971/1966] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:11.658027 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e20ff-64bc-41b2-8613-2d8a05f9a624 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:11.668904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e20ff-64bc-41b2-8613-2d8a05f9a624 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:11.674126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e347a6a-11ca-4ea1-abad-762c8f76af66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:11.675018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e347a6a-11ca-4ea1-abad-762c8f76af66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:11.675308 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e347a6a-11ca-4ea1-abad-762c8f76af66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:11.676118 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e347a6a-11ca-4ea1-abad-762c8f76af66 admin admin] PATH_INFO: `/v3/projects/8162a14d4e714ae3ab6afa53108956be/users/cd0734f459394294a7b59ce2741df679/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:11.678556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e347a6a-11ca-4ea1-abad-762c8f76af66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8162a14d4e714ae3ab6afa53108956be, user_id=cd0734f459394294a7b59ce2741df679, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:11.680800 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e347a6a-11ca-4ea1-abad-762c8f76af66 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:11.692163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 996/1967] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:11 2022] PUT /identity/v3/projects/8162a14d4e714ae3ab6afa53108956be/users/cd0734f459394294a7b59ce2741df679/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:11.752817 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f00a5-7353-4706-81ce-d7de3f9691b5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:11.764078 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f00a5-7353-4706-81ce-d7de3f9691b5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:11.820417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71467a96-ef86-4211-80fd-4c0c65dfe538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:11.821378 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71467a96-ef86-4211-80fd-4c0c65dfe538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:11.821661 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71467a96-ef86-4211-80fd-4c0c65dfe538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:11.821932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71467a96-ef86-4211-80fd-4c0c65dfe538 admin admin] PATH_INFO: `/v3/users/abe5a76b847c4bc5b5bc321b41d848c8` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:11.823122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71467a96-ef86-4211-80fd-4c0c65dfe538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe5a76b847c4bc5b5bc321b41d848c8)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:11.825314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71467a96-ef86-4211-80fd-4c0c65dfe538 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:12.084314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-71467a96-ef86-4211-80fd-4c0c65dfe538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe5a76b847c4bc5b5bc321b41d848c8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:12.086019 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-71467a96-ef86-4211-80fd-4c0c65dfe538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe5a76b847c4bc5b5bc321b41d848c8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:12.087286 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-71467a96-ef86-4211-80fd-4c0c65dfe538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe5a76b847c4bc5b5bc321b41d848c8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:12.151188 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-71467a96-ef86-4211-80fd-4c0c65dfe538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe5a76b847c4bc5b5bc321b41d848c8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:12.165607 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-71467a96-ef86-4211-80fd-4c0c65dfe538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe5a76b847c4bc5b5bc321b41d848c8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:12.189365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 972/1968] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:11 2022] DELETE /identity/v3/users/abe5a76b847c4bc5b5bc321b41d848c8 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:12.192435 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90716b9-b061-4343-868c-747a28288b7e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:12.192888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90716b9-b061-4343-868c-747a28288b7e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:12.193180 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90716b9-b061-4343-868c-747a28288b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:12.213968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-b90716b9-b061-4343-868c-747a28288b7e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:12.215225 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b90716b9-b061-4343-868c-747a28288b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:12.293878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 997/1969] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:12.303033 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71467a96-ef86-4211-80fd-4c0c65dfe538 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:12.304582 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-71467a96-ef86-4211-80fd-4c0c65dfe538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:12.368745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71467a96-ef86-4211-80fd-4c0c65dfe538 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:12.373253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1573b0e-273e-423e-b41a-fc661f6afd60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:12.374227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1573b0e-273e-423e-b41a-fc661f6afd60 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:12.374433 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1573b0e-273e-423e-b41a-fc661f6afd60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:12.374940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1573b0e-273e-423e-b41a-fc661f6afd60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:12.387554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1573b0e-273e-423e-b41a-fc661f6afd60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:12.388778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1573b0e-273e-423e-b41a-fc661f6afd60 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:12.401702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 973/1970] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:13.067574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90716b9-b061-4343-868c-747a28288b7e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:13.069431 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b90716b9-b061-4343-868c-747a28288b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:13.083005 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90716b9-b061-4343-868c-747a28288b7e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:13.096311 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:13.097956 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:13.098417 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:13.098812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] PATH_INFO: `/v3/projects/27292b91f68742a18b3e0b401d4f0ccd` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:13.101388 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27292b91f68742a18b3e0b401d4f0ccd)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:13.103439 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:13.196924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565903-69ac-4369-8bd2-0579e6f4a208 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:13.197454 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565903-69ac-4369-8bd2-0579e6f4a208 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:13.197543 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565903-69ac-4369-8bd2-0579e6f4a208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:13.224864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b3565903-69ac-4369-8bd2-0579e6f4a208 None None] MFA Rules not processed for user `cd0734f459394294a7b59ce2741df679`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:13.226138 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b3565903-69ac-4369-8bd2-0579e6f4a208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:13.296240 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 974/1971] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:13 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:09:13.314159 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27292b91f68742a18b3e0b401d4f0ccd', 'request_id': 'req-727ebdfa-2c05-4569-b286-ea60c1696733'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:13.435319 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27292b91f68742a18b3e0b401d4f0ccd', 'request_id': 'req-727ebdfa-2c05-4569-b286-ea60c1696733'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:13.443499 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27292b91f68742a18b3e0b401d4f0ccd', 'request_id': 'req-727ebdfa-2c05-4569-b286-ea60c1696733'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:13.456114 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] The token cache is being invalidate because project 27292b91f68742a18b3e0b401d4f0ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:13.456440 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:13.457258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:13.459455 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 998/1972] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:13 2022] DELETE /identity/v3/projects/27292b91f68742a18b3e0b401d4f0ccd => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:13.463140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3565903-69ac-4369-8bd2-0579e6f4a208 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:13.474666 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3565903-69ac-4369-8bd2-0579e6f4a208 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:13.542161 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ef358-45e3-409e-94cd-eba5b3319065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:13.543055 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ef358-45e3-409e-94cd-eba5b3319065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:13.543329 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ef358-45e3-409e-94cd-eba5b3319065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:13.543607 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ef358-45e3-409e-94cd-eba5b3319065 admin admin] PATH_INFO: `/v3/users/4c2789ea6bbb4fd38c2cb8009166e37e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:13.544854 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ef358-45e3-409e-94cd-eba5b3319065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2789ea6bbb4fd38c2cb8009166e37e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:13.546891 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ef358-45e3-409e-94cd-eba5b3319065 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:13.742429 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-566ef358-45e3-409e-94cd-eba5b3319065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2789ea6bbb4fd38c2cb8009166e37e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:13.743108 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-566ef358-45e3-409e-94cd-eba5b3319065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2789ea6bbb4fd38c2cb8009166e37e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:13.743731 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-566ef358-45e3-409e-94cd-eba5b3319065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2789ea6bbb4fd38c2cb8009166e37e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:13.786247 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-566ef358-45e3-409e-94cd-eba5b3319065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2789ea6bbb4fd38c2cb8009166e37e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:13.787925 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:13.789485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:13.799837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-566ef358-45e3-409e-94cd-eba5b3319065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2789ea6bbb4fd38c2cb8009166e37e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:13.803165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ebdfa-2c05-4569-b286-ea60c1696733 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:13.809357 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850716b5-62fc-410e-a8ea-fafd71227f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:13.810428 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850716b5-62fc-410e-a8ea-fafd71227f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:13.810732 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850716b5-62fc-410e-a8ea-fafd71227f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:13.811147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850716b5-62fc-410e-a8ea-fafd71227f37 admin admin] PATH_INFO: `/v3/users/5087bb57b9304e6c9009e4c593abaaaf` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:13.812370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850716b5-62fc-410e-a8ea-fafd71227f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5087bb57b9304e6c9009e4c593abaaaf)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:13.816227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 975/1973] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:13 2022] DELETE /identity/v3/users/4c2789ea6bbb4fd38c2cb8009166e37e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:13.816382 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850716b5-62fc-410e-a8ea-fafd71227f37 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:14.040000 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-850716b5-62fc-410e-a8ea-fafd71227f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5087bb57b9304e6c9009e4c593abaaaf'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:14.040642 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-850716b5-62fc-410e-a8ea-fafd71227f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5087bb57b9304e6c9009e4c593abaaaf'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:14.041280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-850716b5-62fc-410e-a8ea-fafd71227f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5087bb57b9304e6c9009e4c593abaaaf'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:14.056653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-850716b5-62fc-410e-a8ea-fafd71227f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5087bb57b9304e6c9009e4c593abaaaf'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:14.067461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-850716b5-62fc-410e-a8ea-fafd71227f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5087bb57b9304e6c9009e4c593abaaaf'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:14.151545 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 999/1974] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:13 2022] DELETE /identity/v3/users/5087bb57b9304e6c9009e4c593abaaaf => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:14.155932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90868792-f85d-48b5-98b8-aea2165ae083 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:14.156225 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90868792-f85d-48b5-98b8-aea2165ae083 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:14.156501 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90868792-f85d-48b5-98b8-aea2165ae083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:14.178895 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-90868792-f85d-48b5-98b8-aea2165ae083 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:14.180130 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-90868792-f85d-48b5-98b8-aea2165ae083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:14.262256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 976/1975] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:14.274704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850716b5-62fc-410e-a8ea-fafd71227f37 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:14.276335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-850716b5-62fc-410e-a8ea-fafd71227f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:14.336320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850716b5-62fc-410e-a8ea-fafd71227f37 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:14.342429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bd380-ca0b-47e7-b674-773ed9195c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:14.343327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bd380-ca0b-47e7-b674-773ed9195c47 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:14.343832 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bd380-ca0b-47e7-b674-773ed9195c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:14.343964 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90868792-f85d-48b5-98b8-aea2165ae083 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:14.344421 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bd380-ca0b-47e7-b674-773ed9195c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:14.345489 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-90868792-f85d-48b5-98b8-aea2165ae083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:14.366757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90868792-f85d-48b5-98b8-aea2165ae083 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:14.366993 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bd380-ca0b-47e7-b674-773ed9195c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:14.368612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bd380-ca0b-47e7-b674-773ed9195c47 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:14.372616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705c450-c053-43a2-b319-b7492b104bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:14.373795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705c450-c053-43a2-b319-b7492b104bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:14.374230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705c450-c053-43a2-b319-b7492b104bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:14.374670 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705c450-c053-43a2-b319-b7492b104bac admin admin] PATH_INFO: `/v3/projects/cd4fd98f47bb471cbf9d3e50f1c52395` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:14.376041 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705c450-c053-43a2-b319-b7492b104bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4fd98f47bb471cbf9d3e50f1c52395)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:14.379691 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705c450-c053-43a2-b319-b7492b104bac admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:14.382161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1000/1976] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:14.533827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9705c450-c053-43a2-b319-b7492b104bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4fd98f47bb471cbf9d3e50f1c52395', 'request_id': 'req-9705c450-c053-43a2-b319-b7492b104bac'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:14.539594 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9705c450-c053-43a2-b319-b7492b104bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4fd98f47bb471cbf9d3e50f1c52395', 'request_id': 'req-9705c450-c053-43a2-b319-b7492b104bac'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:14.545022 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9705c450-c053-43a2-b319-b7492b104bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4fd98f47bb471cbf9d3e50f1c52395', 'request_id': 'req-9705c450-c053-43a2-b319-b7492b104bac'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:14.632343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9705c450-c053-43a2-b319-b7492b104bac admin admin] The token cache is being invalidate because project cd4fd98f47bb471cbf9d3e50f1c52395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:14.632638 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9705c450-c053-43a2-b319-b7492b104bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:14.633414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9705c450-c053-43a2-b319-b7492b104bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:14.638367 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 977/1977] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:14 2022] DELETE /identity/v3/projects/cd4fd98f47bb471cbf9d3e50f1c52395 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:14.640437 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0096ed0-8287-45ea-bae0-463c9a2b87b8 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:14.640808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0096ed0-8287-45ea-bae0-463c9a2b87b8 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:14.641300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0096ed0-8287-45ea-bae0-463c9a2b87b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:14.671144 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d0096ed0-8287-45ea-bae0-463c9a2b87b8 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:14.673732 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d0096ed0-8287-45ea-bae0-463c9a2b87b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:14.781197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1001/1978] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:14.782913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5588c-bec6-46e8-85f6-49e3cee627e5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:14.783204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5588c-bec6-46e8-85f6-49e3cee627e5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:14.783481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5588c-bec6-46e8-85f6-49e3cee627e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:14.824123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c1b5588c-bec6-46e8-85f6-49e3cee627e5 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:14.826074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c1b5588c-bec6-46e8-85f6-49e3cee627e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:14.842116 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 978/1979] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:14.846499 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0096ed0-8287-45ea-bae0-463c9a2b87b8 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:14.892227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0096ed0-8287-45ea-bae0-463c9a2b87b8 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:14.910218 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a59e2-d007-4947-8c4e-02c82797f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:14.912161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a59e2-d007-4947-8c4e-02c82797f986 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:14.912402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a59e2-d007-4947-8c4e-02c82797f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:14.913917 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a59e2-d007-4947-8c4e-02c82797f986 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:14.918227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a59e2-d007-4947-8c4e-02c82797f986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:09:14.918227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a59e2-d007-4947-8c4e-02c82797f986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:14.919613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a59e2-d007-4947-8c4e-02c82797f986 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:14.946672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1002/1980] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:09:14.953037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5588c-bec6-46e8-85f6-49e3cee627e5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:14.965881 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5588c-bec6-46e8-85f6-49e3cee627e5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:14.970918 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57240f1-603d-407e-853a-d1c995b810d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:14.971656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57240f1-603d-407e-853a-d1c995b810d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:14.972005 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57240f1-603d-407e-853a-d1c995b810d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:14.972405 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57240f1-603d-407e-853a-d1c995b810d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:14.973162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57240f1-603d-407e-853a-d1c995b810d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:14.975111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57240f1-603d-407e-853a-d1c995b810d5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:15.065306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a59e2-d007-4947-8c4e-02c82797f986 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:15.067562 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-183a59e2-d007-4947-8c4e-02c82797f986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:15.069151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 979/1981] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:14 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:15.080976 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57240f1-603d-407e-853a-d1c995b810d5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:15.098240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a59e2-d007-4947-8c4e-02c82797f986 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:15.210462 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:15.212062 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:15.212418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:15.212757 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] PATH_INFO: `/v3/projects/88ffafbb07fd4990b9a019c6f54b10e4` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:15.212952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57240f1-603d-407e-853a-d1c995b810d5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:15.214891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ffafbb07fd4990b9a019c6f54b10e4)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:15.217857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:15.222624 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d7590-4502-405b-acae-1bb7a27754d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:15.223529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d7590-4502-405b-acae-1bb7a27754d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:15.223960 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d7590-4502-405b-acae-1bb7a27754d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:15.224397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d7590-4502-405b-acae-1bb7a27754d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:15.225425 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d7590-4502-405b-acae-1bb7a27754d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:15.228292 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d7590-4502-405b-acae-1bb7a27754d9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:15.374767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 980/1982] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:15 2022] POST /identity/v3/users => generated 289 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:15.376414 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ffafbb07fd4990b9a019c6f54b10e4', 'request_id': 'req-e3b1af65-d60e-4546-9443-e7773c1edbb4'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.377241 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d7590-4502-405b-acae-1bb7a27754d9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:15.388522 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d7590-4502-405b-acae-1bb7a27754d9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:15.453450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cda7cd-62ad-4910-9441-d92edaa06c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:15.454234 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cda7cd-62ad-4910-9441-d92edaa06c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:15.454461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ffafbb07fd4990b9a019c6f54b10e4', 'request_id': 'req-e3b1af65-d60e-4546-9443-e7773c1edbb4'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.454568 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cda7cd-62ad-4910-9441-d92edaa06c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:15.454950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cda7cd-62ad-4910-9441-d92edaa06c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:15.455879 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cda7cd-62ad-4910-9441-d92edaa06c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:15.458159 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cda7cd-62ad-4910-9441-d92edaa06c29 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:15.462303 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ffafbb07fd4990b9a019c6f54b10e4', 'request_id': 'req-e3b1af65-d60e-4546-9443-e7773c1edbb4'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.468533 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 981/1983] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:15.469498 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cda7cd-62ad-4910-9441-d92edaa06c29 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:15.471566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-80cda7cd-62ad-4910-9441-d92edaa06c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:15.486596 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cda7cd-62ad-4910-9441-d92edaa06c29 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:15.490615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] The token cache is being invalidate because project 88ffafbb07fd4990b9a019c6f54b10e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:15.490615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.491351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.492195 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685dd8d-6a59-465e-aff0-6731ab8c29cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:15.493346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685dd8d-6a59-465e-aff0-6731ab8c29cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:15.493856 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685dd8d-6a59-465e-aff0-6731ab8c29cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:15.494336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685dd8d-6a59-465e-aff0-6731ab8c29cd admin admin] PATH_INFO: `/v3/users/f11699e8a7194fafb53513106cf40b96` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:15.495775 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685dd8d-6a59-465e-aff0-6731ab8c29cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11699e8a7194fafb53513106cf40b96)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:15.498584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685dd8d-6a59-465e-aff0-6731ab8c29cd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:15.501581 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1003/1984] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:15 2022] DELETE /identity/v3/projects/88ffafbb07fd4990b9a019c6f54b10e4 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:15.501581 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:15.505503 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:15.523246 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1af65-d60e-4546-9443-e7773c1edbb4 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:15.537770 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58524a08-1011-4527-8625-ad13db1f9fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:15.538468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58524a08-1011-4527-8625-ad13db1f9fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:15.538755 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58524a08-1011-4527-8625-ad13db1f9fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:15.539048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58524a08-1011-4527-8625-ad13db1f9fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:15.539763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58524a08-1011-4527-8625-ad13db1f9fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:15.541538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58524a08-1011-4527-8625-ad13db1f9fc5 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:15.552757 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1004/1985] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:15.553532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58524a08-1011-4527-8625-ad13db1f9fc5 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:15.555221 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-58524a08-1011-4527-8625-ad13db1f9fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:15.568219 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58524a08-1011-4527-8625-ad13db1f9fc5 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:15.575008 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9262e9-93b7-4b6d-9f85-ac0e7f34e816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:15.580646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9262e9-93b7-4b6d-9f85-ac0e7f34e816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:15.580646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9262e9-93b7-4b6d-9f85-ac0e7f34e816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:15.580646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9262e9-93b7-4b6d-9f85-ac0e7f34e816 admin admin] PATH_INFO: `/v3/users/367af99c844c4854be33b9521f37111c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:15.580646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9262e9-93b7-4b6d-9f85-ac0e7f34e816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=367af99c844c4854be33b9521f37111c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:15.580646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9262e9-93b7-4b6d-9f85-ac0e7f34e816 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:15.702434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f685dd8d-6a59-465e-aff0-6731ab8c29cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11699e8a7194fafb53513106cf40b96'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.703092 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f685dd8d-6a59-465e-aff0-6731ab8c29cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11699e8a7194fafb53513106cf40b96'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.703702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f685dd8d-6a59-465e-aff0-6731ab8c29cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11699e8a7194fafb53513106cf40b96'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.763070 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f685dd8d-6a59-465e-aff0-6731ab8c29cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11699e8a7194fafb53513106cf40b96'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.776113 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f685dd8d-6a59-465e-aff0-6731ab8c29cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11699e8a7194fafb53513106cf40b96'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.776774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5b9262e9-93b7-4b6d-9f85-ac0e7f34e816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367af99c844c4854be33b9521f37111c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.777485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5b9262e9-93b7-4b6d-9f85-ac0e7f34e816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367af99c844c4854be33b9521f37111c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.778369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5b9262e9-93b7-4b6d-9f85-ac0e7f34e816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367af99c844c4854be33b9521f37111c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.790190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 982/1986] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:15 2022] DELETE /identity/v3/users/f11699e8a7194fafb53513106cf40b96 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:15.791100 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685dd8d-6a59-465e-aff0-6731ab8c29cd admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:15.792655 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f685dd8d-6a59-465e-aff0-6731ab8c29cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:15.798802 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5b9262e9-93b7-4b6d-9f85-ac0e7f34e816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367af99c844c4854be33b9521f37111c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.807677 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5b9262e9-93b7-4b6d-9f85-ac0e7f34e816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367af99c844c4854be33b9521f37111c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:15.867200 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685dd8d-6a59-465e-aff0-6731ab8c29cd admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:15.872432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bc817-d4eb-47c5-b074-0b1aa5f37fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:15.873501 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bc817-d4eb-47c5-b074-0b1aa5f37fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:15.873995 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bc817-d4eb-47c5-b074-0b1aa5f37fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:15.874376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bc817-d4eb-47c5-b074-0b1aa5f37fb6 admin admin] PATH_INFO: `/v3/projects/979f5afc46ba488dbc235fbaea1388d1/users/00a25285f40b4c91b39114f63ec62d2e/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:15.888876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bc817-d4eb-47c5-b074-0b1aa5f37fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979f5afc46ba488dbc235fbaea1388d1, user_id=00a25285f40b4c91b39114f63ec62d2e, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:15.897361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bc817-d4eb-47c5-b074-0b1aa5f37fb6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:15.924887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1005/1987] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:15 2022] DELETE /identity/v3/users/367af99c844c4854be33b9521f37111c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:16.009210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 983/1988] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:15 2022] PUT /identity/v3/projects/979f5afc46ba488dbc235fbaea1388d1/users/00a25285f40b4c91b39114f63ec62d2e/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:16.015490 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b664c7-8357-4748-997c-9356c28ffb3a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:16.015789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b664c7-8357-4748-997c-9356c28ffb3a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:16.016077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b664c7-8357-4748-997c-9356c28ffb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:16.046442 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-87b664c7-8357-4748-997c-9356c28ffb3a None None] MFA Rules not processed for user `00a25285f40b4c91b39114f63ec62d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:16.047805 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-87b664c7-8357-4748-997c-9356c28ffb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:16.079503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bc817-d4eb-47c5-b074-0b1aa5f37fb6 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:16.083439 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a89bc817-d4eb-47c5-b074-0b1aa5f37fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:16.137407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1006/1989] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:16.158282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b664c7-8357-4748-997c-9356c28ffb3a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:16.160752 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-87b664c7-8357-4748-997c-9356c28ffb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:16.197292 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bc817-d4eb-47c5-b074-0b1aa5f37fb6 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:16.202219 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:16.203133 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:16.203406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:16.203677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] PATH_INFO: `/v3/projects/3e583d6cd0354a86aba6e3e89818890b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:16.204848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e583d6cd0354a86aba6e3e89818890b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:16.208673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:16.218487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b664c7-8357-4748-997c-9356c28ffb3a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:16.226046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a948a-32c0-4793-85a3-7f32f502b3f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:16.226660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a948a-32c0-4793-85a3-7f32f502b3f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:16.226952 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a948a-32c0-4793-85a3-7f32f502b3f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:16.227233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a948a-32c0-4793-85a3-7f32f502b3f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:16.239692 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a948a-32c0-4793-85a3-7f32f502b3f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:16.241178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a948a-32c0-4793-85a3-7f32f502b3f0 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:16.269709 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1007/1990] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:16.359650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e583d6cd0354a86aba6e3e89818890b', 'request_id': 'req-2b6a85d1-7633-4eea-9032-d96da6e48ed6'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.366578 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e583d6cd0354a86aba6e3e89818890b', 'request_id': 'req-2b6a85d1-7633-4eea-9032-d96da6e48ed6'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.373009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e583d6cd0354a86aba6e3e89818890b', 'request_id': 'req-2b6a85d1-7633-4eea-9032-d96da6e48ed6'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.410665 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a948a-32c0-4793-85a3-7f32f502b3f0 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:16.412118 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-471a948a-32c0-4793-85a3-7f32f502b3f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:16.427695 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a948a-32c0-4793-85a3-7f32f502b3f0 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:16.453435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] The token cache is being invalidate because project 3e583d6cd0354a86aba6e3e89818890b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:16.453953 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.454392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.455992 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 984/1991] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:16 2022] DELETE /identity/v3/projects/3e583d6cd0354a86aba6e3e89818890b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:16.460385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:16.461773 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:16.494657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c839f8c-ac18-4c89-98af-9ea959c71ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:16.495546 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c839f8c-ac18-4c89-98af-9ea959c71ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:16.495830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c839f8c-ac18-4c89-98af-9ea959c71ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:16.496108 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c839f8c-ac18-4c89-98af-9ea959c71ac3 admin admin] PATH_INFO: `/v3/users/1463e87cd3944dd2bfb3f8407301f2cf` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:16.497406 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c839f8c-ac18-4c89-98af-9ea959c71ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1463e87cd3944dd2bfb3f8407301f2cf)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:16.499334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c839f8c-ac18-4c89-98af-9ea959c71ac3 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:16.546362 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a85d1-7633-4eea-9032-d96da6e48ed6 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:16.552261 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9d436-f400-439e-9462-f62315034432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:16.553209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9d436-f400-439e-9462-f62315034432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:16.553491 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9d436-f400-439e-9462-f62315034432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:16.553767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9d436-f400-439e-9462-f62315034432 admin admin] PATH_INFO: `/v3/users/cd0734f459394294a7b59ce2741df679` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:16.555018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9d436-f400-439e-9462-f62315034432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0734f459394294a7b59ce2741df679)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:16.557004 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9d436-f400-439e-9462-f62315034432 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:16.692110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-9c839f8c-ac18-4c89-98af-9ea959c71ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1463e87cd3944dd2bfb3f8407301f2cf'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.692794 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-9c839f8c-ac18-4c89-98af-9ea959c71ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1463e87cd3944dd2bfb3f8407301f2cf'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.693432 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-9c839f8c-ac18-4c89-98af-9ea959c71ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1463e87cd3944dd2bfb3f8407301f2cf'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.715921 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-9c839f8c-ac18-4c89-98af-9ea959c71ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1463e87cd3944dd2bfb3f8407301f2cf'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.722977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-9c839f8c-ac18-4c89-98af-9ea959c71ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1463e87cd3944dd2bfb3f8407301f2cf'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.759573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c4c9d436-f400-439e-9462-f62315034432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0734f459394294a7b59ce2741df679'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.760242 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c4c9d436-f400-439e-9462-f62315034432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0734f459394294a7b59ce2741df679'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.760878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c4c9d436-f400-439e-9462-f62315034432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0734f459394294a7b59ce2741df679'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.803368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1008/1992] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:16 2022] DELETE /identity/v3/users/1463e87cd3944dd2bfb3f8407301f2cf => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:16.804233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c839f8c-ac18-4c89-98af-9ea959c71ac3 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:16.805615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9c839f8c-ac18-4c89-98af-9ea959c71ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:16.860167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c4c9d436-f400-439e-9462-f62315034432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0734f459394294a7b59ce2741df679'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.873879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c839f8c-ac18-4c89-98af-9ea959c71ac3 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:16.878688 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:16.880044 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:16.880329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:16.880608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] PATH_INFO: `/v3/projects/87f665ad42984fddb4254f2a49c7b67d` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:16.882066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f665ad42984fddb4254f2a49c7b67d)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:16.882950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c4c9d436-f400-439e-9462-f62315034432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0734f459394294a7b59ce2741df679'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:16.884089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:16.896146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 985/1993] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:16 2022] DELETE /identity/v3/users/cd0734f459394294a7b59ce2741df679 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:16.897406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffa303-b8fb-4a52-aa24-1c6c1054bd21 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:16.897696 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffa303-b8fb-4a52-aa24-1c6c1054bd21 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:16.897973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffa303-b8fb-4a52-aa24-1c6c1054bd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:16.915089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b0ffa303-b8fb-4a52-aa24-1c6c1054bd21 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:16.916304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b0ffa303-b8fb-4a52-aa24-1c6c1054bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:16.981447 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 986/1994] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:16.994436 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffa303-b8fb-4a52-aa24-1c6c1054bd21 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:16.996165 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b0ffa303-b8fb-4a52-aa24-1c6c1054bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:16.996484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f665ad42984fddb4254f2a49c7b67d', 'request_id': 'req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.060596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f665ad42984fddb4254f2a49c7b67d', 'request_id': 'req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.062054 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffa303-b8fb-4a52-aa24-1c6c1054bd21 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:17.069322 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f665ad42984fddb4254f2a49c7b67d', 'request_id': 'req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.082280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] The token cache is being invalidate because project 87f665ad42984fddb4254f2a49c7b67d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:17.082588 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.100344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.101086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1009/1995] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:16 2022] DELETE /identity/v3/projects/87f665ad42984fddb4254f2a49c7b67d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:17.105277 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:17.107267 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:17.138593 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048838cc-2234-4ad8-88ce-c1d7f23eecc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:17.140109 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048838cc-2234-4ad8-88ce-c1d7f23eecc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:17.140525 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048838cc-2234-4ad8-88ce-c1d7f23eecc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:17.140883 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048838cc-2234-4ad8-88ce-c1d7f23eecc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:17.143023 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-048838cc-2234-4ad8-88ce-c1d7f23eecc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:17.191486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcacab-9aec-4044-9dbd-82c1e6b8152d admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:17.197145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e8acf-f440-4743-b7cd-71fba0568b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:17.198102 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e8acf-f440-4743-b7cd-71fba0568b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:17.198389 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e8acf-f440-4743-b7cd-71fba0568b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:17.198788 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e8acf-f440-4743-b7cd-71fba0568b40 admin admin] PATH_INFO: `/v3/users/1c5557bde4c94b44848f030c06d992e4` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:17.200194 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e8acf-f440-4743-b7cd-71fba0568b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5557bde4c94b44848f030c06d992e4)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:17.202992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e8acf-f440-4743-b7cd-71fba0568b40 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:17.229789 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048838cc-2234-4ad8-88ce-c1d7f23eecc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:17.233622 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048838cc-2234-4ad8-88ce-c1d7f23eecc3 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:17.273297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 987/1996] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:17.274908 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048838cc-2234-4ad8-88ce-c1d7f23eecc3 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:17.276343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-048838cc-2234-4ad8-88ce-c1d7f23eecc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:17.289256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048838cc-2234-4ad8-88ce-c1d7f23eecc3 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:17.294527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d379fa-1369-4d7f-8f05-32551cc06c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:17.295396 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d379fa-1369-4d7f-8f05-32551cc06c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:17.295676 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d379fa-1369-4d7f-8f05-32551cc06c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:17.296135 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d379fa-1369-4d7f-8f05-32551cc06c6f admin admin] PATH_INFO: `/v3/projects/8162a14d4e714ae3ab6afa53108956be` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:17.297696 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d379fa-1369-4d7f-8f05-32551cc06c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8162a14d4e714ae3ab6afa53108956be)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:17.299953 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d379fa-1369-4d7f-8f05-32551cc06c6f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:17.458371 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ed3e8acf-f440-4743-b7cd-71fba0568b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5557bde4c94b44848f030c06d992e4'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.460121 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e9d379fa-1369-4d7f-8f05-32551cc06c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8162a14d4e714ae3ab6afa53108956be', 'request_id': 'req-e9d379fa-1369-4d7f-8f05-32551cc06c6f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.460513 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ed3e8acf-f440-4743-b7cd-71fba0568b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5557bde4c94b44848f030c06d992e4'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.461717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ed3e8acf-f440-4743-b7cd-71fba0568b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5557bde4c94b44848f030c06d992e4'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.467716 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e9d379fa-1369-4d7f-8f05-32551cc06c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8162a14d4e714ae3ab6afa53108956be', 'request_id': 'req-e9d379fa-1369-4d7f-8f05-32551cc06c6f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.476588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e9d379fa-1369-4d7f-8f05-32551cc06c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8162a14d4e714ae3ab6afa53108956be', 'request_id': 'req-e9d379fa-1369-4d7f-8f05-32551cc06c6f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.480508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ed3e8acf-f440-4743-b7cd-71fba0568b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5557bde4c94b44848f030c06d992e4'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.487452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ed3e8acf-f440-4743-b7cd-71fba0568b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5557bde4c94b44848f030c06d992e4'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.586639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e9d379fa-1369-4d7f-8f05-32551cc06c6f admin admin] The token cache is being invalidate because project 8162a14d4e714ae3ab6afa53108956be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:17.587077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e9d379fa-1369-4d7f-8f05-32551cc06c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.587727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e9d379fa-1369-4d7f-8f05-32551cc06c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:17.589828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 988/1997] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:17 2022] DELETE /identity/v3/projects/8162a14d4e714ae3ab6afa53108956be => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:17.594280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e1bf-1fad-42a2-9c4a-ae43819457b5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:17.594607 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e1bf-1fad-42a2-9c4a-ae43819457b5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:17.594999 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e1bf-1fad-42a2-9c4a-ae43819457b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:17.617538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6c49e1bf-1fad-42a2-9c4a-ae43819457b5 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:17.618815 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6c49e1bf-1fad-42a2-9c4a-ae43819457b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:17.686610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1010/1998] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:17 2022] DELETE /identity/v3/users/1c5557bde4c94b44848f030c06d992e4 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:17.707766 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 989/1999] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:17.718670 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ccc7e-9da8-4fae-a905-478771bb0251 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:17.719014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ccc7e-9da8-4fae-a905-478771bb0251 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:17.719298 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ccc7e-9da8-4fae-a905-478771bb0251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:17.738454 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-764ccc7e-9da8-4fae-a905-478771bb0251 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:17.739734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-764ccc7e-9da8-4fae-a905-478771bb0251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:17.810374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1011/2000] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:17.812899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49e1bf-1fad-42a2-9c4a-ae43819457b5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:17.823117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49e1bf-1fad-42a2-9c4a-ae43819457b5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:17.828946 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225e163-55a8-4f86-8348-c40e5df7b8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:17.829834 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e163-55a8-4f86-8348-c40e5df7b8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:17.830262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e163-55a8-4f86-8348-c40e5df7b8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:17.830542 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e163-55a8-4f86-8348-c40e5df7b8a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:17.831332 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225e163-55a8-4f86-8348-c40e5df7b8a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:09:17.832162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225e163-55a8-4f86-8348-c40e5df7b8a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:17.834005 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225e163-55a8-4f86-8348-c40e5df7b8a6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:17.847175 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 990/2001] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:09:17.853674 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ccc7e-9da8-4fae-a905-478771bb0251 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:17.864355 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ccc7e-9da8-4fae-a905-478771bb0251 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:17.870771 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2b4a3-3a8e-4655-b3f9-9701aa051722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:17.871483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2b4a3-3a8e-4655-b3f9-9701aa051722 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:17.871766 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2b4a3-3a8e-4655-b3f9-9701aa051722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:17.872039 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2b4a3-3a8e-4655-b3f9-9701aa051722 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:17.872766 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2b4a3-3a8e-4655-b3f9-9701aa051722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:17.874827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2b4a3-3a8e-4655-b3f9-9701aa051722 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:18.005868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225e163-55a8-4f86-8348-c40e5df7b8a6 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:18.009594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1012/2002] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:17 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:18.010670 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2b4a3-3a8e-4655-b3f9-9701aa051722 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:18.012120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4225e163-55a8-4f86-8348-c40e5df7b8a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:18.031123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225e163-55a8-4f86-8348-c40e5df7b8a6 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:18.095419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2b4a3-3a8e-4655-b3f9-9701aa051722 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:18.102635 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d0f39-c9d6-4af2-b34a-03b31b155e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:18.103758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d0f39-c9d6-4af2-b34a-03b31b155e96 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:18.104179 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d0f39-c9d6-4af2-b34a-03b31b155e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:18.104463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d0f39-c9d6-4af2-b34a-03b31b155e96 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:18.105182 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d0f39-c9d6-4af2-b34a-03b31b155e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:18.106732 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:18.107103 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d0f39-c9d6-4af2-b34a-03b31b155e96 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:18.107733 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:18.108014 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:18.108297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] PATH_INFO: `/v3/projects/d52e7e5611a743529ff106c4f4ca58fb` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:18.109554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52e7e5611a743529ff106c4f4ca58fb)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:18.111550 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:18.209465 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1013/2003] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:18 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:18.213214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d0f39-c9d6-4af2-b34a-03b31b155e96 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:18.223332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d0f39-c9d6-4af2-b34a-03b31b155e96 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:18.227978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bf46e-f8ad-42b5-8ad6-de731ad7df65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:18.228614 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bf46e-f8ad-42b5-8ad6-de731ad7df65 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:18.228898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bf46e-f8ad-42b5-8ad6-de731ad7df65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:18.229208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bf46e-f8ad-42b5-8ad6-de731ad7df65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:18.229923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bf46e-f8ad-42b5-8ad6-de731ad7df65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:18.231515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bf46e-f8ad-42b5-8ad6-de731ad7df65 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:18.241718 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1014/2004] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:18.245554 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bf46e-f8ad-42b5-8ad6-de731ad7df65 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:18.254929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bf46e-f8ad-42b5-8ad6-de731ad7df65 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:18.261861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab1b05-400b-46c3-9d96-0201848c5e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:18.261861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab1b05-400b-46c3-9d96-0201848c5e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:18.261861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab1b05-400b-46c3-9d96-0201848c5e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:18.261861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab1b05-400b-46c3-9d96-0201848c5e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:18.262159 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab1b05-400b-46c3-9d96-0201848c5e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:18.263337 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab1b05-400b-46c3-9d96-0201848c5e62 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:18.278174 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52e7e5611a743529ff106c4f4ca58fb', 'request_id': 'req-0b4b92c2-7df8-48db-8661-1e940e5db016'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:18.283116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1015/2005] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:18.284156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab1b05-400b-46c3-9d96-0201848c5e62 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:18.286533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1cab1b05-400b-46c3-9d96-0201848c5e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:18.298142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52e7e5611a743529ff106c4f4ca58fb', 'request_id': 'req-0b4b92c2-7df8-48db-8661-1e940e5db016'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:18.302068 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab1b05-400b-46c3-9d96-0201848c5e62 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:18.305742 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52e7e5611a743529ff106c4f4ca58fb', 'request_id': 'req-0b4b92c2-7df8-48db-8661-1e940e5db016'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:18.363178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3598d-44f3-4fa2-809e-8009557a838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:18.364048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3598d-44f3-4fa2-809e-8009557a838d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:18.364334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3598d-44f3-4fa2-809e-8009557a838d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:18.364608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3598d-44f3-4fa2-809e-8009557a838d admin admin] PATH_INFO: `/v3/projects/282e6c2d857842b8bdc6d6aeb861b25e` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:18.365884 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3598d-44f3-4fa2-809e-8009557a838d admin admin] RBAC: Authorizing `identity:delete_project(project_id=282e6c2d857842b8bdc6d6aeb861b25e)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:18.368078 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3598d-44f3-4fa2-809e-8009557a838d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:18.409434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] The token cache is being invalidate because project d52e7e5611a743529ff106c4f4ca58fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:18.410753 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:18.411514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:18.413282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 991/2006] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:18 2022] DELETE /identity/v3/projects/d52e7e5611a743529ff106c4f4ca58fb => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:18.414349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:18.416036 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:18.431565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b92c2-7df8-48db-8661-1e940e5db016 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:18.436386 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0c3fd-d326-4dbd-ae9b-902b6d5d72d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:18.437321 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0c3fd-d326-4dbd-ae9b-902b6d5d72d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:18.438264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0c3fd-d326-4dbd-ae9b-902b6d5d72d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:18.438264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0c3fd-d326-4dbd-ae9b-902b6d5d72d2 admin admin] PATH_INFO: `/v3/projects/8b53550b1305425ca539afb1a0ebc2de/users/7894d1cbe73f43189e6d67ada67a9094/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:18.457195 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0c3fd-d326-4dbd-ae9b-902b6d5d72d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b53550b1305425ca539afb1a0ebc2de, user_id=7894d1cbe73f43189e6d67ada67a9094, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:18.459951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0c3fd-d326-4dbd-ae9b-902b6d5d72d2 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:18.560291 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 992/2007] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:18 2022] PUT /identity/v3/projects/8b53550b1305425ca539afb1a0ebc2de/users/7894d1cbe73f43189e6d67ada67a9094/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:18.560291 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0c3fd-d326-4dbd-ae9b-902b6d5d72d2 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:18.561247 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a3b3598d-44f3-4fa2-809e-8009557a838d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282e6c2d857842b8bdc6d6aeb861b25e', 'request_id': 'req-a3b3598d-44f3-4fa2-809e-8009557a838d'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:18.562878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f0e0c3fd-d326-4dbd-ae9b-902b6d5d72d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:18.626641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0c3fd-d326-4dbd-ae9b-902b6d5d72d2 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:18.636773 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a3b3598d-44f3-4fa2-809e-8009557a838d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282e6c2d857842b8bdc6d6aeb861b25e', 'request_id': 'req-a3b3598d-44f3-4fa2-809e-8009557a838d'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:18.644907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a3b3598d-44f3-4fa2-809e-8009557a838d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282e6c2d857842b8bdc6d6aeb861b25e', 'request_id': 'req-a3b3598d-44f3-4fa2-809e-8009557a838d'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:18.656765 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a3b3598d-44f3-4fa2-809e-8009557a838d admin admin] The token cache is being invalidate because project 282e6c2d857842b8bdc6d6aeb861b25e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:18.657108 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a3b3598d-44f3-4fa2-809e-8009557a838d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:18.658019 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a3b3598d-44f3-4fa2-809e-8009557a838d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:18.659719 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1016/2008] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:18 2022] DELETE /identity/v3/projects/282e6c2d857842b8bdc6d6aeb861b25e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:18.661046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b42f1-511d-4b30-8152-ef510d3b69b6 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:18.661295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b42f1-511d-4b30-8152-ef510d3b69b6 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:18.661577 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b42f1-511d-4b30-8152-ef510d3b69b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:18.689089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaebe5-646b-4919-b1eb-e9901f7f22f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:18.689696 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaebe5-646b-4919-b1eb-e9901f7f22f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:18.689982 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaebe5-646b-4919-b1eb-e9901f7f22f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:18.690261 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaebe5-646b-4919-b1eb-e9901f7f22f5 admin admin] PATH_INFO: `/v3/users/3f5e64ba5a164815986ebf5c2fbda021` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:18.692019 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aaebe5-646b-4919-b1eb-e9901f7f22f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5e64ba5a164815986ebf5c2fbda021)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:18.694051 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aaebe5-646b-4919-b1eb-e9901f7f22f5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:18.696069 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-235b42f1-511d-4b30-8152-ef510d3b69b6 None None] MFA Rules not processed for user `7894d1cbe73f43189e6d67ada67a9094`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:18.697344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-235b42f1-511d-4b30-8152-ef510d3b69b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:18.765206 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1017/2009] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:18.766555 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11e64-5bd6-4edd-9efd-101303d39442 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:18.766846 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11e64-5bd6-4edd-9efd-101303d39442 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:18.767133 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11e64-5bd6-4edd-9efd-101303d39442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:18.798926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-88a11e64-5bd6-4edd-9efd-101303d39442 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:18.798926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-88a11e64-5bd6-4edd-9efd-101303d39442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:18.805470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1018/2010] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:18.805801 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a11e64-5bd6-4edd-9efd-101303d39442 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:18.807410 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-88a11e64-5bd6-4edd-9efd-101303d39442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:18.820241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a11e64-5bd6-4edd-9efd-101303d39442 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:18.826550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e89be-94cf-4f50-92eb-d2034ebf4735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:18.828072 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e89be-94cf-4f50-92eb-d2034ebf4735 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:18.828383 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e89be-94cf-4f50-92eb-d2034ebf4735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:18.828669 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e89be-94cf-4f50-92eb-d2034ebf4735 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:18.829428 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e89be-94cf-4f50-92eb-d2034ebf4735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:18.832189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e89be-94cf-4f50-92eb-d2034ebf4735 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:18.852279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b6aaebe5-646b-4919-b1eb-e9901f7f22f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5e64ba5a164815986ebf5c2fbda021'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:18.853125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b6aaebe5-646b-4919-b1eb-e9901f7f22f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5e64ba5a164815986ebf5c2fbda021'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:18.853800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b6aaebe5-646b-4919-b1eb-e9901f7f22f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5e64ba5a164815986ebf5c2fbda021'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:18.936438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1019/2011] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:18 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:18.936438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44125da8-7ed9-48e1-a4cd-c653cf5ab98a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:18.936438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44125da8-7ed9-48e1-a4cd-c653cf5ab98a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:18.936438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44125da8-7ed9-48e1-a4cd-c653cf5ab98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:18.945428 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b6aaebe5-646b-4919-b1eb-e9901f7f22f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5e64ba5a164815986ebf5c2fbda021'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:18.955796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-44125da8-7ed9-48e1-a4cd-c653cf5ab98a None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:18.957530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-44125da8-7ed9-48e1-a4cd-c653cf5ab98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:18.992338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b6aaebe5-646b-4919-b1eb-e9901f7f22f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5e64ba5a164815986ebf5c2fbda021'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:19.021152 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 993/2012] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:18 2022] DELETE /identity/v3/users/3f5e64ba5a164815986ebf5c2fbda021 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:19.021152 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaebe5-646b-4919-b1eb-e9901f7f22f5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:19.021687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b6aaebe5-646b-4919-b1eb-e9901f7f22f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:19.044660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1020/2013] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:19.070487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44125da8-7ed9-48e1-a4cd-c653cf5ab98a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:19.099155 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44125da8-7ed9-48e1-a4cd-c653cf5ab98a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:19.151144 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaebe5-646b-4919-b1eb-e9901f7f22f5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:19.155949 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bf632-0b5b-441f-b7dc-8c7b243b80ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:19.156864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bf632-0b5b-441f-b7dc-8c7b243b80ca admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:19.156864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bf632-0b5b-441f-b7dc-8c7b243b80ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:19.157111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bf632-0b5b-441f-b7dc-8c7b243b80ca admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:19.158304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9bf632-0b5b-441f-b7dc-8c7b243b80ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:19.160312 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9bf632-0b5b-441f-b7dc-8c7b243b80ca admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:19.246600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f64017-67f4-4cd2-8b07-2ebe12ff811f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:19.247288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64017-67f4-4cd2-8b07-2ebe12ff811f admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:19.247573 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64017-67f4-4cd2-8b07-2ebe12ff811f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:19.247851 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64017-67f4-4cd2-8b07-2ebe12ff811f admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:19.248619 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f64017-67f4-4cd2-8b07-2ebe12ff811f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:09:19.248933 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f64017-67f4-4cd2-8b07-2ebe12ff811f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:19.250685 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f64017-67f4-4cd2-8b07-2ebe12ff811f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:19.260902 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 994/2014] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:19 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:19.264813 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bf632-0b5b-441f-b7dc-8c7b243b80ca admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:19.269086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1021/2015] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:09:19.270901 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f64017-67f4-4cd2-8b07-2ebe12ff811f admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:19.275514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bf632-0b5b-441f-b7dc-8c7b243b80ca admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:19.283296 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58de028-69d5-48b4-b524-842af349cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:19.283492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f64017-67f4-4cd2-8b07-2ebe12ff811f admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:19.284424 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de028-69d5-48b4-b524-842af349cd17 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:19.284839 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de028-69d5-48b4-b524-842af349cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:19.285310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de028-69d5-48b4-b524-842af349cd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:19.286282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58de028-69d5-48b4-b524-842af349cd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:19.288418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e34979-b286-4d14-8b98-4355572f25fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:19.291837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58de028-69d5-48b4-b524-842af349cd17 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:19.291977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e34979-b286-4d14-8b98-4355572f25fb admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:19.291977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e34979-b286-4d14-8b98-4355572f25fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:19.291977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e34979-b286-4d14-8b98-4355572f25fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:19.291977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e34979-b286-4d14-8b98-4355572f25fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:19.293640 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e34979-b286-4d14-8b98-4355572f25fb admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:19.301492 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 995/2016] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:19.305571 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58de028-69d5-48b4-b524-842af349cd17 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:19.315723 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58de028-69d5-48b4-b524-842af349cd17 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:19.321304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b4c56-ed08-4cd2-86c0-d4c989f39c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:19.322438 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b4c56-ed08-4cd2-86c0-d4c989f39c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:19.322720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b4c56-ed08-4cd2-86c0-d4c989f39c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:19.322995 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b4c56-ed08-4cd2-86c0-d4c989f39c6b admin admin] PATH_INFO: `/v3/projects/01bdc3ebf72c4894b664ae3f90b09cc2/users/47ef62c29fbc46aeb88cf59913c0822f/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:19.337868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b4c56-ed08-4cd2-86c0-d4c989f39c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bdc3ebf72c4894b664ae3f90b09cc2, user_id=47ef62c29fbc46aeb88cf59913c0822f, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:19.340802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b4c56-ed08-4cd2-86c0-d4c989f39c6b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:19.410274 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1022/2017] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:19 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:19.411268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 996/2018] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:19 2022] PUT /identity/v3/projects/01bdc3ebf72c4894b664ae3f90b09cc2/users/47ef62c29fbc46aeb88cf59913c0822f/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:19.411522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e34979-b286-4d14-8b98-4355572f25fb admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:19.412900 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b4c56-ed08-4cd2-86c0-d4c989f39c6b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:19.493080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e34979-b286-4d14-8b98-4355572f25fb admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:19.506126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaec3f5-d214-421d-8988-54246db1ad6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:19.506980 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaec3f5-d214-421d-8988-54246db1ad6a admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:19.507319 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaec3f5-d214-421d-8988-54246db1ad6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:19.507603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaec3f5-d214-421d-8988-54246db1ad6a admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:19.508320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaec3f5-d214-421d-8988-54246db1ad6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:19.510380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaec3f5-d214-421d-8988-54246db1ad6a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:19.516186 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b4c56-ed08-4cd2-86c0-d4c989f39c6b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:19.528258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f2714-e1a0-4272-9392-8377e8962f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:19.528995 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f2714-e1a0-4272-9392-8377e8962f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:19.529447 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f2714-e1a0-4272-9392-8377e8962f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:19.531604 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f2714-e1a0-4272-9392-8377e8962f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:19.531604 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f2714-e1a0-4272-9392-8377e8962f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:19.532324 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f2714-e1a0-4272-9392-8377e8962f2a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:19.544298 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 997/2019] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:19.548169 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f2714-e1a0-4272-9392-8377e8962f2a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:19.559431 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f2714-e1a0-4272-9392-8377e8962f2a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:19.564428 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca2c60-9348-4f76-acfa-8d3be61c69ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:19.565466 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca2c60-9348-4f76-acfa-8d3be61c69ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:19.565754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca2c60-9348-4f76-acfa-8d3be61c69ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:19.566062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca2c60-9348-4f76-acfa-8d3be61c69ad admin admin] PATH_INFO: `/v3/projects/01bdc3ebf72c4894b664ae3f90b09cc2/users/47ef62c29fbc46aeb88cf59913c0822f/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:19.571449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca2c60-9348-4f76-acfa-8d3be61c69ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bdc3ebf72c4894b664ae3f90b09cc2, user_id=47ef62c29fbc46aeb88cf59913c0822f, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:19.571449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca2c60-9348-4f76-acfa-8d3be61c69ad admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:19.581838 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 998/2020] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:19 2022] PUT /identity/v3/projects/01bdc3ebf72c4894b664ae3f90b09cc2/users/47ef62c29fbc46aeb88cf59913c0822f/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:19.592426 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7bac9-2ed0-479a-82e5-ac513477b7b9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:19.592733 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7bac9-2ed0-479a-82e5-ac513477b7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:19.592984 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7bac9-2ed0-479a-82e5-ac513477b7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:19.623235 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-03f7bac9-2ed0-479a-82e5-ac513477b7b9 None None] MFA Rules not processed for user `47ef62c29fbc46aeb88cf59913c0822f`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:19.624470 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-03f7bac9-2ed0-479a-82e5-ac513477b7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:19.629817 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1023/2021] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:19 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:09:19.630953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaec3f5-d214-421d-8988-54246db1ad6a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:19.641136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaec3f5-d214-421d-8988-54246db1ad6a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:19.716167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 999/2022] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:09:19.721126 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7bac9-2ed0-479a-82e5-ac513477b7b9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:19.727371 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-03f7bac9-2ed0-479a-82e5-ac513477b7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:19.752397 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c418f63-f638-47d7-8b48-f8162316845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:19.752645 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c418f63-f638-47d7-8b48-f8162316845d admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:19.752875 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c418f63-f638-47d7-8b48-f8162316845d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:19.753229 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c418f63-f638-47d7-8b48-f8162316845d admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:19.753964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c418f63-f638-47d7-8b48-f8162316845d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:19.756697 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c418f63-f638-47d7-8b48-f8162316845d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:19.770187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1024/2023] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:19.771266 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c418f63-f638-47d7-8b48-f8162316845d admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:19.773263 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6c418f63-f638-47d7-8b48-f8162316845d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:19.834951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7bac9-2ed0-479a-82e5-ac513477b7b9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:19.848868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d17ba4-4c2d-4679-a8ff-8ef67732d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:19.850033 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d17ba4-4c2d-4679-a8ff-8ef67732d181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:19.850591 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d17ba4-4c2d-4679-a8ff-8ef67732d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:19.851758 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d17ba4-4c2d-4679-a8ff-8ef67732d181 admin admin] PATH_INFO: `/v3/projects/1123f1587a5e43f6910ee6e76f000cac` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:19.853601 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d17ba4-4c2d-4679-a8ff-8ef67732d181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1123f1587a5e43f6910ee6e76f000cac)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:19.856198 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d17ba4-4c2d-4679-a8ff-8ef67732d181 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:19.880752 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c418f63-f638-47d7-8b48-f8162316845d admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:19.884908 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b29a6-555d-438d-8689-a91c1104d8a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:19.885603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b29a6-555d-438d-8689-a91c1104d8a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:19.885889 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b29a6-555d-438d-8689-a91c1104d8a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:19.886169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b29a6-555d-438d-8689-a91c1104d8a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:19.897124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b29a6-555d-438d-8689-a91c1104d8a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:19.898810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b29a6-555d-438d-8689-a91c1104d8a5 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:19.911211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1025/2024] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:19.912172 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b29a6-555d-438d-8689-a91c1104d8a5 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:19.930681 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b29a6-555d-438d-8689-a91c1104d8a5 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:19.939970 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5aeb7b-e9a8-4c39-bbc3-51bbc344a696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:19.940756 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aeb7b-e9a8-4c39-bbc3-51bbc344a696 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:19.941682 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aeb7b-e9a8-4c39-bbc3-51bbc344a696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:19.942014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aeb7b-e9a8-4c39-bbc3-51bbc344a696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:19.943514 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5aeb7b-e9a8-4c39-bbc3-51bbc344a696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:19.945272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5aeb7b-e9a8-4c39-bbc3-51bbc344a696 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:19.959075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1026/2025] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:19.963503 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5aeb7b-e9a8-4c39-bbc3-51bbc344a696 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:19.979802 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5aeb7b-e9a8-4c39-bbc3-51bbc344a696 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:19.982257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-00d17ba4-4c2d-4679-a8ff-8ef67732d181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1123f1587a5e43f6910ee6e76f000cac', 'request_id': 'req-00d17ba4-4c2d-4679-a8ff-8ef67732d181'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:19.989195 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-00d17ba4-4c2d-4679-a8ff-8ef67732d181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1123f1587a5e43f6910ee6e76f000cac', 'request_id': 'req-00d17ba4-4c2d-4679-a8ff-8ef67732d181'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:19.997732 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-00d17ba4-4c2d-4679-a8ff-8ef67732d181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1123f1587a5e43f6910ee6e76f000cac', 'request_id': 'req-00d17ba4-4c2d-4679-a8ff-8ef67732d181'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:20.046708 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f242b0-c215-4ec0-9e6c-97b6c173750a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:20.049963 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f242b0-c215-4ec0-9e6c-97b6c173750a admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:20.049963 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f242b0-c215-4ec0-9e6c-97b6c173750a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:20.049963 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f242b0-c215-4ec0-9e6c-97b6c173750a admin admin] PATH_INFO: `/v3/projects/d2b0aec3cdef4a0492a1d2ab70523c97/users/96de9c536a8946659c615366c8e0a121/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:20.064340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f242b0-c215-4ec0-9e6c-97b6c173750a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b0aec3cdef4a0492a1d2ab70523c97, user_id=96de9c536a8946659c615366c8e0a121, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:20.067147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f242b0-c215-4ec0-9e6c-97b6c173750a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:20.159066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-00d17ba4-4c2d-4679-a8ff-8ef67732d181 admin admin] The token cache is being invalidate because project 1123f1587a5e43f6910ee6e76f000cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:20.159066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-00d17ba4-4c2d-4679-a8ff-8ef67732d181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:20.159066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-00d17ba4-4c2d-4679-a8ff-8ef67732d181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:20.159066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1000/2026] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:19 2022] DELETE /identity/v3/projects/1123f1587a5e43f6910ee6e76f000cac => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:20.166672 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a642b8c-2129-4fcc-90bd-3852249f03be None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:20.167055 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a642b8c-2129-4fcc-90bd-3852249f03be None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:20.167412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a642b8c-2129-4fcc-90bd-3852249f03be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:20.190143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7a642b8c-2129-4fcc-90bd-3852249f03be None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:20.191986 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7a642b8c-2129-4fcc-90bd-3852249f03be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:20.208099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1027/2027] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:19 2022] PUT /identity/v3/projects/d2b0aec3cdef4a0492a1d2ab70523c97/users/96de9c536a8946659c615366c8e0a121/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:20.209725 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f242b0-c215-4ec0-9e6c-97b6c173750a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:20.221242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-80f242b0-c215-4ec0-9e6c-97b6c173750a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:20.231247 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1001/2028] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:20.234321 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9629e3e-9932-465f-aeb3-3cb7b44973b8 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:20.236230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9629e3e-9932-465f-aeb3-3cb7b44973b8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:20.237168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9629e3e-9932-465f-aeb3-3cb7b44973b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:20.283971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c9629e3e-9932-465f-aeb3-3cb7b44973b8 None None] MFA Rules not processed for user `96de9c536a8946659c615366c8e0a121`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:20.285784 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c9629e3e-9932-465f-aeb3-3cb7b44973b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:20.320800 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f242b0-c215-4ec0-9e6c-97b6c173750a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:20.324880 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e109a5-1c55-46c6-8df7-505644282ab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:20.325584 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e109a5-1c55-46c6-8df7-505644282ab6 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:20.326216 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e109a5-1c55-46c6-8df7-505644282ab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:20.326336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e109a5-1c55-46c6-8df7-505644282ab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:20.328835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c0e109a5-1c55-46c6-8df7-505644282ab6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:20.355755 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1002/2029] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:20.357619 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639d13f-5b1c-4ba2-b17f-dc4cf280582f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:20.358390 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639d13f-5b1c-4ba2-b17f-dc4cf280582f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:20.358864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639d13f-5b1c-4ba2-b17f-dc4cf280582f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:20.377148 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e639d13f-5b1c-4ba2-b17f-dc4cf280582f None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:20.378474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e639d13f-5b1c-4ba2-b17f-dc4cf280582f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:20.394688 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e109a5-1c55-46c6-8df7-505644282ab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:20.396132 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e109a5-1c55-46c6-8df7-505644282ab6 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:20.405607 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1028/2030] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:20.443909 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1003/2031] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:20.448137 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e109a5-1c55-46c6-8df7-505644282ab6 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:20.459077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e109a5-1c55-46c6-8df7-505644282ab6 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:20.463981 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5db6c-1400-4685-9b11-1f720c72f4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:20.464759 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5db6c-1400-4685-9b11-1f720c72f4ba admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:20.465202 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5db6c-1400-4685-9b11-1f720c72f4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:20.465658 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5db6c-1400-4685-9b11-1f720c72f4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:20.466421 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5db6c-1400-4685-9b11-1f720c72f4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:09:20.466734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5db6c-1400-4685-9b11-1f720c72f4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:20.468331 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5db6c-1400-4685-9b11-1f720c72f4ba admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:20.481137 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1029/2032] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:09:20.485604 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639d13f-5b1c-4ba2-b17f-dc4cf280582f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:20.496212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639d13f-5b1c-4ba2-b17f-dc4cf280582f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:20.501317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176c1c0-0303-40e3-8aca-ad98b235d947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:20.501925 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176c1c0-0303-40e3-8aca-ad98b235d947 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:20.502208 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176c1c0-0303-40e3-8aca-ad98b235d947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:20.502491 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176c1c0-0303-40e3-8aca-ad98b235d947 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:20.503185 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176c1c0-0303-40e3-8aca-ad98b235d947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:20.505248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176c1c0-0303-40e3-8aca-ad98b235d947 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:20.579310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1004/2033] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:20 2022] POST /identity/v3/projects => generated 369 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:09:20.580902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5db6c-1400-4685-9b11-1f720c72f4ba admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:20.591874 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5db6c-1400-4685-9b11-1f720c72f4ba admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:20.669946 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6442a-9eb3-4432-8df8-bbf672b562b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:20.670597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6442a-9eb3-4432-8df8-bbf672b562b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:20.670822 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6442a-9eb3-4432-8df8-bbf672b562b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:20.671107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6442a-9eb3-4432-8df8-bbf672b562b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:20.671808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6442a-9eb3-4432-8df8-bbf672b562b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:20.674143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6442a-9eb3-4432-8df8-bbf672b562b8 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:20.754704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1030/2034] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:20 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:20.755664 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176c1c0-0303-40e3-8aca-ad98b235d947 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:20.768523 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176c1c0-0303-40e3-8aca-ad98b235d947 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:20.774406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee476b5-67b7-4fc1-93c6-ba98ce64408b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:20.774850 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6442a-9eb3-4432-8df8-bbf672b562b8 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:20.775428 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee476b5-67b7-4fc1-93c6-ba98ce64408b admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:20.775876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee476b5-67b7-4fc1-93c6-ba98ce64408b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:20.776358 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee476b5-67b7-4fc1-93c6-ba98ce64408b admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:20.777700 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee476b5-67b7-4fc1-93c6-ba98ce64408b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:20.779698 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee476b5-67b7-4fc1-93c6-ba98ce64408b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:20.792735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1005/2035] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:20.796569 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee476b5-67b7-4fc1-93c6-ba98ce64408b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:20.807257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee476b5-67b7-4fc1-93c6-ba98ce64408b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:20.812475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8778509-b9d9-4169-9bbf-8608cea17cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:20.813298 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8778509-b9d9-4169-9bbf-8608cea17cef admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:20.813648 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8778509-b9d9-4169-9bbf-8608cea17cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:20.814059 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8778509-b9d9-4169-9bbf-8608cea17cef admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:20.814895 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8778509-b9d9-4169-9bbf-8608cea17cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:20.816852 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8778509-b9d9-4169-9bbf-8608cea17cef admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:20.828087 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1006/2036] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:20.833807 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8778509-b9d9-4169-9bbf-8608cea17cef admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:20.844739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8778509-b9d9-4169-9bbf-8608cea17cef admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:20.846826 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6442a-9eb3-4432-8df8-bbf672b562b8 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:20.851363 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292d8b6-7cd4-4129-bdbf-c1bff276e9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:20.852101 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0a363-c2f8-4c03-8b22-33b847406b5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:20.852416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d8b6-7cd4-4129-bdbf-c1bff276e9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:20.852887 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d8b6-7cd4-4129-bdbf-c1bff276e9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:20.853272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d8b6-7cd4-4129-bdbf-c1bff276e9ff admin admin] PATH_INFO: `/v3/projects/05ae77c080d7417aab52594bc467013a/users/cddbabd5671348d48b8826ed32d53442/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:20.853760 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0a363-c2f8-4c03-8b22-33b847406b5f service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:20.854104 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0a363-c2f8-4c03-8b22-33b847406b5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:20.854444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0a363-c2f8-4c03-8b22-33b847406b5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:20.868810 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292d8b6-7cd4-4129-bdbf-c1bff276e9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ae77c080d7417aab52594bc467013a, user_id=cddbabd5671348d48b8826ed32d53442, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:20.871694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292d8b6-7cd4-4129-bdbf-c1bff276e9ff admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:20.918849 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0a363-c2f8-4c03-8b22-33b847406b5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:20.920487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0a363-c2f8-4c03-8b22-33b847406b5f service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:20.932838 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1031/2037] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:09:20.941547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1007/2038] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:20 2022] PUT /identity/v3/projects/05ae77c080d7417aab52594bc467013a/users/cddbabd5671348d48b8826ed32d53442/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:20.947184 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b54cd-bbc7-46bf-894f-6fec16dcbe87 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:20.947485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b54cd-bbc7-46bf-894f-6fec16dcbe87 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:20.947769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b54cd-bbc7-46bf-894f-6fec16dcbe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:20.961912 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292d8b6-7cd4-4129-bdbf-c1bff276e9ff admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:20.965382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8292d8b6-7cd4-4129-bdbf-c1bff276e9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:20.983283 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-003b54cd-bbc7-46bf-894f-6fec16dcbe87 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:20.989234 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-003b54cd-bbc7-46bf-894f-6fec16dcbe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:21.062228 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292d8b6-7cd4-4129-bdbf-c1bff276e9ff admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:21.067878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc933c-52ce-4bb6-a825-5d869b08f847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:21.069310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc933c-52ce-4bb6-a825-5d869b08f847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:21.069601 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc933c-52ce-4bb6-a825-5d869b08f847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:21.069883 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc933c-52ce-4bb6-a825-5d869b08f847 admin admin] PATH_INFO: `/v3/users/96de9c536a8946659c615366c8e0a121` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:21.071095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc933c-52ce-4bb6-a825-5d869b08f847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96de9c536a8946659c615366c8e0a121)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:21.073077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc933c-52ce-4bb6-a825-5d869b08f847 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:21.085701 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1032/2039] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:21.094904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b54cd-bbc7-46bf-894f-6fec16dcbe87 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:21.096951 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-003b54cd-bbc7-46bf-894f-6fec16dcbe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:21.152969 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b54cd-bbc7-46bf-894f-6fec16dcbe87 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:21.156875 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df26405-29e9-4fc5-bfb8-b13a4eadc3b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:21.157593 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df26405-29e9-4fc5-bfb8-b13a4eadc3b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:21.157858 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df26405-29e9-4fc5-bfb8-b13a4eadc3b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:21.158173 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df26405-29e9-4fc5-bfb8-b13a4eadc3b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:21.167606 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df26405-29e9-4fc5-bfb8-b13a4eadc3b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:21.169084 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df26405-29e9-4fc5-bfb8-b13a4eadc3b7 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:21.179299 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1033/2040] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:09:21.261342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5fbc933c-52ce-4bb6-a825-5d869b08f847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96de9c536a8946659c615366c8e0a121'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:21.262025 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5fbc933c-52ce-4bb6-a825-5d869b08f847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96de9c536a8946659c615366c8e0a121'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:21.262646 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5fbc933c-52ce-4bb6-a825-5d869b08f847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96de9c536a8946659c615366c8e0a121'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:21.345170 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5fbc933c-52ce-4bb6-a825-5d869b08f847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96de9c536a8946659c615366c8e0a121'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:21.359712 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5fbc933c-52ce-4bb6-a825-5d869b08f847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96de9c536a8946659c615366c8e0a121'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:21.372647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1008/2041] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:09:20 2022] DELETE /identity/v3/users/96de9c536a8946659c615366c8e0a121 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:21.377332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc88db-3f93-449b-8ea6-d45bce210787 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:21.377684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc88db-3f93-449b-8ea6-d45bce210787 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:21.377972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc88db-3f93-449b-8ea6-d45bce210787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:21.397099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-fcfc88db-3f93-449b-8ea6-d45bce210787 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:21.398335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fcfc88db-3f93-449b-8ea6-d45bce210787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:21.466030 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1034/2042] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:21.476761 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc933c-52ce-4bb6-a825-5d869b08f847 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:21.478958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5fbc933c-52ce-4bb6-a825-5d869b08f847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:21.540493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc933c-52ce-4bb6-a825-5d869b08f847 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:21.547651 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61241c40-17b4-48bb-8836-bc1f3119a414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:21.547651 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241c40-17b4-48bb-8836-bc1f3119a414 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:21.547651 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241c40-17b4-48bb-8836-bc1f3119a414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:21.547651 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241c40-17b4-48bb-8836-bc1f3119a414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:21.556246 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61241c40-17b4-48bb-8836-bc1f3119a414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:21.557756 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61241c40-17b4-48bb-8836-bc1f3119a414 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:21.567853 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1009/2043] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:22.104487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc88db-3f93-449b-8ea6-d45bce210787 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:22.107274 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fcfc88db-3f93-449b-8ea6-d45bce210787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:22.122227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc88db-3f93-449b-8ea6-d45bce210787 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:22.129904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f30f7-9af4-4836-b42e-ec68cd427b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:22.130847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f30f7-9af4-4836-b42e-ec68cd427b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:22.131353 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f30f7-9af4-4836-b42e-ec68cd427b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:22.131460 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f30f7-9af4-4836-b42e-ec68cd427b81 admin admin] PATH_INFO: `/v3/projects/d2b0aec3cdef4a0492a1d2ab70523c97` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:22.132920 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f30f7-9af4-4836-b42e-ec68cd427b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b0aec3cdef4a0492a1d2ab70523c97)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:22.134951 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f30f7-9af4-4836-b42e-ec68cd427b81 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:22.250584 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5b2f30f7-9af4-4836-b42e-ec68cd427b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b0aec3cdef4a0492a1d2ab70523c97', 'request_id': 'req-5b2f30f7-9af4-4836-b42e-ec68cd427b81'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:22.328422 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5b2f30f7-9af4-4836-b42e-ec68cd427b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b0aec3cdef4a0492a1d2ab70523c97', 'request_id': 'req-5b2f30f7-9af4-4836-b42e-ec68cd427b81'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:22.335938 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5b2f30f7-9af4-4836-b42e-ec68cd427b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b0aec3cdef4a0492a1d2ab70523c97', 'request_id': 'req-5b2f30f7-9af4-4836-b42e-ec68cd427b81'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:22.346997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5b2f30f7-9af4-4836-b42e-ec68cd427b81 admin admin] The token cache is being invalidate because project d2b0aec3cdef4a0492a1d2ab70523c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:09:22.347923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5b2f30f7-9af4-4836-b42e-ec68cd427b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:22.348583 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5b2f30f7-9af4-4836-b42e-ec68cd427b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:09:22.350192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1035/2044] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:09:22 2022] DELETE /identity/v3/projects/d2b0aec3cdef4a0492a1d2ab70523c97 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:22.355692 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d6dd-948b-49fc-8893-a8bb813487d6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:22.356191 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d6dd-948b-49fc-8893-a8bb813487d6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:22.356325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d6dd-948b-49fc-8893-a8bb813487d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:22.378313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f8f7d6dd-948b-49fc-8893-a8bb813487d6 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:22.378313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f8f7d6dd-948b-49fc-8893-a8bb813487d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:22.465036 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1010/2045] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:22.466641 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707068ce-7cdf-4836-934a-59878caaac29 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:22.466936 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707068ce-7cdf-4836-934a-59878caaac29 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:22.467213 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707068ce-7cdf-4836-934a-59878caaac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:22.487206 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-707068ce-7cdf-4836-934a-59878caaac29 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:22.489009 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-707068ce-7cdf-4836-934a-59878caaac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:22.497162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1036/2046] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:22.555186 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7d6dd-948b-49fc-8893-a8bb813487d6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:22.555186 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7d6dd-948b-49fc-8893-a8bb813487d6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:22.555186 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71631f-5107-4069-bf1b-c4233ae086f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:22.555186 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71631f-5107-4069-bf1b-c4233ae086f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:22.555853 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71631f-5107-4069-bf1b-c4233ae086f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:22.555853 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71631f-5107-4069-bf1b-c4233ae086f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:22.555853 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71631f-5107-4069-bf1b-c4233ae086f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:09:22.555853 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71631f-5107-4069-bf1b-c4233ae086f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:22.555853 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71631f-5107-4069-bf1b-c4233ae086f7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:22.564693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1011/2047] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:09:22.568879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707068ce-7cdf-4836-934a-59878caaac29 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:22.578154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707068ce-7cdf-4836-934a-59878caaac29 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:22.582908 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc40a5-b799-414a-9839-355c8790ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:22.583553 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc40a5-b799-414a-9839-355c8790ce9e admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:22.583839 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc40a5-b799-414a-9839-355c8790ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:22.584117 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc40a5-b799-414a-9839-355c8790ce9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:22.584874 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc40a5-b799-414a-9839-355c8790ce9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:22.586802 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc40a5-b799-414a-9839-355c8790ce9e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:22.849840 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1037/2048] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:22 2022] POST /identity/v3/projects => generated 373 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:22.852268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71631f-5107-4069-bf1b-c4233ae086f7 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:22.852268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71631f-5107-4069-bf1b-c4233ae086f7 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:22.972419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448d72a-9045-406d-bec6-54953c5b1081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:22.972419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448d72a-9045-406d-bec6-54953c5b1081 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:22.972419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448d72a-9045-406d-bec6-54953c5b1081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:22.972419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448d72a-9045-406d-bec6-54953c5b1081 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:22.976091 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448d72a-9045-406d-bec6-54953c5b1081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:22.976091 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448d72a-9045-406d-bec6-54953c5b1081 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:22.984543 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99ef2e-e1fc-4e5a-93f2-1f182eba4fc1 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:22.984834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99ef2e-e1fc-4e5a-93f2-1f182eba4fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:22.985150 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99ef2e-e1fc-4e5a-93f2-1f182eba4fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:23.011073 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5d99ef2e-e1fc-4e5a-93f2-1f182eba4fc1 None None] MFA Rules not processed for user `cddbabd5671348d48b8826ed32d53442`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:23.018082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5d99ef2e-e1fc-4e5a-93f2-1f182eba4fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:23.075487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1038/2049] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:09:23.079640 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99ef2e-e1fc-4e5a-93f2-1f182eba4fc1 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:23.080925 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5d99ef2e-e1fc-4e5a-93f2-1f182eba4fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:23.095141 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99ef2e-e1fc-4e5a-93f2-1f182eba4fc1 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:23.105740 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600f5b5-4b2d-4184-910b-ce0795022b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:23.105740 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f5b5-4b2d-4184-910b-ce0795022b48 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:23.105740 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f5b5-4b2d-4184-910b-ce0795022b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:23.105740 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f5b5-4b2d-4184-910b-ce0795022b48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:23.106543 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1012/2050] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:22 2022] POST /identity/v3/users => generated 287 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:09:23.106638 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600f5b5-4b2d-4184-910b-ce0795022b48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:23.106638 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600f5b5-4b2d-4184-910b-ce0795022b48 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:23.106801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448d72a-9045-406d-bec6-54953c5b1081 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:23.116407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448d72a-9045-406d-bec6-54953c5b1081 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:23.121834 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c8ce3-925a-4db1-bd07-b746654640d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:23.122481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c8ce3-925a-4db1-bd07-b746654640d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:23.122771 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c8ce3-925a-4db1-bd07-b746654640d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:23.123043 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c8ce3-925a-4db1-bd07-b746654640d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:23.123796 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c8ce3-925a-4db1-bd07-b746654640d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:23.125670 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c8ce3-925a-4db1-bd07-b746654640d9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:23.136084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1013/2051] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:23.139974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c8ce3-925a-4db1-bd07-b746654640d9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:23.150043 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c8ce3-925a-4db1-bd07-b746654640d9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:23.154769 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda6b47-6fe5-432a-b80f-9ae5fb5257d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:23.167349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda6b47-6fe5-432a-b80f-9ae5fb5257d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:23.167349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda6b47-6fe5-432a-b80f-9ae5fb5257d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:23.167349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda6b47-6fe5-432a-b80f-9ae5fb5257d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:23.167349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda6b47-6fe5-432a-b80f-9ae5fb5257d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:23.167349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda6b47-6fe5-432a-b80f-9ae5fb5257d6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:23.168877 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1014/2052] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:23.172739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda6b47-6fe5-432a-b80f-9ae5fb5257d6 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:23.182753 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda6b47-6fe5-432a-b80f-9ae5fb5257d6 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:23.187398 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fedf1-760b-4f36-99ce-374527001798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:23.188213 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fedf1-760b-4f36-99ce-374527001798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:23.188497 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fedf1-760b-4f36-99ce-374527001798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:23.188773 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fedf1-760b-4f36-99ce-374527001798 admin admin] PATH_INFO: `/v3/projects/132785353bff4202a8cfa0544ed715d6/users/af03bebc4dec402fa6fac887bd5b27b7/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:23.198102 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1039/2053] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:09:23 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:09:23.201975 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600f5b5-4b2d-4184-910b-ce0795022b48 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:23.203215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fedf1-760b-4f36-99ce-374527001798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132785353bff4202a8cfa0544ed715d6, user_id=af03bebc4dec402fa6fac887bd5b27b7, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:23.206025 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fedf1-760b-4f36-99ce-374527001798 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:23.262687 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600f5b5-4b2d-4184-910b-ce0795022b48 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:23.267372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a5a1e-522f-4961-a939-16910af8ee76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:23.268043 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a5a1e-522f-4961-a939-16910af8ee76 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:23.268327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a5a1e-522f-4961-a939-16910af8ee76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:23.268604 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a5a1e-522f-4961-a939-16910af8ee76 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:23.269352 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a5a1e-522f-4961-a939-16910af8ee76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:23.271410 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a5a1e-522f-4961-a939-16910af8ee76 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:23.294446 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1015/2054] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:23 2022] PUT /identity/v3/projects/132785353bff4202a8cfa0544ed715d6/users/af03bebc4dec402fa6fac887bd5b27b7/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:23.305276 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48126bc6-9cbb-4439-ba75-d702aa4456e7 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:23.305568 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48126bc6-9cbb-4439-ba75-d702aa4456e7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:23.305847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48126bc6-9cbb-4439-ba75-d702aa4456e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:23.332960 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-48126bc6-9cbb-4439-ba75-d702aa4456e7 None None] MFA Rules not processed for user `af03bebc4dec402fa6fac887bd5b27b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:23.337790 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-48126bc6-9cbb-4439-ba75-d702aa4456e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:23.364373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1040/2055] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:09:23 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:09:23.368993 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a5a1e-522f-4961-a939-16910af8ee76 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:23.379408 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a5a1e-522f-4961-a939-16910af8ee76 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:23.403710 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1016/2056] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:09:23.416071 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48126bc6-9cbb-4439-ba75-d702aa4456e7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:23.417727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-48126bc6-9cbb-4439-ba75-d702aa4456e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:23.444017 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e440795-aac4-46ce-a41f-ada894e17a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:23.444926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e440795-aac4-46ce-a41f-ada894e17a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:23.445174 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e440795-aac4-46ce-a41f-ada894e17a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:23.445540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e440795-aac4-46ce-a41f-ada894e17a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:23.446331 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e440795-aac4-46ce-a41f-ada894e17a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:23.448013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e440795-aac4-46ce-a41f-ada894e17a39 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:23.459252 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1041/2057] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:09:23.463064 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e440795-aac4-46ce-a41f-ada894e17a39 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:23.473739 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e440795-aac4-46ce-a41f-ada894e17a39 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:23.478827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e649c44-562e-44be-9ac5-4e2aa75c1973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:23.479904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e649c44-562e-44be-9ac5-4e2aa75c1973 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:23.480121 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e649c44-562e-44be-9ac5-4e2aa75c1973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:23.480386 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e649c44-562e-44be-9ac5-4e2aa75c1973 admin admin] PATH_INFO: `/v3/projects/11abff5a0eb54363a047b68c03d39f1a/users/39b22c14e25646deb73bd14652a506ba/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:23.481973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48126bc6-9cbb-4439-ba75-d702aa4456e7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:23.486444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4759e39-7407-42aa-a5f1-4d5464da8a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:23.487098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4759e39-7407-42aa-a5f1-4d5464da8a8d service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:23.487378 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4759e39-7407-42aa-a5f1-4d5464da8a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:23.487685 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4759e39-7407-42aa-a5f1-4d5464da8a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:23.498068 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4759e39-7407-42aa-a5f1-4d5464da8a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:23.498410 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e649c44-562e-44be-9ac5-4e2aa75c1973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11abff5a0eb54363a047b68c03d39f1a, user_id=39b22c14e25646deb73bd14652a506ba, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:23.499733 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4759e39-7407-42aa-a5f1-4d5464da8a8d service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:23.501541 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e649c44-562e-44be-9ac5-4e2aa75c1973 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:23.509883 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1017/2058] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:09:23.574727 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1042/2059] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:23 2022] PUT /identity/v3/projects/11abff5a0eb54363a047b68c03d39f1a/users/39b22c14e25646deb73bd14652a506ba/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:09:23.582480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4759e39-7407-42aa-a5f1-4d5464da8a8d service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:23.593149 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4759e39-7407-42aa-a5f1-4d5464da8a8d service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:23.653823 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b0464-1b54-4eba-b5c2-d9ad86f40f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:23.654422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b0464-1b54-4eba-b5c2-d9ad86f40f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:23.654719 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b0464-1b54-4eba-b5c2-d9ad86f40f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:23.655002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b0464-1b54-4eba-b5c2-d9ad86f40f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:23.655734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b0464-1b54-4eba-b5c2-d9ad86f40f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:23.657669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b0464-1b54-4eba-b5c2-d9ad86f40f16 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:23.674815 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1018/2060] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:09:23.676094 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e649c44-562e-44be-9ac5-4e2aa75c1973 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:23.689419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e649c44-562e-44be-9ac5-4e2aa75c1973 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:23.694715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0b39a-7a5f-4466-ac6a-19ad3a488ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:23.695587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b39a-7a5f-4466-ac6a-19ad3a488ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:23.695866 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b39a-7a5f-4466-ac6a-19ad3a488ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:23.696138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b39a-7a5f-4466-ac6a-19ad3a488ec7 admin admin] PATH_INFO: `/v3/projects/11abff5a0eb54363a047b68c03d39f1a/users/39b22c14e25646deb73bd14652a506ba/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:23.698213 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0b39a-7a5f-4466-ac6a-19ad3a488ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11abff5a0eb54363a047b68c03d39f1a, user_id=39b22c14e25646deb73bd14652a506ba, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:23.708887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0b39a-7a5f-4466-ac6a-19ad3a488ec7 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:23.710680 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1043/2061] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:09:23 2022] PUT /identity/v3/projects/11abff5a0eb54363a047b68c03d39f1a/users/39b22c14e25646deb73bd14652a506ba/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:09:24.997917 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5047-495e-4b70-acac-f4becb9aba2b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:24.998408 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5047-495e-4b70-acac-f4becb9aba2b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:24.998624 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5047-495e-4b70-acac-f4becb9aba2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:25.025648 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ce0d5047-495e-4b70-acac-f4becb9aba2b None None] MFA Rules not processed for user `39b22c14e25646deb73bd14652a506ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:25.026866 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ce0d5047-495e-4b70-acac-f4becb9aba2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:25.094846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1019/2062] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:25.106934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0b39a-7a5f-4466-ac6a-19ad3a488ec7 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:25.163388 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0b39a-7a5f-4466-ac6a-19ad3a488ec7 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:25.167108 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54e17e-c2fc-48b9-9cc8-6090a086d56a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:25.167753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54e17e-c2fc-48b9-9cc8-6090a086d56a service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:25.168037 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54e17e-c2fc-48b9-9cc8-6090a086d56a service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:25.168315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54e17e-c2fc-48b9-9cc8-6090a086d56a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:25.224240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54e17e-c2fc-48b9-9cc8-6090a086d56a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:25.228709 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54e17e-c2fc-48b9-9cc8-6090a086d56a service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:25.235049 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1044/2063] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:09:27.016457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d9b4c-e2a0-45a0-836b-2d6e28c79e47 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:27.016985 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d9b4c-e2a0-45a0-836b-2d6e28c79e47 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:27.017128 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d9b4c-e2a0-45a0-836b-2d6e28c79e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:27.037084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a65d9b4c-e2a0-45a0-836b-2d6e28c79e47 None None] MFA Rules not processed for user `af03bebc4dec402fa6fac887bd5b27b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:09:27.038376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a65d9b4c-e2a0-45a0-836b-2d6e28c79e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:09:27.110096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1020/2064] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:09:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:09:34.453949 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54e17e-c2fc-48b9-9cc8-6090a086d56a service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:09:34.462615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54e17e-c2fc-48b9-9cc8-6090a086d56a service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:09:34.466561 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd86be-11c5-425d-b7fd-c790c2b19a7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:09:34.467205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd86be-11c5-425d-b7fd-c790c2b19a7b service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:09:34.467485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd86be-11c5-425d-b7fd-c790c2b19a7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:09:34.467757 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd86be-11c5-425d-b7fd-c790c2b19a7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:09:34.478414 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd86be-11c5-425d-b7fd-c790c2b19a7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:09:34.479886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd86be-11c5-425d-b7fd-c790c2b19a7b service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:09:34.490554 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1045/2065] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:09:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:10:01.840406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d9b4c-e2a0-45a0-836b-2d6e28c79e47 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:01.841930 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a65d9b4c-e2a0-45a0-836b-2d6e28c79e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:01.978688 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d9b4c-e2a0-45a0-836b-2d6e28c79e47 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:01.983735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c0e5f-0691-4670-a092-2294a0de5675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:01.984610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c0e5f-0691-4670-a092-2294a0de5675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:01.984893 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c0e5f-0691-4670-a092-2294a0de5675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:01.985253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c0e5f-0691-4670-a092-2294a0de5675 admin admin] PATH_INFO: `/v3/users/00a25285f40b4c91b39114f63ec62d2e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:01.986416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c0e5f-0691-4670-a092-2294a0de5675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a25285f40b4c91b39114f63ec62d2e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:01.988470 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c0e5f-0691-4670-a092-2294a0de5675 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:02.206423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c02c0e5f-0691-4670-a092-2294a0de5675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a25285f40b4c91b39114f63ec62d2e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:02.207385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c02c0e5f-0691-4670-a092-2294a0de5675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a25285f40b4c91b39114f63ec62d2e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:02.207913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c02c0e5f-0691-4670-a092-2294a0de5675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a25285f40b4c91b39114f63ec62d2e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:02.339593 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c02c0e5f-0691-4670-a092-2294a0de5675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a25285f40b4c91b39114f63ec62d2e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:02.355166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c02c0e5f-0691-4670-a092-2294a0de5675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a25285f40b4c91b39114f63ec62d2e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:02.367725 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1021/2066] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:10:01 2022] DELETE /identity/v3/users/00a25285f40b4c91b39114f63ec62d2e => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:02.378871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaff77-56fa-4908-9199-854b471552d1 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:02.378871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaff77-56fa-4908-9199-854b471552d1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:02.378871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaff77-56fa-4908-9199-854b471552d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:02.402678 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-9ddaff77-56fa-4908-9199-854b471552d1 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:02.403903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9ddaff77-56fa-4908-9199-854b471552d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:02.465957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1046/2067] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:10:02.488100 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c0e5f-0691-4670-a092-2294a0de5675 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:02.488743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c02c0e5f-0691-4670-a092-2294a0de5675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:02.601718 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c0e5f-0691-4670-a092-2294a0de5675 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:02.606142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a3191-3e75-4b06-b516-62ea65ce16fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:02.606616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a3191-3e75-4b06-b516-62ea65ce16fc service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:02.606932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a3191-3e75-4b06-b516-62ea65ce16fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:02.607158 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a3191-3e75-4b06-b516-62ea65ce16fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:02.618477 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a3191-3e75-4b06-b516-62ea65ce16fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:02.621792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a3191-3e75-4b06-b516-62ea65ce16fc service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:02.635588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1022/2068] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:10:03.114889 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaff77-56fa-4908-9199-854b471552d1 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:03.116867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9ddaff77-56fa-4908-9199-854b471552d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:03.128972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaff77-56fa-4908-9199-854b471552d1 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:03.135139 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fac440-19bb-400f-93f4-7fbc7a489e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:03.136015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac440-19bb-400f-93f4-7fbc7a489e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:03.136301 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac440-19bb-400f-93f4-7fbc7a489e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:03.136577 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac440-19bb-400f-93f4-7fbc7a489e18 admin admin] PATH_INFO: `/v3/projects/979f5afc46ba488dbc235fbaea1388d1` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:03.137845 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fac440-19bb-400f-93f4-7fbc7a489e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=979f5afc46ba488dbc235fbaea1388d1)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:03.139711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fac440-19bb-400f-93f4-7fbc7a489e18 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:03.248383 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-36fac440-19bb-400f-93f4-7fbc7a489e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979f5afc46ba488dbc235fbaea1388d1', 'request_id': 'req-36fac440-19bb-400f-93f4-7fbc7a489e18'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:03.293242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-36fac440-19bb-400f-93f4-7fbc7a489e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979f5afc46ba488dbc235fbaea1388d1', 'request_id': 'req-36fac440-19bb-400f-93f4-7fbc7a489e18'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:03.299739 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-36fac440-19bb-400f-93f4-7fbc7a489e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979f5afc46ba488dbc235fbaea1388d1', 'request_id': 'req-36fac440-19bb-400f-93f4-7fbc7a489e18'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:03.310546 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-36fac440-19bb-400f-93f4-7fbc7a489e18 admin admin] The token cache is being invalidate because project 979f5afc46ba488dbc235fbaea1388d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:10:03.310836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-36fac440-19bb-400f-93f4-7fbc7a489e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:03.311517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-36fac440-19bb-400f-93f4-7fbc7a489e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:03.313127 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1047/2069] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:10:03 2022] DELETE /identity/v3/projects/979f5afc46ba488dbc235fbaea1388d1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:03.321927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a368da-d6b7-4b34-9dfc-ab23aa274e9b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:03.321927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a368da-d6b7-4b34-9dfc-ab23aa274e9b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:03.321927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a368da-d6b7-4b34-9dfc-ab23aa274e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:03.357658 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-93a368da-d6b7-4b34-9dfc-ab23aa274e9b None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:03.359110 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-93a368da-d6b7-4b34-9dfc-ab23aa274e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:03.416264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1023/2070] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:03.424400 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1e19-77cd-4af8-998f-1bd8a5020c79 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:03.424886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1e19-77cd-4af8-998f-1bd8a5020c79 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:03.424978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1e19-77cd-4af8-998f-1bd8a5020c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:03.443741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e61c1e19-77cd-4af8-998f-1bd8a5020c79 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:03.445555 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e61c1e19-77cd-4af8-998f-1bd8a5020c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:03.453581 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1048/2071] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:03.464830 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a368da-d6b7-4b34-9dfc-ab23aa274e9b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:03.474485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a368da-d6b7-4b34-9dfc-ab23aa274e9b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:03.479170 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833e944-2a73-442a-a358-c3a403b51f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:03.479825 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833e944-2a73-442a-a358-c3a403b51f2e admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:03.480111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833e944-2a73-442a-a358-c3a403b51f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:03.480387 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833e944-2a73-442a-a358-c3a403b51f2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:03.481212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833e944-2a73-442a-a358-c3a403b51f2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:10:03.481523 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833e944-2a73-442a-a358-c3a403b51f2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:03.483157 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833e944-2a73-442a-a358-c3a403b51f2e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:03.494377 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1024/2072] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:10:03.498827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c1e19-77cd-4af8-998f-1bd8a5020c79 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:03.508418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c1e19-77cd-4af8-998f-1bd8a5020c79 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:03.513204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd8192-ad86-4c45-8a53-da9c6cec955c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:03.513852 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd8192-ad86-4c45-8a53-da9c6cec955c admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:03.514139 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd8192-ad86-4c45-8a53-da9c6cec955c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:03.514418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd8192-ad86-4c45-8a53-da9c6cec955c admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:03.515119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd8192-ad86-4c45-8a53-da9c6cec955c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:03.517008 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd8192-ad86-4c45-8a53-da9c6cec955c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:03.626574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1049/2073] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:10:03 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:10:03.630713 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833e944-2a73-442a-a358-c3a403b51f2e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:03.641255 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833e944-2a73-442a-a358-c3a403b51f2e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:03.697234 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962e727-674d-428d-af7b-36fd140c7afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:03.697896 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962e727-674d-428d-af7b-36fd140c7afd admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:03.698178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962e727-674d-428d-af7b-36fd140c7afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:03.698450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962e727-674d-428d-af7b-36fd140c7afd admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:03.699141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962e727-674d-428d-af7b-36fd140c7afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:03.701110 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962e727-674d-428d-af7b-36fd140c7afd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:03.772388 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1025/2074] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:10:03 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:10:03.776567 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd8192-ad86-4c45-8a53-da9c6cec955c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:03.787311 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd8192-ad86-4c45-8a53-da9c6cec955c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:03.792102 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42d561-2642-41f6-953a-f704c5857fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:03.792800 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42d561-2642-41f6-953a-f704c5857fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:03.796348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42d561-2642-41f6-953a-f704c5857fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:03.796348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42d561-2642-41f6-953a-f704c5857fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:03.796348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42d561-2642-41f6-953a-f704c5857fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:03.796348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42d561-2642-41f6-953a-f704c5857fd0 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:03.806779 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1050/2075] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:10:03.810418 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962e727-674d-428d-af7b-36fd140c7afd admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:03.820916 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962e727-674d-428d-af7b-36fd140c7afd admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:03.825528 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3ecac-dcd3-4a78-87f3-b9897ae6b563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:03.826170 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ecac-dcd3-4a78-87f3-b9897ae6b563 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:03.826450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ecac-dcd3-4a78-87f3-b9897ae6b563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:03.826719 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ecac-dcd3-4a78-87f3-b9897ae6b563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:03.827438 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3ecac-dcd3-4a78-87f3-b9897ae6b563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:03.829072 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3ecac-dcd3-4a78-87f3-b9897ae6b563 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:03.838493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1026/2076] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:10:03.842312 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42d561-2642-41f6-953a-f704c5857fd0 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:03.852136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42d561-2642-41f6-953a-f704c5857fd0 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:03.856790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc451f66-b7c4-4dda-93ab-4d68abaebc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:03.857697 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc451f66-b7c4-4dda-93ab-4d68abaebc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:03.857980 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc451f66-b7c4-4dda-93ab-4d68abaebc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:03.858259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc451f66-b7c4-4dda-93ab-4d68abaebc28 admin admin] PATH_INFO: `/v3/projects/41d757cafb7946c88886c285b5a3e307/users/bb4a3a32eab24a43ace2277485375bfb/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:03.872609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc451f66-b7c4-4dda-93ab-4d68abaebc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d757cafb7946c88886c285b5a3e307, user_id=bb4a3a32eab24a43ace2277485375bfb, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:03.875273 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc451f66-b7c4-4dda-93ab-4d68abaebc28 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:03.945447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1051/2077] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:10:03 2022] PUT /identity/v3/projects/41d757cafb7946c88886c285b5a3e307/users/bb4a3a32eab24a43ace2277485375bfb/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:03.956143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff9cd4-3a41-4e75-9352-ee426ea868ab None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:03.956444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff9cd4-3a41-4e75-9352-ee426ea868ab None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:03.956724 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff9cd4-3a41-4e75-9352-ee426ea868ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:03.987184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-edff9cd4-3a41-4e75-9352-ee426ea868ab None None] MFA Rules not processed for user `bb4a3a32eab24a43ace2277485375bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:03.988420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-edff9cd4-3a41-4e75-9352-ee426ea868ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:04.059567 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1027/2078] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:04.071240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc451f66-b7c4-4dda-93ab-4d68abaebc28 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:04.074849 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-bc451f66-b7c4-4dda-93ab-4d68abaebc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:04.128212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc451f66-b7c4-4dda-93ab-4d68abaebc28 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:04.131958 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e1dd-56e1-48e1-bc7d-f8a78b6adba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:04.132597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e1dd-56e1-48e1-bc7d-f8a78b6adba1 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:04.132881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e1dd-56e1-48e1-bc7d-f8a78b6adba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:04.133195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e1dd-56e1-48e1-bc7d-f8a78b6adba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:04.141393 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4e1dd-56e1-48e1-bc7d-f8a78b6adba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:04.145207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4e1dd-56e1-48e1-bc7d-f8a78b6adba1 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:04.151557 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1052/2079] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:10:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:10:07.646191 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f55579-f987-40dd-9615-02123fd4ba17 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:07.648699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f55579-f987-40dd-9615-02123fd4ba17 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:07.648699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f55579-f987-40dd-9615-02123fd4ba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:07.666890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c3f55579-f987-40dd-9615-02123fd4ba17 None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:07.668104 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c3f55579-f987-40dd-9615-02123fd4ba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:07.729264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1028/2080] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:10:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:07.771365 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e1dd-56e1-48e1-bc7d-f8a78b6adba1 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:07.773370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d0e4e1dd-56e1-48e1-bc7d-f8a78b6adba1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:07.850411 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e1dd-56e1-48e1-bc7d-f8a78b6adba1 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:07.856090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeadbd6-a311-47ff-a88c-d9a4172386a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:07.856911 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeadbd6-a311-47ff-a88c-d9a4172386a1 service swift] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:07.857246 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeadbd6-a311-47ff-a88c-d9a4172386a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:07.857560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeadbd6-a311-47ff-a88c-d9a4172386a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:07.866545 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeadbd6-a311-47ff-a88c-d9a4172386a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:07.868131 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeadbd6-a311-47ff-a88c-d9a4172386a1 service swift] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:07.876507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1053/2081] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:10:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 06 11:10:08.219015 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f55579-f987-40dd-9615-02123fd4ba17 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:08.300792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f55579-f987-40dd-9615-02123fd4ba17 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:08.309474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cf5d5-8334-4126-ba36-844a880dcb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:08.309474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cf5d5-8334-4126-ba36-844a880dcb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:08.309474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cf5d5-8334-4126-ba36-844a880dcb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:08.309474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cf5d5-8334-4126-ba36-844a880dcb7b admin admin] PATH_INFO: `/v3/users/bb4a3a32eab24a43ace2277485375bfb` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:08.309749 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01cf5d5-8334-4126-ba36-844a880dcb7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb4a3a32eab24a43ace2277485375bfb)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:08.309749 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01cf5d5-8334-4126-ba36-844a880dcb7b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:08.508089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a01cf5d5-8334-4126-ba36-844a880dcb7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb4a3a32eab24a43ace2277485375bfb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:08.509197 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a01cf5d5-8334-4126-ba36-844a880dcb7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb4a3a32eab24a43ace2277485375bfb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:08.513480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a01cf5d5-8334-4126-ba36-844a880dcb7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb4a3a32eab24a43ace2277485375bfb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:08.584757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a01cf5d5-8334-4126-ba36-844a880dcb7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb4a3a32eab24a43ace2277485375bfb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:08.614859 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a01cf5d5-8334-4126-ba36-844a880dcb7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb4a3a32eab24a43ace2277485375bfb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:08.629984 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1029/2082] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:10:08 2022] DELETE /identity/v3/users/bb4a3a32eab24a43ace2277485375bfb => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:08.634919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa8442-9194-493d-95f6-e4b18ae274b6 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:08.635214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa8442-9194-493d-95f6-e4b18ae274b6 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:08.635500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa8442-9194-493d-95f6-e4b18ae274b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:08.656835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c4aa8442-9194-493d-95f6-e4b18ae274b6 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:08.656835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c4aa8442-9194-493d-95f6-e4b18ae274b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:08.717430 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1054/2083] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:08.730285 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cf5d5-8334-4126-ba36-844a880dcb7b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:08.732132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a01cf5d5-8334-4126-ba36-844a880dcb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:08.749810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bc88f-1c4b-4b04-8e94-78d739f622ff None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:08.750103 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bc88f-1c4b-4b04-8e94-78d739f622ff None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:08.750381 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bc88f-1c4b-4b04-8e94-78d739f622ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:08.773713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-191bc88f-1c4b-4b04-8e94-78d739f622ff None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:08.774936 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-191bc88f-1c4b-4b04-8e94-78d739f622ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:08.806416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cf5d5-8334-4126-ba36-844a880dcb7b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:08.810183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c845b-5b90-4b34-9cf5-a0f54614d7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:08.810863 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c845b-5b90-4b34-9cf5-a0f54614d7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:08.811142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c845b-5b90-4b34-9cf5-a0f54614d7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:08.811461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c845b-5b90-4b34-9cf5-a0f54614d7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:08.824527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c845b-5b90-4b34-9cf5-a0f54614d7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:08.824527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c845b-5b90-4b34-9cf5-a0f54614d7c5 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:08.842505 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1030/2084] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:10:08.848098 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1055/2085] 10.222.0.62 () {58 vars in 967 bytes} [Wed Apr 6 11:10:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:08.866179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c845b-5b90-4b34-9cf5-a0f54614d7c5 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:08.867720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ee3c845b-5b90-4b34-9cf5-a0f54614d7c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:08.943683 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c845b-5b90-4b34-9cf5-a0f54614d7c5 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:08.952565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519dc276-6221-442a-8013-ec1da70913b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:08.953270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dc276-6221-442a-8013-ec1da70913b8 service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:08.959540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dc276-6221-442a-8013-ec1da70913b8 service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:08.959540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dc276-6221-442a-8013-ec1da70913b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:08.963484 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519dc276-6221-442a-8013-ec1da70913b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:08.965170 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519dc276-6221-442a-8013-ec1da70913b8 service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:08.973600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1031/2086] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:10:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 11:10:09.195688 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bc88f-1c4b-4b04-8e94-78d739f622ff None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:09.197447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-191bc88f-1c4b-4b04-8e94-78d739f622ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:09.217386 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bc88f-1c4b-4b04-8e94-78d739f622ff None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:09.229554 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1dd0d-5591-4f78-b9e2-4b45cce6d13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:09.230449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1dd0d-5591-4f78-b9e2-4b45cce6d13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:09.230738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1dd0d-5591-4f78-b9e2-4b45cce6d13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:09.231018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1dd0d-5591-4f78-b9e2-4b45cce6d13d admin admin] PATH_INFO: `/v3/users/cddbabd5671348d48b8826ed32d53442` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:09.232267 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1dd0d-5591-4f78-b9e2-4b45cce6d13d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cddbabd5671348d48b8826ed32d53442)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:09.234671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1dd0d-5591-4f78-b9e2-4b45cce6d13d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:09.433702 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-abb1dd0d-5591-4f78-b9e2-4b45cce6d13d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cddbabd5671348d48b8826ed32d53442'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:09.434375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-abb1dd0d-5591-4f78-b9e2-4b45cce6d13d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cddbabd5671348d48b8826ed32d53442'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:09.435011 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-abb1dd0d-5591-4f78-b9e2-4b45cce6d13d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cddbabd5671348d48b8826ed32d53442'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:09.452378 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-abb1dd0d-5591-4f78-b9e2-4b45cce6d13d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cddbabd5671348d48b8826ed32d53442'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:09.459166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519dc276-6221-442a-8013-ec1da70913b8 service swift] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:09.461252 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-519dc276-6221-442a-8013-ec1da70913b8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:09.463796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-abb1dd0d-5591-4f78-b9e2-4b45cce6d13d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cddbabd5671348d48b8826ed32d53442'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:09.476183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519dc276-6221-442a-8013-ec1da70913b8 service swift] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:09.481245 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfe73c-d60a-48d4-8218-71627660e607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:09.482335 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe73c-d60a-48d4-8218-71627660e607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:09.482804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe73c-d60a-48d4-8218-71627660e607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:09.483280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe73c-d60a-48d4-8218-71627660e607 admin admin] PATH_INFO: `/v3/projects/41d757cafb7946c88886c285b5a3e307` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:09.485039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfe73c-d60a-48d4-8218-71627660e607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d757cafb7946c88886c285b5a3e307)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:09.487429 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfe73c-d60a-48d4-8218-71627660e607 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:09.528947 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1056/2087] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:10:09 2022] DELETE /identity/v3/users/cddbabd5671348d48b8826ed32d53442 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:10:09.622088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-62cfe73c-d60a-48d4-8218-71627660e607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d757cafb7946c88886c285b5a3e307', 'request_id': 'req-62cfe73c-d60a-48d4-8218-71627660e607'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:09.628965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-62cfe73c-d60a-48d4-8218-71627660e607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d757cafb7946c88886c285b5a3e307', 'request_id': 'req-62cfe73c-d60a-48d4-8218-71627660e607'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:09.635656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-62cfe73c-d60a-48d4-8218-71627660e607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d757cafb7946c88886c285b5a3e307', 'request_id': 'req-62cfe73c-d60a-48d4-8218-71627660e607'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:09.716899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-62cfe73c-d60a-48d4-8218-71627660e607 admin admin] The token cache is being invalidate because project 41d757cafb7946c88886c285b5a3e307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:10:09.717212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-62cfe73c-d60a-48d4-8218-71627660e607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:09.717905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-62cfe73c-d60a-48d4-8218-71627660e607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:09.719539 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1032/2088] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:10:09 2022] DELETE /identity/v3/projects/41d757cafb7946c88886c285b5a3e307 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:09.724775 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a1345-71e1-428d-ad1f-3184873ef6ff None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:09.724927 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a1345-71e1-428d-ad1f-3184873ef6ff None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:09.725337 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a1345-71e1-428d-ad1f-3184873ef6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:09.737960 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a7a01-855f-4f0f-8075-32f03a0419b3 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:09.738443 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a7a01-855f-4f0f-8075-32f03a0419b3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:09.738588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a7a01-855f-4f0f-8075-32f03a0419b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:09.745160 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7a9a1345-71e1-428d-ad1f-3184873ef6ff None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:09.746393 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7a9a1345-71e1-428d-ad1f-3184873ef6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:09.757179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6f5a7a01-855f-4f0f-8075-32f03a0419b3 None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:09.758510 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6f5a7a01-855f-4f0f-8075-32f03a0419b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:09.816947 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1057/2089] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:09.818401 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a1345-71e1-428d-ad1f-3184873ef6ff None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:09.822155 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7a9a1345-71e1-428d-ad1f-3184873ef6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:09.823748 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1033/2090] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:10:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:10:09.831309 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60b5d8-dbc1-4c4a-be4a-8c23ab4847a0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:09.831475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60b5d8-dbc1-4c4a-be4a-8c23ab4847a0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:09.831751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60b5d8-dbc1-4c4a-be4a-8c23ab4847a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:09.839292 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a1345-71e1-428d-ad1f-3184873ef6ff None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:09.844559 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:09.845551 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:09.845910 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:09.846258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] PATH_INFO: `/v3/projects/05ae77c080d7417aab52594bc467013a` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:09.847517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ae77c080d7417aab52594bc467013a)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:09.849552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:09.852125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ed60b5d8-dbc1-4c4a-be4a-8c23ab4847a0 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:09.853353 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ed60b5d8-dbc1-4c4a-be4a-8c23ab4847a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:09.861314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1034/2091] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:09.862250 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60b5d8-dbc1-4c4a-be4a-8c23ab4847a0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:09.863464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ed60b5d8-dbc1-4c4a-be4a-8c23ab4847a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:09.934338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60b5d8-dbc1-4c4a-be4a-8c23ab4847a0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:09.939437 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cad72-3de7-41a4-a12b-55bb06ad25f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:09.940219 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cad72-3de7-41a4-a12b-55bb06ad25f6 service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:09.940507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cad72-3de7-41a4-a12b-55bb06ad25f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:09.940788 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cad72-3de7-41a4-a12b-55bb06ad25f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:09.950356 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cad72-3de7-41a4-a12b-55bb06ad25f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:09.952152 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cad72-3de7-41a4-a12b-55bb06ad25f6 service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:09.961658 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1035/2092] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:10:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 11:10:09.962575 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cad72-3de7-41a4-a12b-55bb06ad25f6 service swift] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:09.966823 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ae77c080d7417aab52594bc467013a', 'request_id': 'req-1a1a060c-92a9-4944-b579-daa237c638e6'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:09.974476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cad72-3de7-41a4-a12b-55bb06ad25f6 service swift] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:10.033932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f929a0-2c82-4881-a0e7-b787dee56de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:10.034606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f929a0-2c82-4881-a0e7-b787dee56de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:10.034881 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f929a0-2c82-4881-a0e7-b787dee56de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:10.035325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f929a0-2c82-4881-a0e7-b787dee56de6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:10.036044 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f929a0-2c82-4881-a0e7-b787dee56de6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:10:10.036350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f929a0-2c82-4881-a0e7-b787dee56de6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:10.038070 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f929a0-2c82-4881-a0e7-b787dee56de6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:10.047367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ae77c080d7417aab52594bc467013a', 'request_id': 'req-1a1a060c-92a9-4944-b579-daa237c638e6'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:10.049772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1036/2093] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:10:10.054133 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f929a0-2c82-4881-a0e7-b787dee56de6 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:10.055818 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ae77c080d7417aab52594bc467013a', 'request_id': 'req-1a1a060c-92a9-4944-b579-daa237c638e6'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:10.063965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f929a0-2c82-4881-a0e7-b787dee56de6 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:10.067836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] The token cache is being invalidate because project 05ae77c080d7417aab52594bc467013a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:10:10.068288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:10.069079 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff63273-2c0f-4c84-808c-34c45f2c5738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:10.069741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:10.070253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63273-2c0f-4c84-808c-34c45f2c5738 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:10.070535 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63273-2c0f-4c84-808c-34c45f2c5738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:10.070811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63273-2c0f-4c84-808c-34c45f2c5738 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:10.071409 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1058/2094] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:10:09 2022] DELETE /identity/v3/projects/05ae77c080d7417aab52594bc467013a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:10.071788 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff63273-2c0f-4c84-808c-34c45f2c5738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:10.073811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff63273-2c0f-4c84-808c-34c45f2c5738 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:10.076264 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:10.078318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:10.094610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a060c-92a9-4944-b579-daa237c638e6 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:10.101971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d5dbc-8b3f-4fb7-a450-b948e271e556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:10.103130 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d5dbc-8b3f-4fb7-a450-b948e271e556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:10.104306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d5dbc-8b3f-4fb7-a450-b948e271e556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:10.104691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d5dbc-8b3f-4fb7-a450-b948e271e556 admin admin] PATH_INFO: `/v3/users/39b22c14e25646deb73bd14652a506ba` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:10.106211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d5dbc-8b3f-4fb7-a450-b948e271e556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b22c14e25646deb73bd14652a506ba)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:10.109624 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d5dbc-8b3f-4fb7-a450-b948e271e556 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:10.175093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1037/2095] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:10:10 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:10:10.179178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff63273-2c0f-4c84-808c-34c45f2c5738 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:10.180874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8ff63273-2c0f-4c84-808c-34c45f2c5738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:10.254996 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff63273-2c0f-4c84-808c-34c45f2c5738 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:10.260442 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3b5fd-ed49-4eae-b2e8-37bbe2c8774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:10.264765 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b5fd-ed49-4eae-b2e8-37bbe2c8774c admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:10.264765 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b5fd-ed49-4eae-b2e8-37bbe2c8774c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:10.264765 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b5fd-ed49-4eae-b2e8-37bbe2c8774c admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:10.264765 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3b5fd-ed49-4eae-b2e8-37bbe2c8774c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:10.265574 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3b5fd-ed49-4eae-b2e8-37bbe2c8774c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:10.269354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0f2d5dbc-8b3f-4fb7-a450-b948e271e556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b22c14e25646deb73bd14652a506ba'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:10.270061 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0f2d5dbc-8b3f-4fb7-a450-b948e271e556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b22c14e25646deb73bd14652a506ba'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:10.270690 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0f2d5dbc-8b3f-4fb7-a450-b948e271e556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b22c14e25646deb73bd14652a506ba'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:10.289081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0f2d5dbc-8b3f-4fb7-a450-b948e271e556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b22c14e25646deb73bd14652a506ba'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:10.295769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0f2d5dbc-8b3f-4fb7-a450-b948e271e556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b22c14e25646deb73bd14652a506ba'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:10.334421 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1038/2096] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:10:10 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:10:10.338860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3b5fd-ed49-4eae-b2e8-37bbe2c8774c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:10.340735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fdd3b5fd-ed49-4eae-b2e8-37bbe2c8774c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:10.354895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1059/2097] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:10:10 2022] DELETE /identity/v3/users/39b22c14e25646deb73bd14652a506ba => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:10:10.359148 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3b5fd-ed49-4eae-b2e8-37bbe2c8774c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:10.416088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5862c1-4b54-4062-88d2-99364a9058cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:10.416349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5862c1-4b54-4062-88d2-99364a9058cb admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:10.416680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5862c1-4b54-4062-88d2-99364a9058cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:10.417022 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5862c1-4b54-4062-88d2-99364a9058cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:10.417988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5862c1-4b54-4062-88d2-99364a9058cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:10.419804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5862c1-4b54-4062-88d2-99364a9058cb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:10.431661 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1039/2098] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:10:10.435513 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d5dbc-8b3f-4fb7-a450-b948e271e556 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:10.448290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d5dbc-8b3f-4fb7-a450-b948e271e556 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:10.453651 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09880f-d64f-4078-9dc7-672d3835042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:10.454432 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09880f-d64f-4078-9dc7-672d3835042f admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:10.454785 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09880f-d64f-4078-9dc7-672d3835042f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:10.455241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09880f-d64f-4078-9dc7-672d3835042f admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:10.456049 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09880f-d64f-4078-9dc7-672d3835042f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:10.457833 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09880f-d64f-4078-9dc7-672d3835042f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:10.473468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5862c1-4b54-4062-88d2-99364a9058cb admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:10.483547 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1060/2099] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:10:10.486776 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5862c1-4b54-4062-88d2-99364a9058cb admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:10.493091 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7372e2f-4afc-4f48-982c-c4a66f2edc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:10.495052 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7372e2f-4afc-4f48-982c-c4a66f2edc16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:10.495976 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7372e2f-4afc-4f48-982c-c4a66f2edc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:10.496514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7372e2f-4afc-4f48-982c-c4a66f2edc16 admin admin] PATH_INFO: `/v3/projects/d3ce1c3afe244184898cd4d28a766de7/users/b7ae72d145a7437fa7ffd7d25c06b6e5/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:10.520914 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7372e2f-4afc-4f48-982c-c4a66f2edc16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ce1c3afe244184898cd4d28a766de7, user_id=b7ae72d145a7437fa7ffd7d25c06b6e5, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:10.527297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7372e2f-4afc-4f48-982c-c4a66f2edc16 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:10.613120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1040/2100] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:10:10 2022] PUT /identity/v3/projects/d3ce1c3afe244184898cd4d28a766de7/users/b7ae72d145a7437fa7ffd7d25c06b6e5/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:10.617792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a38e4f-fb36-43a6-bf7d-671329b25296 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:10.618090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a38e4f-fb36-43a6-bf7d-671329b25296 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:10.618580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a38e4f-fb36-43a6-bf7d-671329b25296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:10.620195 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e175941-d7c0-43fc-abcb-965f99cf669e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:10.620485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e175941-d7c0-43fc-abcb-965f99cf669e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:10.620765 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e175941-d7c0-43fc-abcb-965f99cf669e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:10.638147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a1a38e4f-fb36-43a6-bf7d-671329b25296 None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:10.639628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a1a38e4f-fb36-43a6-bf7d-671329b25296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:10.649029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5e175941-d7c0-43fc-abcb-965f99cf669e None None] MFA Rules not processed for user `b7ae72d145a7437fa7ffd7d25c06b6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:10.650351 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5e175941-d7c0-43fc-abcb-965f99cf669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:10.700128 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1061/2101] 10.222.0.62 () {58 vars in 967 bytes} [Wed Apr 6 11:10:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:10.715329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a38e4f-fb36-43a6-bf7d-671329b25296 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:10.716791 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a1a38e4f-fb36-43a6-bf7d-671329b25296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:10.756147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1041/2102] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:10:10.757948 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e175941-d7c0-43fc-abcb-965f99cf669e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:10.759693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5e175941-d7c0-43fc-abcb-965f99cf669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:10.808790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a38e4f-fb36-43a6-bf7d-671329b25296 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:10.814506 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb05b1-e625-42d7-97e0-3b4b0255d427 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:10.815698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb05b1-e625-42d7-97e0-3b4b0255d427 service swift] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:10.816197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb05b1-e625-42d7-97e0-3b4b0255d427 service swift] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:10.816684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb05b1-e625-42d7-97e0-3b4b0255d427 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:10.827575 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e175941-d7c0-43fc-abcb-965f99cf669e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:10.831050 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb05b1-e625-42d7-97e0-3b4b0255d427 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:10.832390 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23081117-2c9c-4a42-86c7-a6653f6a6ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:10.833217 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb05b1-e625-42d7-97e0-3b4b0255d427 service swift] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:10.833327 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081117-2c9c-4a42-86c7-a6653f6a6ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:10.833558 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081117-2c9c-4a42-86c7-a6653f6a6ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:10.833833 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081117-2c9c-4a42-86c7-a6653f6a6ba3 admin admin] PATH_INFO: `/v3/users/943b6ee853b3419d86efb708721cbeb5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:10.835577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23081117-2c9c-4a42-86c7-a6653f6a6ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=943b6ee853b3419d86efb708721cbeb5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:10.837566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23081117-2c9c-4a42-86c7-a6653f6a6ba3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:10.845737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1062/2103] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:10:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 11:10:10.846494 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb05b1-e625-42d7-97e0-3b4b0255d427 service swift] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:10.847961 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5cfb05b1-e625-42d7-97e0-3b4b0255d427 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:10.861471 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb05b1-e625-42d7-97e0-3b4b0255d427 service swift] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:10.866848 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:10.867909 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:10.868351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:10.868692 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] PATH_INFO: `/v3/projects/11abff5a0eb54363a047b68c03d39f1a` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:10.870186 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=11abff5a0eb54363a047b68c03d39f1a)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:10.872129 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:11.027731 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-23081117-2c9c-4a42-86c7-a6653f6a6ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943b6ee853b3419d86efb708721cbeb5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.027926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11abff5a0eb54363a047b68c03d39f1a', 'request_id': 'req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.028442 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-23081117-2c9c-4a42-86c7-a6653f6a6ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943b6ee853b3419d86efb708721cbeb5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.029093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-23081117-2c9c-4a42-86c7-a6653f6a6ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943b6ee853b3419d86efb708721cbeb5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.081517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11abff5a0eb54363a047b68c03d39f1a', 'request_id': 'req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.087898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11abff5a0eb54363a047b68c03d39f1a', 'request_id': 'req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.098158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] The token cache is being invalidate because project 11abff5a0eb54363a047b68c03d39f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:10:11.098449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.099122 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.100766 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1063/2104] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:10:10 2022] DELETE /identity/v3/projects/11abff5a0eb54363a047b68c03d39f1a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:11.101571 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:11.102924 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:11.146504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-23081117-2c9c-4a42-86c7-a6653f6a6ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943b6ee853b3419d86efb708721cbeb5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.160710 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-23081117-2c9c-4a42-86c7-a6653f6a6ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943b6ee853b3419d86efb708721cbeb5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.164804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99568f0-2c3f-4ad5-a70f-4b1f568317bf admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:11.168698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f45d8-4223-41a8-b4d1-91a4280aa2e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:11.169373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f45d8-4223-41a8-b4d1-91a4280aa2e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:11.169657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f45d8-4223-41a8-b4d1-91a4280aa2e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:11.169931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f45d8-4223-41a8-b4d1-91a4280aa2e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:11.171898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c88f45d8-4223-41a8-b4d1-91a4280aa2e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:11.174213 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1042/2105] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:10:10 2022] DELETE /identity/v3/users/943b6ee853b3419d86efb708721cbeb5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:11.175609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea18a6-7a83-4ac2-ae79-6a407575a0e7 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:11.175901 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea18a6-7a83-4ac2-ae79-6a407575a0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:11.176178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea18a6-7a83-4ac2-ae79-6a407575a0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:11.196494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9dea18a6-7a83-4ac2-ae79-6a407575a0e7 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:11.197750 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9dea18a6-7a83-4ac2-ae79-6a407575a0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:11.250726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f45d8-4223-41a8-b4d1-91a4280aa2e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:11.252339 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f45d8-4223-41a8-b4d1-91a4280aa2e9 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:11.264815 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1064/2106] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:10:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:10:11.282795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1043/2107] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:11.291152 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eca1ab-8d84-40ed-90e5-dfd9bcf4d6f2 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:11.291450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eca1ab-8d84-40ed-90e5-dfd9bcf4d6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:11.291733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eca1ab-8d84-40ed-90e5-dfd9bcf4d6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:11.318715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-78eca1ab-8d84-40ed-90e5-dfd9bcf4d6f2 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:11.320989 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-78eca1ab-8d84-40ed-90e5-dfd9bcf4d6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:11.332890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1065/2108] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:11.338394 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea18a6-7a83-4ac2-ae79-6a407575a0e7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:11.351518 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea18a6-7a83-4ac2-ae79-6a407575a0e7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:11.357314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fff8b-e3f2-4039-a6ea-7716bc4454f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:11.361730 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fff8b-e3f2-4039-a6ea-7716bc4454f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:11.362223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fff8b-e3f2-4039-a6ea-7716bc4454f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:11.362507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fff8b-e3f2-4039-a6ea-7716bc4454f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:11.363257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fff8b-e3f2-4039-a6ea-7716bc4454f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:10:11.363570 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fff8b-e3f2-4039-a6ea-7716bc4454f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:11.365272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fff8b-e3f2-4039-a6ea-7716bc4454f0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:11.379393 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1044/2109] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:10:11.390431 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eca1ab-8d84-40ed-90e5-dfd9bcf4d6f2 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:11.400532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eca1ab-8d84-40ed-90e5-dfd9bcf4d6f2 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:11.406872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59616aca-104c-4319-bbcf-0e2baddb5956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:11.406872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59616aca-104c-4319-bbcf-0e2baddb5956 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:11.406872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59616aca-104c-4319-bbcf-0e2baddb5956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:11.406872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59616aca-104c-4319-bbcf-0e2baddb5956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:11.407420 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59616aca-104c-4319-bbcf-0e2baddb5956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:11.409380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59616aca-104c-4319-bbcf-0e2baddb5956 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:11.471996 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fff8b-e3f2-4039-a6ea-7716bc4454f0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:11.473854 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fd6fff8b-e3f2-4039-a6ea-7716bc4454f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:11.497042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fff8b-e3f2-4039-a6ea-7716bc4454f0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:11.512044 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c8f55-a098-46f4-a7e9-51015f3e3865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:11.512919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8f55-a098-46f4-a7e9-51015f3e3865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:11.513248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8f55-a098-46f4-a7e9-51015f3e3865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:11.513558 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8f55-a098-46f4-a7e9-51015f3e3865 admin admin] PATH_INFO: `/v3/projects/92825d48c6c044b3bad475b05c9d138f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:11.514923 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c8f55-a098-46f4-a7e9-51015f3e3865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92825d48c6c044b3bad475b05c9d138f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:11.517492 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c8f55-a098-46f4-a7e9-51015f3e3865 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:11.519386 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1066/2110] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:10:11 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:10:11.523534 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59616aca-104c-4319-bbcf-0e2baddb5956 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:11.605631 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59616aca-104c-4319-bbcf-0e2baddb5956 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:11.620320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b26c8f55-a098-46f4-a7e9-51015f3e3865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92825d48c6c044b3bad475b05c9d138f', 'request_id': 'req-b26c8f55-a098-46f4-a7e9-51015f3e3865'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.623285 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a89c6b-f1f5-4043-b887-85cb1a5f2ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:11.624185 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a89c6b-f1f5-4043-b887-85cb1a5f2ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:11.624603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a89c6b-f1f5-4043-b887-85cb1a5f2ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:11.625522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a89c6b-f1f5-4043-b887-85cb1a5f2ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:11.626339 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a89c6b-f1f5-4043-b887-85cb1a5f2ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:11.627833 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b26c8f55-a098-46f4-a7e9-51015f3e3865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92825d48c6c044b3bad475b05c9d138f', 'request_id': 'req-b26c8f55-a098-46f4-a7e9-51015f3e3865'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.628585 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a89c6b-f1f5-4043-b887-85cb1a5f2ca7 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:11.633952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b26c8f55-a098-46f4-a7e9-51015f3e3865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92825d48c6c044b3bad475b05c9d138f', 'request_id': 'req-b26c8f55-a098-46f4-a7e9-51015f3e3865'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.728010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b26c8f55-a098-46f4-a7e9-51015f3e3865 admin admin] The token cache is being invalidate because project 92825d48c6c044b3bad475b05c9d138f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:10:11.728305 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b26c8f55-a098-46f4-a7e9-51015f3e3865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.729037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b26c8f55-a098-46f4-a7e9-51015f3e3865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:11.730924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1045/2111] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:10:11 2022] DELETE /identity/v3/projects/92825d48c6c044b3bad475b05c9d138f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:10:11.735780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc615854-43fe-4603-a8d4-8a93d815f747 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:11.736073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc615854-43fe-4603-a8d4-8a93d815f747 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:11.736487 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc615854-43fe-4603-a8d4-8a93d815f747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:11.751099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1067/2112] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:10:11 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:10:11.751099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a89c6b-f1f5-4043-b887-85cb1a5f2ca7 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:11.754085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d5a89c6b-f1f5-4043-b887-85cb1a5f2ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:11.782809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a89c6b-f1f5-4043-b887-85cb1a5f2ca7 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:11.786129 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-bc615854-43fe-4603-a8d4-8a93d815f747 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:11.787392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-bc615854-43fe-4603-a8d4-8a93d815f747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:11.883458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045a1cd-7e28-41f2-88a0-1394ebe53ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:11.888799 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045a1cd-7e28-41f2-88a0-1394ebe53ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:11.888799 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045a1cd-7e28-41f2-88a0-1394ebe53ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:11.888799 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045a1cd-7e28-41f2-88a0-1394ebe53ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:11.888799 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045a1cd-7e28-41f2-88a0-1394ebe53ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:11.888799 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045a1cd-7e28-41f2-88a0-1394ebe53ea5 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:11.898241 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1046/2113] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:10:11.900945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1068/2114] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:10:11.905712 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc615854-43fe-4603-a8d4-8a93d815f747 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:11.906147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c78ac-389b-40ce-aa64-c4f054ea8742 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:11.906446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c78ac-389b-40ce-aa64-c4f054ea8742 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:11.906727 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c78ac-389b-40ce-aa64-c4f054ea8742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:11.918603 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc615854-43fe-4603-a8d4-8a93d815f747 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:11.925284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb44f86-3091-455e-9947-8f61adc338a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:11.926155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb44f86-3091-455e-9947-8f61adc338a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:11.926449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb44f86-3091-455e-9947-8f61adc338a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:11.926813 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb44f86-3091-455e-9947-8f61adc338a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:11.927585 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb44f86-3091-455e-9947-8f61adc338a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:11.948137 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb44f86-3091-455e-9947-8f61adc338a1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:11.948426 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-f69c78ac-389b-40ce-aa64-c4f054ea8742 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:11.948426 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f69c78ac-389b-40ce-aa64-c4f054ea8742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:11.962007 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1047/2115] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:10:11.967444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1069/2116] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:11.969302 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb44f86-3091-455e-9947-8f61adc338a1 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:11.972083 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c78ac-389b-40ce-aa64-c4f054ea8742 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:11.985123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb44f86-3091-455e-9947-8f61adc338a1 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:11.990697 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c37cd-9127-4f23-91e4-22b9855f3e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:11.992096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c37cd-9127-4f23-91e4-22b9855f3e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:11.992377 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c37cd-9127-4f23-91e4-22b9855f3e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:11.992657 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c37cd-9127-4f23-91e4-22b9855f3e06 admin admin] PATH_INFO: `/v3/projects/e8a70e51069e48d4bd49403c898e8c42/users/04b1fd04b5ff4da59ce51f6ee7726a2f/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:11.993082 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c78ac-389b-40ce-aa64-c4f054ea8742 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:12.005369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8786c-91b0-4625-aec4-27f8fa8b0125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:12.005369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8786c-91b0-4625-aec4-27f8fa8b0125 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:12.005369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8786c-91b0-4625-aec4-27f8fa8b0125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:12.005369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8786c-91b0-4625-aec4-27f8fa8b0125 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:12.005682 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8786c-91b0-4625-aec4-27f8fa8b0125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:10:12.005752 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8786c-91b0-4625-aec4-27f8fa8b0125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:12.007997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8786c-91b0-4625-aec4-27f8fa8b0125 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:12.014930 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c37cd-9127-4f23-91e4-22b9855f3e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a70e51069e48d4bd49403c898e8c42, user_id=04b1fd04b5ff4da59ce51f6ee7726a2f, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:12.020148 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1070/2117] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:10:12.024353 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8786c-91b0-4625-aec4-27f8fa8b0125 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:12.028416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c37cd-9127-4f23-91e4-22b9855f3e06 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:12.034578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8786c-91b0-4625-aec4-27f8fa8b0125 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:12.040087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f8501-5ead-47e5-b48f-fd8bca2cef3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:12.040726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f8501-5ead-47e5-b48f-fd8bca2cef3a admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:12.041009 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f8501-5ead-47e5-b48f-fd8bca2cef3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:12.041402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f8501-5ead-47e5-b48f-fd8bca2cef3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:12.042031 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f8501-5ead-47e5-b48f-fd8bca2cef3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:12.043963 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f8501-5ead-47e5-b48f-fd8bca2cef3a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:12.110986 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1048/2118] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:10:11 2022] PUT /identity/v3/projects/e8a70e51069e48d4bd49403c898e8c42/users/04b1fd04b5ff4da59ce51f6ee7726a2f/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:12.129499 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23bcf1-2378-4e2c-8610-86f1c515bce6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:12.129813 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23bcf1-2378-4e2c-8610-86f1c515bce6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:12.130135 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23bcf1-2378-4e2c-8610-86f1c515bce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:12.146901 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1071/2119] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:10:12 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:10:12.152743 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f8501-5ead-47e5-b48f-fd8bca2cef3a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:12.161256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2a23bcf1-2378-4e2c-8610-86f1c515bce6 None None] MFA Rules not processed for user `04b1fd04b5ff4da59ce51f6ee7726a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:12.162598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2a23bcf1-2378-4e2c-8610-86f1c515bce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:12.240345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f8501-5ead-47e5-b48f-fd8bca2cef3a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:12.246129 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac189ca3-fa70-4253-9d69-f5ce8d9b0a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:12.246844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac189ca3-fa70-4253-9d69-f5ce8d9b0a81 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:12.247228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac189ca3-fa70-4253-9d69-f5ce8d9b0a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:12.247612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac189ca3-fa70-4253-9d69-f5ce8d9b0a81 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:12.247720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1049/2120] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:10:12.249765 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac189ca3-fa70-4253-9d69-f5ce8d9b0a81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:12.251838 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac189ca3-fa70-4253-9d69-f5ce8d9b0a81 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:12.258275 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23bcf1-2378-4e2c-8610-86f1c515bce6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:12.260928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2a23bcf1-2378-4e2c-8610-86f1c515bce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:12.316824 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23bcf1-2378-4e2c-8610-86f1c515bce6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:12.320581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0322a91-063b-4964-9510-6af0e5761b76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42cd381cf5c745de9dac8f77a8cea554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:12.321249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322a91-063b-4964-9510-6af0e5761b76 service glance] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:12.321533 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322a91-063b-4964-9510-6af0e5761b76 service glance] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:12.321806 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322a91-063b-4964-9510-6af0e5761b76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:12.330279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0322a91-063b-4964-9510-6af0e5761b76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:12.331814 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0322a91-063b-4964-9510-6af0e5761b76 service glance] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:12.347243 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1050/2121] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:10:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:10:12.369018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1072/2122] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:10:12 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:10:12.373409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0322a91-063b-4964-9510-6af0e5761b76 service glance] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:12.384284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0322a91-063b-4964-9510-6af0e5761b76 service glance] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:12.388994 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a18f5-2049-4f4c-bf09-63de5dce1c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:12.389778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a18f5-2049-4f4c-bf09-63de5dce1c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:12.389947 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a18f5-2049-4f4c-bf09-63de5dce1c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:12.390195 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a18f5-2049-4f4c-bf09-63de5dce1c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:12.390913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a18f5-2049-4f4c-bf09-63de5dce1c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:12.392542 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a18f5-2049-4f4c-bf09-63de5dce1c9a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:12.405475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1051/2123] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:10:12.406859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac189ca3-fa70-4253-9d69-f5ce8d9b0a81 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:12.417410 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac189ca3-fa70-4253-9d69-f5ce8d9b0a81 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:12.422397 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70f95b-0233-4ebc-98b8-f185a676d70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:12.423311 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70f95b-0233-4ebc-98b8-f185a676d70c admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:12.423721 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70f95b-0233-4ebc-98b8-f185a676d70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:12.423997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70f95b-0233-4ebc-98b8-f185a676d70c admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:12.424721 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70f95b-0233-4ebc-98b8-f185a676d70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:12.426360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70f95b-0233-4ebc-98b8-f185a676d70c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:12.440847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1073/2124] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:10:12.442588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a18f5-2049-4f4c-bf09-63de5dce1c9a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:12.452972 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a18f5-2049-4f4c-bf09-63de5dce1c9a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:12.457971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ced57a-a31e-474c-92ca-0f6204c62942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:12.458850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced57a-a31e-474c-92ca-0f6204c62942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:12.459130 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced57a-a31e-474c-92ca-0f6204c62942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:12.459401 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced57a-a31e-474c-92ca-0f6204c62942 admin admin] PATH_INFO: `/v3/projects/866279fd7e7342ada14b63bbbd3d64be/users/e9f1dd7aa9bc47f59656d326eb6cc751/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:12.474877 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ced57a-a31e-474c-92ca-0f6204c62942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866279fd7e7342ada14b63bbbd3d64be, user_id=e9f1dd7aa9bc47f59656d326eb6cc751, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:12.480735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ced57a-a31e-474c-92ca-0f6204c62942 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:12.568011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1052/2125] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:10:12 2022] PUT /identity/v3/projects/866279fd7e7342ada14b63bbbd3d64be/users/e9f1dd7aa9bc47f59656d326eb6cc751/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:12.578795 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf7e5a-7d5d-4718-aa9a-97c9f06860d3 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:12.579085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf7e5a-7d5d-4718-aa9a-97c9f06860d3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:12.579361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf7e5a-7d5d-4718-aa9a-97c9f06860d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:12.597615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a9bf7e5a-7d5d-4718-aa9a-97c9f06860d3 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:12.598821 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a9bf7e5a-7d5d-4718-aa9a-97c9f06860d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:12.656452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1074/2126] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:12.666686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ced57a-a31e-474c-92ca-0f6204c62942 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:12.668425 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-25ced57a-a31e-474c-92ca-0f6204c62942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:12.723562 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ced57a-a31e-474c-92ca-0f6204c62942 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:12.727886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b97be-645b-4122-9774-5bcc11c3f236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:12.728527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b97be-645b-4122-9774-5bcc11c3f236 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:12.728812 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b97be-645b-4122-9774-5bcc11c3f236 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:12.729114 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b97be-645b-4122-9774-5bcc11c3f236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:12.738175 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b97be-645b-4122-9774-5bcc11c3f236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:12.739645 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b97be-645b-4122-9774-5bcc11c3f236 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:12.749032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1053/2127] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:10:18.222233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a238fb7-c3f4-4220-8637-284b9aefd543 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:18.222806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a238fb7-c3f4-4220-8637-284b9aefd543 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:18.223612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a238fb7-c3f4-4220-8637-284b9aefd543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:18.258948 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0a238fb7-c3f4-4220-8637-284b9aefd543 None None] MFA Rules not processed for user `e9f1dd7aa9bc47f59656d326eb6cc751`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:18.260169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0a238fb7-c3f4-4220-8637-284b9aefd543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:18.334378 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1075/2128] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:18.346493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b97be-645b-4122-9774-5bcc11c3f236 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:18.348027 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-359b97be-645b-4122-9774-5bcc11c3f236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:18.424408 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b97be-645b-4122-9774-5bcc11c3f236 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:18.430314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552c5ed-ae30-4f7c-8ee4-5b1b246933fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:18.430964 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552c5ed-ae30-4f7c-8ee4-5b1b246933fa service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:18.431244 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552c5ed-ae30-4f7c-8ee4-5b1b246933fa service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:18.431518 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552c5ed-ae30-4f7c-8ee4-5b1b246933fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:18.440029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552c5ed-ae30-4f7c-8ee4-5b1b246933fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:18.441698 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552c5ed-ae30-4f7c-8ee4-5b1b246933fa service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:18.452146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1054/2129] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:10:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:10:20.912262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d31c75-fe1d-4e93-bbb2-07b288719f45 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:20.912767 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d31c75-fe1d-4e93-bbb2-07b288719f45 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:20.913510 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d31c75-fe1d-4e93-bbb2-07b288719f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:20.935441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-41d31c75-fe1d-4e93-bbb2-07b288719f45 None None] MFA Rules not processed for user `e9f1dd7aa9bc47f59656d326eb6cc751`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:20.935441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-41d31c75-fe1d-4e93-bbb2-07b288719f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:20.947416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1076/2130] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:24.122077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552c5ed-ae30-4f7c-8ee4-5b1b246933fa service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:24.123427 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6552c5ed-ae30-4f7c-8ee4-5b1b246933fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:24.138662 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552c5ed-ae30-4f7c-8ee4-5b1b246933fa service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:24.143486 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbc79d-887f-4fa6-993b-40d2e5e5b32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:24.144348 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbc79d-887f-4fa6-993b-40d2e5e5b32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:24.144629 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbc79d-887f-4fa6-993b-40d2e5e5b32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:24.144906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbc79d-887f-4fa6-993b-40d2e5e5b32c admin admin] PATH_INFO: `/v3/users/af03bebc4dec402fa6fac887bd5b27b7` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:24.146109 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbc79d-887f-4fa6-993b-40d2e5e5b32c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af03bebc4dec402fa6fac887bd5b27b7)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:24.148640 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbc79d-887f-4fa6-993b-40d2e5e5b32c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:24.307811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-49cbc79d-887f-4fa6-993b-40d2e5e5b32c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af03bebc4dec402fa6fac887bd5b27b7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:24.308709 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-49cbc79d-887f-4fa6-993b-40d2e5e5b32c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af03bebc4dec402fa6fac887bd5b27b7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:24.309417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-49cbc79d-887f-4fa6-993b-40d2e5e5b32c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af03bebc4dec402fa6fac887bd5b27b7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:24.475679 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-49cbc79d-887f-4fa6-993b-40d2e5e5b32c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af03bebc4dec402fa6fac887bd5b27b7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:24.488893 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-49cbc79d-887f-4fa6-993b-40d2e5e5b32c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af03bebc4dec402fa6fac887bd5b27b7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:24.502034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1055/2131] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:10:24 2022] DELETE /identity/v3/users/af03bebc4dec402fa6fac887bd5b27b7 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:24.507793 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20176d-7952-4898-9ec1-67f34c52b751 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:24.507793 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20176d-7952-4898-9ec1-67f34c52b751 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:24.508274 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20176d-7952-4898-9ec1-67f34c52b751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:24.526752 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-ae20176d-7952-4898-9ec1-67f34c52b751 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:24.528255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ae20176d-7952-4898-9ec1-67f34c52b751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:24.598481 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1077/2132] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:24.601677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbc79d-887f-4fa6-993b-40d2e5e5b32c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:24.603078 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-49cbc79d-887f-4fa6-993b-40d2e5e5b32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:24.673246 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbc79d-887f-4fa6-993b-40d2e5e5b32c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:24.680481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e35818-219f-4def-9ee4-5f6fce4e5a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:24.681236 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e35818-219f-4def-9ee4-5f6fce4e5a2c service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:24.681680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e35818-219f-4def-9ee4-5f6fce4e5a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:24.681966 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e35818-219f-4def-9ee4-5f6fce4e5a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:24.692781 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e35818-219f-4def-9ee4-5f6fce4e5a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:24.695073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e35818-219f-4def-9ee4-5f6fce4e5a2c service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:24.705695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1056/2133] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:10:24.959717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20176d-7952-4898-9ec1-67f34c52b751 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:24.967184 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ae20176d-7952-4898-9ec1-67f34c52b751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:25.000006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20176d-7952-4898-9ec1-67f34c52b751 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:25.010367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:25.011425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:25.011810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:25.012274 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6 admin admin] PATH_INFO: `/v3/projects/132785353bff4202a8cfa0544ed715d6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:25.013631 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=132785353bff4202a8cfa0544ed715d6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:25.017260 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:25.175212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132785353bff4202a8cfa0544ed715d6', 'request_id': 'req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:25.276696 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132785353bff4202a8cfa0544ed715d6', 'request_id': 'req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:25.284020 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132785353bff4202a8cfa0544ed715d6', 'request_id': 'req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:25.304227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6 admin admin] The token cache is being invalidate because project 132785353bff4202a8cfa0544ed715d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:10:25.304519 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:25.305239 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f1ed6adf-ec6a-4117-a416-8dc0797a03a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:25.308007 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1078/2134] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:10:24 2022] DELETE /identity/v3/projects/132785353bff4202a8cfa0544ed715d6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:33.567540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e35818-219f-4def-9ee4-5f6fce4e5a2c service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:33.568962 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-84e35818-219f-4def-9ee4-5f6fce4e5a2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:33.581919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e35818-219f-4def-9ee4-5f6fce4e5a2c service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:33.640498 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401c07b-09ab-4b83-a7ad-374fab69dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:33.641430 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401c07b-09ab-4b83-a7ad-374fab69dbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:33.641741 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401c07b-09ab-4b83-a7ad-374fab69dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:33.642012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401c07b-09ab-4b83-a7ad-374fab69dbeb admin admin] PATH_INFO: `/v3/users/b7ae72d145a7437fa7ffd7d25c06b6e5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:33.643201 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401c07b-09ab-4b83-a7ad-374fab69dbeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ae72d145a7437fa7ffd7d25c06b6e5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:33.645247 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401c07b-09ab-4b83-a7ad-374fab69dbeb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:33.799105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2401c07b-09ab-4b83-a7ad-374fab69dbeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ae72d145a7437fa7ffd7d25c06b6e5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:33.799781 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2401c07b-09ab-4b83-a7ad-374fab69dbeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ae72d145a7437fa7ffd7d25c06b6e5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:33.800373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2401c07b-09ab-4b83-a7ad-374fab69dbeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ae72d145a7437fa7ffd7d25c06b6e5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:33.847033 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2401c07b-09ab-4b83-a7ad-374fab69dbeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ae72d145a7437fa7ffd7d25c06b6e5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:33.858979 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2401c07b-09ab-4b83-a7ad-374fab69dbeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ae72d145a7437fa7ffd7d25c06b6e5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:33.871734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1057/2135] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:10:33 2022] DELETE /identity/v3/users/b7ae72d145a7437fa7ffd7d25c06b6e5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:33.876452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c13d-0145-4e4f-a212-bf7dcb30b4a6 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:33.876933 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c13d-0145-4e4f-a212-bf7dcb30b4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:33.877132 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c13d-0145-4e4f-a212-bf7dcb30b4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:33.895784 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-8547c13d-0145-4e4f-a212-bf7dcb30b4a6 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:33.897003 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8547c13d-0145-4e4f-a212-bf7dcb30b4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:33.965535 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1079/2136] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:33.975175 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401c07b-09ab-4b83-a7ad-374fab69dbeb admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:33.977214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2401c07b-09ab-4b83-a7ad-374fab69dbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:34.049194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401c07b-09ab-4b83-a7ad-374fab69dbeb admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:34.060027 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f194e-ce8e-4fb9-a445-129acf56b67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:34.061761 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f194e-ce8e-4fb9-a445-129acf56b67d service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:34.067233 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f194e-ce8e-4fb9-a445-129acf56b67d service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:34.067233 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f194e-ce8e-4fb9-a445-129acf56b67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:34.073875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f194e-ce8e-4fb9-a445-129acf56b67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:34.076101 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f194e-ce8e-4fb9-a445-129acf56b67d service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:34.087810 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1058/2137] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:10:34.547270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547c13d-0145-4e4f-a212-bf7dcb30b4a6 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:34.549263 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8547c13d-0145-4e4f-a212-bf7dcb30b4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:34.562316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547c13d-0145-4e4f-a212-bf7dcb30b4a6 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:34.568014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bae667-76c7-4f8f-bf94-3abe9044ec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:34.578380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae667-76c7-4f8f-bf94-3abe9044ec03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:34.578380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae667-76c7-4f8f-bf94-3abe9044ec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:34.578380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae667-76c7-4f8f-bf94-3abe9044ec03 admin admin] PATH_INFO: `/v3/projects/d3ce1c3afe244184898cd4d28a766de7` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:34.578380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bae667-76c7-4f8f-bf94-3abe9044ec03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ce1c3afe244184898cd4d28a766de7)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:34.578380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bae667-76c7-4f8f-bf94-3abe9044ec03 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:34.687739 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d4bae667-76c7-4f8f-bf94-3abe9044ec03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ce1c3afe244184898cd4d28a766de7', 'request_id': 'req-d4bae667-76c7-4f8f-bf94-3abe9044ec03'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:34.749835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d4bae667-76c7-4f8f-bf94-3abe9044ec03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ce1c3afe244184898cd4d28a766de7', 'request_id': 'req-d4bae667-76c7-4f8f-bf94-3abe9044ec03'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:34.756809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d4bae667-76c7-4f8f-bf94-3abe9044ec03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ce1c3afe244184898cd4d28a766de7', 'request_id': 'req-d4bae667-76c7-4f8f-bf94-3abe9044ec03'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:34.767574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d4bae667-76c7-4f8f-bf94-3abe9044ec03 admin admin] The token cache is being invalidate because project d3ce1c3afe244184898cd4d28a766de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:10:34.767861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d4bae667-76c7-4f8f-bf94-3abe9044ec03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:34.769441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d4bae667-76c7-4f8f-bf94-3abe9044ec03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:34.770384 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1080/2138] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:10:34 2022] DELETE /identity/v3/projects/d3ce1c3afe244184898cd4d28a766de7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:46.889964 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f194e-ce8e-4fb9-a445-129acf56b67d service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:46.891433 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5e0f194e-ce8e-4fb9-a445-129acf56b67d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:46.905300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f194e-ce8e-4fb9-a445-129acf56b67d service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:46.971057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6902-4392-4665-8905-8947fcd8a5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:46.971940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6902-4392-4665-8905-8947fcd8a5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:46.972220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6902-4392-4665-8905-8947fcd8a5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:46.972524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6902-4392-4665-8905-8947fcd8a5ec admin admin] PATH_INFO: `/v3/users/7894d1cbe73f43189e6d67ada67a9094` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:46.973756 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be6902-4392-4665-8905-8947fcd8a5ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7894d1cbe73f43189e6d67ada67a9094)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:46.975792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be6902-4392-4665-8905-8947fcd8a5ec admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:47.165260 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-94be6902-4392-4665-8905-8947fcd8a5ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7894d1cbe73f43189e6d67ada67a9094'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:47.165931 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-94be6902-4392-4665-8905-8947fcd8a5ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7894d1cbe73f43189e6d67ada67a9094'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:47.166531 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-94be6902-4392-4665-8905-8947fcd8a5ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7894d1cbe73f43189e6d67ada67a9094'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:47.223884 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-94be6902-4392-4665-8905-8947fcd8a5ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7894d1cbe73f43189e6d67ada67a9094'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:47.236234 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-94be6902-4392-4665-8905-8947fcd8a5ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7894d1cbe73f43189e6d67ada67a9094'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:47.248972 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1059/2139] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:10:46 2022] DELETE /identity/v3/users/7894d1cbe73f43189e6d67ada67a9094 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:47.254796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47612c3f-ed16-4393-9b06-3ab9edc201ce None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:47.255290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47612c3f-ed16-4393-9b06-3ab9edc201ce None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:47.255379 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47612c3f-ed16-4393-9b06-3ab9edc201ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:47.277361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-47612c3f-ed16-4393-9b06-3ab9edc201ce None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:47.278564 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-47612c3f-ed16-4393-9b06-3ab9edc201ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:47.336432 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1081/2140] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:47.346293 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6902-4392-4665-8905-8947fcd8a5ec admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:47.347783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-94be6902-4392-4665-8905-8947fcd8a5ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:47.405566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6902-4392-4665-8905-8947fcd8a5ec admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:47.409166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd69eaa-0e89-4f39-a69c-e6ca0e69a9de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:47.409804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd69eaa-0e89-4f39-a69c-e6ca0e69a9de service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:47.410084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd69eaa-0e89-4f39-a69c-e6ca0e69a9de service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:47.410356 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd69eaa-0e89-4f39-a69c-e6ca0e69a9de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:47.419749 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd69eaa-0e89-4f39-a69c-e6ca0e69a9de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:47.421257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd69eaa-0e89-4f39-a69c-e6ca0e69a9de service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:47.431494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1060/2141] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:10:47.768117 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47612c3f-ed16-4393-9b06-3ab9edc201ce None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:47.769661 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-47612c3f-ed16-4393-9b06-3ab9edc201ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:47.785468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47612c3f-ed16-4393-9b06-3ab9edc201ce None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:47.791445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:47.792599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:47.792775 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:47.793138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] PATH_INFO: `/v3/projects/8b53550b1305425ca539afb1a0ebc2de` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:47.794346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b53550b1305425ca539afb1a0ebc2de)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:47.796282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:47.891624 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b53550b1305425ca539afb1a0ebc2de', 'request_id': 'req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:47.942931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b53550b1305425ca539afb1a0ebc2de', 'request_id': 'req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:47.949174 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b53550b1305425ca539afb1a0ebc2de', 'request_id': 'req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:47.959331 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] The token cache is being invalidate because project 8b53550b1305425ca539afb1a0ebc2de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:10:47.959621 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:47.960261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:47.962367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1082/2142] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:10:47 2022] DELETE /identity/v3/projects/8b53550b1305425ca539afb1a0ebc2de => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:47.966307 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd69eaa-0e89-4f39-a69c-e6ca0e69a9de service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:47.975886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd69eaa-0e89-4f39-a69c-e6ca0e69a9de service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:48.030044 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae4b20-1b65-42d4-9788-bb2573b16517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:48.030929 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4b20-1b65-42d4-9788-bb2573b16517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:48.031207 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4b20-1b65-42d4-9788-bb2573b16517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:48.031482 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4b20-1b65-42d4-9788-bb2573b16517 admin admin] PATH_INFO: `/v3/users/47ef62c29fbc46aeb88cf59913c0822f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:48.032731 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae4b20-1b65-42d4-9788-bb2573b16517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ef62c29fbc46aeb88cf59913c0822f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:48.034726 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae4b20-1b65-42d4-9788-bb2573b16517 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:48.190310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c5ae4b20-1b65-42d4-9788-bb2573b16517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ef62c29fbc46aeb88cf59913c0822f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:48.190888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c5ae4b20-1b65-42d4-9788-bb2573b16517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ef62c29fbc46aeb88cf59913c0822f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:48.191494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c5ae4b20-1b65-42d4-9788-bb2573b16517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ef62c29fbc46aeb88cf59913c0822f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:48.269860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c5ae4b20-1b65-42d4-9788-bb2573b16517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ef62c29fbc46aeb88cf59913c0822f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:48.282518 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c5ae4b20-1b65-42d4-9788-bb2573b16517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ef62c29fbc46aeb88cf59913c0822f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:48.294223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1061/2143] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:10:47 2022] DELETE /identity/v3/users/47ef62c29fbc46aeb88cf59913c0822f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:48.671034 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:48.673274 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:48.687132 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e171e2-a8fc-4734-8c43-d4d3c58a6a1c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:48.744642 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e6023-17b7-4c41-b965-463c7971f729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:48.745539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e6023-17b7-4c41-b965-463c7971f729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:48.745820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e6023-17b7-4c41-b965-463c7971f729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:48.746092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e6023-17b7-4c41-b965-463c7971f729 admin admin] PATH_INFO: `/v3/projects/01bdc3ebf72c4894b664ae3f90b09cc2` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:48.747266 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e6023-17b7-4c41-b965-463c7971f729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01bdc3ebf72c4894b664ae3f90b09cc2)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:48.749188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e6023-17b7-4c41-b965-463c7971f729 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:48.828878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3a2e6023-17b7-4c41-b965-463c7971f729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bdc3ebf72c4894b664ae3f90b09cc2', 'request_id': 'req-3a2e6023-17b7-4c41-b965-463c7971f729'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:48.874902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3a2e6023-17b7-4c41-b965-463c7971f729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bdc3ebf72c4894b664ae3f90b09cc2', 'request_id': 'req-3a2e6023-17b7-4c41-b965-463c7971f729'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:48.880962 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3a2e6023-17b7-4c41-b965-463c7971f729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bdc3ebf72c4894b664ae3f90b09cc2', 'request_id': 'req-3a2e6023-17b7-4c41-b965-463c7971f729'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:48.891847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3a2e6023-17b7-4c41-b965-463c7971f729 admin admin] The token cache is being invalidate because project 01bdc3ebf72c4894b664ae3f90b09cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:10:48.892136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3a2e6023-17b7-4c41-b965-463c7971f729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:48.892792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3a2e6023-17b7-4c41-b965-463c7971f729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:10:48.894477 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1083/2144] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:10:48 2022] DELETE /identity/v3/projects/01bdc3ebf72c4894b664ae3f90b09cc2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:48.899333 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939db8-f02f-4ff8-8b2c-c5370e4b2f34 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:48.899626 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939db8-f02f-4ff8-8b2c-c5370e4b2f34 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:48.899909 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939db8-f02f-4ff8-8b2c-c5370e4b2f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:48.927840 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-02939db8-f02f-4ff8-8b2c-c5370e4b2f34 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:48.929034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-02939db8-f02f-4ff8-8b2c-c5370e4b2f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:48.984745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1062/2145] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:48.993349 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7bdd7-061c-4a12-ac02-823fca64a2ed None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:48.993624 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7bdd7-061c-4a12-ac02-823fca64a2ed None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:48.993897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7bdd7-061c-4a12-ac02-823fca64a2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:49.011740 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e0b7bdd7-061c-4a12-ac02-823fca64a2ed None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:49.012922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e0b7bdd7-061c-4a12-ac02-823fca64a2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:49.020825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1084/2146] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:49.024759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02939db8-f02f-4ff8-8b2c-c5370e4b2f34 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:49.034309 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02939db8-f02f-4ff8-8b2c-c5370e4b2f34 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:49.039360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01a80c-de29-416d-bb5e-ea94c7aa269b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:49.040008 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01a80c-de29-416d-bb5e-ea94c7aa269b admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:49.040289 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01a80c-de29-416d-bb5e-ea94c7aa269b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:49.040567 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01a80c-de29-416d-bb5e-ea94c7aa269b admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:49.042399 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01a80c-de29-416d-bb5e-ea94c7aa269b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:10:49.042399 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01a80c-de29-416d-bb5e-ea94c7aa269b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:49.043296 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01a80c-de29-416d-bb5e-ea94c7aa269b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:49.055354 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1063/2147] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:10:49.059550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7bdd7-061c-4a12-ac02-823fca64a2ed None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:49.068552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7bdd7-061c-4a12-ac02-823fca64a2ed None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:49.074137 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dc77b-4804-4856-be29-3ad08be1d832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:49.074790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dc77b-4804-4856-be29-3ad08be1d832 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:49.075075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dc77b-4804-4856-be29-3ad08be1d832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:49.075348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dc77b-4804-4856-be29-3ad08be1d832 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:49.076246 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dc77b-4804-4856-be29-3ad08be1d832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:49.078721 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dc77b-4804-4856-be29-3ad08be1d832 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:49.159786 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1085/2148] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:10:49 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:10:49.161082 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01a80c-de29-416d-bb5e-ea94c7aa269b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:49.171905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01a80c-de29-416d-bb5e-ea94c7aa269b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:49.228224 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7e95e-6f44-4666-b456-501241ce23c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:49.228933 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7e95e-6f44-4666-b456-501241ce23c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:49.229248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7e95e-6f44-4666-b456-501241ce23c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:49.229528 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7e95e-6f44-4666-b456-501241ce23c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:49.230247 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7e95e-6f44-4666-b456-501241ce23c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:49.232254 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7e95e-6f44-4666-b456-501241ce23c6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:49.332518 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1064/2149] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:10:49 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:10:49.337223 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dc77b-4804-4856-be29-3ad08be1d832 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:49.347393 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dc77b-4804-4856-be29-3ad08be1d832 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:49.352550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f9f0d-7b2b-4447-8cfe-e4f38d9bc0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:49.353246 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f9f0d-7b2b-4447-8cfe-e4f38d9bc0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:49.353569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f9f0d-7b2b-4447-8cfe-e4f38d9bc0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:49.353844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f9f0d-7b2b-4447-8cfe-e4f38d9bc0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:49.354565 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f9f0d-7b2b-4447-8cfe-e4f38d9bc0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:49.356189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f9f0d-7b2b-4447-8cfe-e4f38d9bc0a5 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:49.366193 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1086/2150] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:10:49.370019 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7e95e-6f44-4666-b456-501241ce23c6 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:49.379867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7e95e-6f44-4666-b456-501241ce23c6 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:49.384633 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060983cd-4cf9-453d-9f62-ba9e4291d256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:49.385324 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060983cd-4cf9-453d-9f62-ba9e4291d256 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:49.385607 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060983cd-4cf9-453d-9f62-ba9e4291d256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:49.385886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060983cd-4cf9-453d-9f62-ba9e4291d256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:49.386600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060983cd-4cf9-453d-9f62-ba9e4291d256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:49.388308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060983cd-4cf9-453d-9f62-ba9e4291d256 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:49.398062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1065/2151] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:10:49.402451 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f9f0d-7b2b-4447-8cfe-e4f38d9bc0a5 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:49.412020 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f9f0d-7b2b-4447-8cfe-e4f38d9bc0a5 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:49.417346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c57d07-ed6d-44ac-a07a-da0f2609b0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:49.418207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c57d07-ed6d-44ac-a07a-da0f2609b0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:49.418488 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c57d07-ed6d-44ac-a07a-da0f2609b0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:49.418767 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c57d07-ed6d-44ac-a07a-da0f2609b0f8 admin admin] PATH_INFO: `/v3/projects/62eff4cea4114bb398eaabde1a67b664/users/f72d09a184ad498b8358a7a2edb2ff12/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:49.432977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c57d07-ed6d-44ac-a07a-da0f2609b0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62eff4cea4114bb398eaabde1a67b664, user_id=f72d09a184ad498b8358a7a2edb2ff12, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:49.435617 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c57d07-ed6d-44ac-a07a-da0f2609b0f8 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:49.532426 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1087/2152] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:10:49 2022] PUT /identity/v3/projects/62eff4cea4114bb398eaabde1a67b664/users/f72d09a184ad498b8358a7a2edb2ff12/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:49.544141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9280087-e892-44ab-8d33-57ebc3f19844 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:49.544435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9280087-e892-44ab-8d33-57ebc3f19844 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:49.544745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9280087-e892-44ab-8d33-57ebc3f19844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:49.570577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b9280087-e892-44ab-8d33-57ebc3f19844 None None] MFA Rules not processed for user `f72d09a184ad498b8358a7a2edb2ff12`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:49.571828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b9280087-e892-44ab-8d33-57ebc3f19844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:49.632231 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1066/2153] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:49.637090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c57d07-ed6d-44ac-a07a-da0f2609b0f8 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:49.697358 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c57d07-ed6d-44ac-a07a-da0f2609b0f8 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:49.702065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19979d-ea1b-490d-8569-b72b91c44ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:49.702760 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19979d-ea1b-490d-8569-b72b91c44ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:49.703045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19979d-ea1b-490d-8569-b72b91c44ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:49.703328 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19979d-ea1b-490d-8569-b72b91c44ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:49.704037 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19979d-ea1b-490d-8569-b72b91c44ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:49.705999 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19979d-ea1b-490d-8569-b72b91c44ab4 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:49.791812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1088/2154] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:10:49 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:10:49.795775 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9280087-e892-44ab-8d33-57ebc3f19844 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:49.806988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9280087-e892-44ab-8d33-57ebc3f19844 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:49.862686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91987e32-ac55-489b-8b92-dc4101556bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:49.863359 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91987e32-ac55-489b-8b92-dc4101556bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:49.863682 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91987e32-ac55-489b-8b92-dc4101556bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:49.863902 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91987e32-ac55-489b-8b92-dc4101556bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:49.864594 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91987e32-ac55-489b-8b92-dc4101556bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:49.866584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91987e32-ac55-489b-8b92-dc4101556bd8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:49.933073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1067/2155] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:10:49 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:10:49.937036 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19979d-ea1b-490d-8569-b72b91c44ab4 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:49.948592 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19979d-ea1b-490d-8569-b72b91c44ab4 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:49.953321 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44498359-aa90-4d44-910b-06923a75e376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:49.953984 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44498359-aa90-4d44-910b-06923a75e376 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:49.968199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44498359-aa90-4d44-910b-06923a75e376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:49.968199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44498359-aa90-4d44-910b-06923a75e376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:49.968199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44498359-aa90-4d44-910b-06923a75e376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:49.968199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44498359-aa90-4d44-910b-06923a75e376 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:49.968199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1089/2156] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:10:49.971859 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91987e32-ac55-489b-8b92-dc4101556bd8 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:49.981795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91987e32-ac55-489b-8b92-dc4101556bd8 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:49.986434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96406a46-50c7-4929-b616-85f8b2f03c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:49.987301 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96406a46-50c7-4929-b616-85f8b2f03c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:49.987582 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96406a46-50c7-4929-b616-85f8b2f03c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:49.987878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96406a46-50c7-4929-b616-85f8b2f03c69 admin admin] PATH_INFO: `/v3/projects/a3aedf0eba8d457889d8650412c9b205/users/e8ac11d22f0e4be19d21982c24749993/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:50.003541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96406a46-50c7-4929-b616-85f8b2f03c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3aedf0eba8d457889d8650412c9b205, user_id=e8ac11d22f0e4be19d21982c24749993, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:50.006266 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96406a46-50c7-4929-b616-85f8b2f03c69 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:50.063670 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1068/2157] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:10:49 2022] PUT /identity/v3/projects/a3aedf0eba8d457889d8650412c9b205/users/e8ac11d22f0e4be19d21982c24749993/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:10:50.067513 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44498359-aa90-4d44-910b-06923a75e376 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:50.078167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44498359-aa90-4d44-910b-06923a75e376 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:50.131517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09ff05-7a3a-4a2a-b430-53b936cf01da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:50.132175 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09ff05-7a3a-4a2a-b430-53b936cf01da admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:50.132457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09ff05-7a3a-4a2a-b430-53b936cf01da admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:50.133395 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09ff05-7a3a-4a2a-b430-53b936cf01da admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:50.134115 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09ff05-7a3a-4a2a-b430-53b936cf01da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:50.135699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09ff05-7a3a-4a2a-b430-53b936cf01da admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:50.145128 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1090/2158] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:10:50.149378 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96406a46-50c7-4929-b616-85f8b2f03c69 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:50.159797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96406a46-50c7-4929-b616-85f8b2f03c69 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:50.164441 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6072a-eb1b-4ddd-9964-32a8d5493fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:50.165344 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6072a-eb1b-4ddd-9964-32a8d5493fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:50.165630 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6072a-eb1b-4ddd-9964-32a8d5493fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:50.165909 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6072a-eb1b-4ddd-9964-32a8d5493fcd admin admin] PATH_INFO: `/v3/projects/a3aedf0eba8d457889d8650412c9b205/users/e8ac11d22f0e4be19d21982c24749993/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:50.167872 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6072a-eb1b-4ddd-9964-32a8d5493fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3aedf0eba8d457889d8650412c9b205, user_id=e8ac11d22f0e4be19d21982c24749993, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:50.170602 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6072a-eb1b-4ddd-9964-32a8d5493fcd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:50.181376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1069/2159] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:10:50 2022] PUT /identity/v3/projects/a3aedf0eba8d457889d8650412c9b205/users/e8ac11d22f0e4be19d21982c24749993/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:10:50.191312 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e93a28-8de1-4128-ba5b-0985e2f85a63 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:50.191606 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e93a28-8de1-4128-ba5b-0985e2f85a63 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:50.191885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e93a28-8de1-4128-ba5b-0985e2f85a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:50.217508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c7e93a28-8de1-4128-ba5b-0985e2f85a63 None None] MFA Rules not processed for user `e8ac11d22f0e4be19d21982c24749993`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:10:50.218707 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c7e93a28-8de1-4128-ba5b-0985e2f85a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:50.282655 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1091/2160] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:10:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:10:50.293547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6072a-eb1b-4ddd-9964-32a8d5493fcd admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:50.295349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-85a6072a-eb1b-4ddd-9964-32a8d5493fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:50.373573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6072a-eb1b-4ddd-9964-32a8d5493fcd admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:50.377213 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe98e6-3ef4-4ea4-a858-76499e57a1cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:50.377915 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe98e6-3ef4-4ea4-a858-76499e57a1cf service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:50.378199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe98e6-3ef4-4ea4-a858-76499e57a1cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:50.378476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe98e6-3ef4-4ea4-a858-76499e57a1cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:50.434066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe98e6-3ef4-4ea4-a858-76499e57a1cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:50.435565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe98e6-3ef4-4ea4-a858-76499e57a1cf service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:50.444998 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1070/2161] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:10:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:10:59.736023 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e93a28-8de1-4128-ba5b-0985e2f85a63 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:59.750701 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e93a28-8de1-4128-ba5b-0985e2f85a63 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:59.750701 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265c1b7-755d-47c6-8a88-76b8b803eac7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:59.750701 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265c1b7-755d-47c6-8a88-76b8b803eac7 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:59.750701 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265c1b7-755d-47c6-8a88-76b8b803eac7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:59.751155 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265c1b7-755d-47c6-8a88-76b8b803eac7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:59.759254 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265c1b7-755d-47c6-8a88-76b8b803eac7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:59.760738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265c1b7-755d-47c6-8a88-76b8b803eac7 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:10:59.770364 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1092/2162] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:10:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:10:59.788238 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe98e6-3ef4-4ea4-a858-76499e57a1cf service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:10:59.789694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fafe98e6-3ef4-4ea4-a858-76499e57a1cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:10:59.854615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe98e6-3ef4-4ea4-a858-76499e57a1cf service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:10:59.859204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccebfc9-f627-4a29-85d5-60a21b6235b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:10:59.860065 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccebfc9-f627-4a29-85d5-60a21b6235b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:10:59.860343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccebfc9-f627-4a29-85d5-60a21b6235b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:10:59.860623 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccebfc9-f627-4a29-85d5-60a21b6235b0 admin admin] PATH_INFO: `/v3/users/04b1fd04b5ff4da59ce51f6ee7726a2f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:10:59.861831 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccebfc9-f627-4a29-85d5-60a21b6235b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b1fd04b5ff4da59ce51f6ee7726a2f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:10:59.863882 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccebfc9-f627-4a29-85d5-60a21b6235b0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:00.070666 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8ccebfc9-f627-4a29-85d5-60a21b6235b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b1fd04b5ff4da59ce51f6ee7726a2f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:00.071319 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8ccebfc9-f627-4a29-85d5-60a21b6235b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b1fd04b5ff4da59ce51f6ee7726a2f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:00.071932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8ccebfc9-f627-4a29-85d5-60a21b6235b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b1fd04b5ff4da59ce51f6ee7726a2f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:00.189304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8ccebfc9-f627-4a29-85d5-60a21b6235b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b1fd04b5ff4da59ce51f6ee7726a2f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:00.202126 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8ccebfc9-f627-4a29-85d5-60a21b6235b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b1fd04b5ff4da59ce51f6ee7726a2f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:00.214465 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1071/2163] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:10:59 2022] DELETE /identity/v3/users/04b1fd04b5ff4da59ce51f6ee7726a2f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:11:00.219129 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27f7e7-46e3-46fe-a86c-5f3e18da3412 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:00.219425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27f7e7-46e3-46fe-a86c-5f3e18da3412 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:00.219731 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27f7e7-46e3-46fe-a86c-5f3e18da3412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:00.236616 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-8c27f7e7-46e3-46fe-a86c-5f3e18da3412 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:00.237842 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8c27f7e7-46e3-46fe-a86c-5f3e18da3412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:00.294967 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1093/2164] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:00.304865 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccebfc9-f627-4a29-85d5-60a21b6235b0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:00.306424 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8ccebfc9-f627-4a29-85d5-60a21b6235b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:00.362051 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccebfc9-f627-4a29-85d5-60a21b6235b0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:00.365694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73ef61-16e5-4e84-8328-f23bf337a984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:00.366318 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73ef61-16e5-4e84-8328-f23bf337a984 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:00.366594 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73ef61-16e5-4e84-8328-f23bf337a984 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:00.366863 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73ef61-16e5-4e84-8328-f23bf337a984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:00.375700 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73ef61-16e5-4e84-8328-f23bf337a984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:00.380065 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73ef61-16e5-4e84-8328-f23bf337a984 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:00.387063 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1072/2165] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:11:00.825965 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27f7e7-46e3-46fe-a86c-5f3e18da3412 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:00.827426 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8c27f7e7-46e3-46fe-a86c-5f3e18da3412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:00.842507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27f7e7-46e3-46fe-a86c-5f3e18da3412 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:00.847402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d86041-070b-45fa-8235-23b851339d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:00.848251 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d86041-070b-45fa-8235-23b851339d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:00.848537 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d86041-070b-45fa-8235-23b851339d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:00.849413 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d86041-070b-45fa-8235-23b851339d51 admin admin] PATH_INFO: `/v3/projects/e8a70e51069e48d4bd49403c898e8c42` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:00.850923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d86041-070b-45fa-8235-23b851339d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a70e51069e48d4bd49403c898e8c42)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:00.852872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d86041-070b-45fa-8235-23b851339d51 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:00.943534 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7d86041-070b-45fa-8235-23b851339d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a70e51069e48d4bd49403c898e8c42', 'request_id': 'req-b7d86041-070b-45fa-8235-23b851339d51'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:00.983468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7d86041-070b-45fa-8235-23b851339d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a70e51069e48d4bd49403c898e8c42', 'request_id': 'req-b7d86041-070b-45fa-8235-23b851339d51'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:00.989751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7d86041-070b-45fa-8235-23b851339d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a70e51069e48d4bd49403c898e8c42', 'request_id': 'req-b7d86041-070b-45fa-8235-23b851339d51'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:01.000652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7d86041-070b-45fa-8235-23b851339d51 admin admin] The token cache is being invalidate because project e8a70e51069e48d4bd49403c898e8c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:11:01.000939 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7d86041-070b-45fa-8235-23b851339d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:01.001612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b7d86041-070b-45fa-8235-23b851339d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:01.003156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1094/2166] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:11:00 2022] DELETE /identity/v3/projects/e8a70e51069e48d4bd49403c898e8c42 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:01.008123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed1539-738d-479b-a5d8-118c772544aa None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:01.008583 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed1539-738d-479b-a5d8-118c772544aa None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:01.008699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed1539-738d-479b-a5d8-118c772544aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:01.033867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-eeed1539-738d-479b-a5d8-118c772544aa None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:01.035093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-eeed1539-738d-479b-a5d8-118c772544aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:01.105689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1073/2167] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:01.114089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41af59c-7fba-4ef1-a3b1-32d3c5fbb861 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:01.114376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41af59c-7fba-4ef1-a3b1-32d3c5fbb861 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:01.114653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41af59c-7fba-4ef1-a3b1-32d3c5fbb861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:01.134189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-b41af59c-7fba-4ef1-a3b1-32d3c5fbb861 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:01.135406 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b41af59c-7fba-4ef1-a3b1-32d3c5fbb861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:01.143457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1095/2168] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:11:01.147548 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed1539-738d-479b-a5d8-118c772544aa None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:01.156954 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed1539-738d-479b-a5d8-118c772544aa None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:01.161485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327b67e-dd3c-4dd8-81e5-85b75698cb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:01.162127 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327b67e-dd3c-4dd8-81e5-85b75698cb83 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:01.162410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327b67e-dd3c-4dd8-81e5-85b75698cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:01.162705 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327b67e-dd3c-4dd8-81e5-85b75698cb83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:01.163409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327b67e-dd3c-4dd8-81e5-85b75698cb83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:11:01.163715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327b67e-dd3c-4dd8-81e5-85b75698cb83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:01.165396 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327b67e-dd3c-4dd8-81e5-85b75698cb83 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:01.177278 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1074/2169] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:11:01.181086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41af59c-7fba-4ef1-a3b1-32d3c5fbb861 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:01.190833 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41af59c-7fba-4ef1-a3b1-32d3c5fbb861 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:01.195549 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba891b43-91db-43e0-b7f4-0957b94910a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:01.196123 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba891b43-91db-43e0-b7f4-0957b94910a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:01.196403 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba891b43-91db-43e0-b7f4-0957b94910a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:01.196675 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba891b43-91db-43e0-b7f4-0957b94910a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:01.197399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba891b43-91db-43e0-b7f4-0957b94910a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:01.199296 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba891b43-91db-43e0-b7f4-0957b94910a4 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:01.276995 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1096/2170] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:11:01 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:11:01.281047 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327b67e-dd3c-4dd8-81e5-85b75698cb83 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:01.291729 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327b67e-dd3c-4dd8-81e5-85b75698cb83 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:01.344559 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d69e79-7577-47d2-b599-3873818497ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:01.345251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d69e79-7577-47d2-b599-3873818497ac admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:01.345538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d69e79-7577-47d2-b599-3873818497ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:01.345811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d69e79-7577-47d2-b599-3873818497ac admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:01.346494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d69e79-7577-47d2-b599-3873818497ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:01.348441 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d69e79-7577-47d2-b599-3873818497ac admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:01.407172 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1075/2171] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:11:01 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:11:01.412121 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba891b43-91db-43e0-b7f4-0957b94910a4 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:01.426067 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba891b43-91db-43e0-b7f4-0957b94910a4 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:01.431250 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c02d5d-56c1-4fe0-a71e-7058d5a2fdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:01.431922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02d5d-56c1-4fe0-a71e-7058d5a2fdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:01.432206 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02d5d-56c1-4fe0-a71e-7058d5a2fdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:01.432483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02d5d-56c1-4fe0-a71e-7058d5a2fdf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:01.433239 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c02d5d-56c1-4fe0-a71e-7058d5a2fdf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:01.434930 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c02d5d-56c1-4fe0-a71e-7058d5a2fdf6 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:01.445391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1097/2172] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:11:01.449668 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d69e79-7577-47d2-b599-3873818497ac admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:01.459548 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d69e79-7577-47d2-b599-3873818497ac admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:01.464644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b28497-a839-417b-8aa2-e1cff09cdcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:01.465327 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b28497-a839-417b-8aa2-e1cff09cdcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:01.465616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b28497-a839-417b-8aa2-e1cff09cdcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:01.465892 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b28497-a839-417b-8aa2-e1cff09cdcb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:01.466644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b28497-a839-417b-8aa2-e1cff09cdcb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:01.468303 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b28497-a839-417b-8aa2-e1cff09cdcb4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:01.477912 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1076/2173] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:11:01.482620 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c02d5d-56c1-4fe0-a71e-7058d5a2fdf6 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:01.492523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c02d5d-56c1-4fe0-a71e-7058d5a2fdf6 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:01.497190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7ef80-ac10-4008-859c-b25c286ed008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:01.498062 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7ef80-ac10-4008-859c-b25c286ed008 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:01.498347 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7ef80-ac10-4008-859c-b25c286ed008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:01.498627 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7ef80-ac10-4008-859c-b25c286ed008 admin admin] PATH_INFO: `/v3/projects/5aca1557255f463f979a304ceb6ec5d9/users/627835c0090c4cafafe092bde6d35f8a/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:01.512333 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7ef80-ac10-4008-859c-b25c286ed008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aca1557255f463f979a304ceb6ec5d9, user_id=627835c0090c4cafafe092bde6d35f8a, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:01.514996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7ef80-ac10-4008-859c-b25c286ed008 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:01.560276 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1098/2174] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:11:01 2022] PUT /identity/v3/projects/5aca1557255f463f979a304ceb6ec5d9/users/627835c0090c4cafafe092bde6d35f8a/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:01.576987 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6023cf-475a-4a74-b82b-c4bb90db088e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:01.577310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6023cf-475a-4a74-b82b-c4bb90db088e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:01.577616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6023cf-475a-4a74-b82b-c4bb90db088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:01.603776 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8b6023cf-475a-4a74-b82b-c4bb90db088e None None] MFA Rules not processed for user `627835c0090c4cafafe092bde6d35f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:01.604982 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8b6023cf-475a-4a74-b82b-c4bb90db088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:01.667636 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1077/2175] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:01.672665 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7ef80-ac10-4008-859c-b25c286ed008 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:01.734098 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7ef80-ac10-4008-859c-b25c286ed008 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:01.739156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2445dc3-7ce9-426a-8610-5d62d1a4b9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:01.739816 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2445dc3-7ce9-426a-8610-5d62d1a4b9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:01.740154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2445dc3-7ce9-426a-8610-5d62d1a4b9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:01.740434 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2445dc3-7ce9-426a-8610-5d62d1a4b9a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:01.741207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2445dc3-7ce9-426a-8610-5d62d1a4b9a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:01.743090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2445dc3-7ce9-426a-8610-5d62d1a4b9a5 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:01.819125 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1099/2176] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:11:01 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:11:01.823536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6023cf-475a-4a74-b82b-c4bb90db088e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:01.834385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6023cf-475a-4a74-b82b-c4bb90db088e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:01.888196 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801219c0-0524-47b7-9d83-9fb8b3390497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:01.888864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801219c0-0524-47b7-9d83-9fb8b3390497 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:01.889178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801219c0-0524-47b7-9d83-9fb8b3390497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:01.889468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801219c0-0524-47b7-9d83-9fb8b3390497 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:01.890125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801219c0-0524-47b7-9d83-9fb8b3390497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:01.892339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801219c0-0524-47b7-9d83-9fb8b3390497 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:01.966376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1078/2177] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:11:01 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:11:01.970227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2445dc3-7ce9-426a-8610-5d62d1a4b9a5 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:01.980507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2445dc3-7ce9-426a-8610-5d62d1a4b9a5 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:01.985307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec335b8e-2e6a-49f1-a285-428b3a0caa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:01.985916 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec335b8e-2e6a-49f1-a285-428b3a0caa06 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:01.986195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec335b8e-2e6a-49f1-a285-428b3a0caa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:01.986472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec335b8e-2e6a-49f1-a285-428b3a0caa06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:01.987199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec335b8e-2e6a-49f1-a285-428b3a0caa06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:01.988972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec335b8e-2e6a-49f1-a285-428b3a0caa06 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:01.999937 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1100/2178] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:11:02.003644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801219c0-0524-47b7-9d83-9fb8b3390497 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:02.014056 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801219c0-0524-47b7-9d83-9fb8b3390497 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:02.018738 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b141d12-0e06-4b4f-b3d0-0e9b9d40d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:02.026727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b141d12-0e06-4b4f-b3d0-0e9b9d40d0be admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:02.026727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b141d12-0e06-4b4f-b3d0-0e9b9d40d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:02.026727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b141d12-0e06-4b4f-b3d0-0e9b9d40d0be admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:02.026727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b141d12-0e06-4b4f-b3d0-0e9b9d40d0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:02.026727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b141d12-0e06-4b4f-b3d0-0e9b9d40d0be admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:02.031968 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1079/2179] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:11:02.035852 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec335b8e-2e6a-49f1-a285-428b3a0caa06 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:02.045978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec335b8e-2e6a-49f1-a285-428b3a0caa06 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:02.051098 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612be9eb-1b6f-4f01-b9ae-7cddffb128e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:02.051999 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612be9eb-1b6f-4f01-b9ae-7cddffb128e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:02.052612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612be9eb-1b6f-4f01-b9ae-7cddffb128e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:02.052612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612be9eb-1b6f-4f01-b9ae-7cddffb128e6 admin admin] PATH_INFO: `/v3/projects/b40b7d4942d747848fa9e25467de54ba/users/aa49ff7036104d418a94f3e0314b4ca8/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:02.067255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612be9eb-1b6f-4f01-b9ae-7cddffb128e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40b7d4942d747848fa9e25467de54ba, user_id=aa49ff7036104d418a94f3e0314b4ca8, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:02.069938 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612be9eb-1b6f-4f01-b9ae-7cddffb128e6 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:02.131312 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1101/2180] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:11:02 2022] PUT /identity/v3/projects/b40b7d4942d747848fa9e25467de54ba/users/aa49ff7036104d418a94f3e0314b4ca8/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:02.142152 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273d10e-872e-4a46-948d-4562b09107e6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:02.142442 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273d10e-872e-4a46-948d-4562b09107e6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:02.142724 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273d10e-872e-4a46-948d-4562b09107e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:02.169514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6273d10e-872e-4a46-948d-4562b09107e6 None None] MFA Rules not processed for user `aa49ff7036104d418a94f3e0314b4ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:02.170725 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6273d10e-872e-4a46-948d-4562b09107e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:02.231711 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1080/2181] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:02.236195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612be9eb-1b6f-4f01-b9ae-7cddffb128e6 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:02.294569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612be9eb-1b6f-4f01-b9ae-7cddffb128e6 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:02.299520 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795ba75-6c7b-4379-966e-b1398e0d6e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:02.300170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795ba75-6c7b-4379-966e-b1398e0d6e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:02.300455 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795ba75-6c7b-4379-966e-b1398e0d6e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:02.300729 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795ba75-6c7b-4379-966e-b1398e0d6e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:02.301457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795ba75-6c7b-4379-966e-b1398e0d6e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:02.303338 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795ba75-6c7b-4379-966e-b1398e0d6e50 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:02.379416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1102/2182] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:11:02 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:11:02.383336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273d10e-872e-4a46-948d-4562b09107e6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:02.394037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273d10e-872e-4a46-948d-4562b09107e6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:02.449323 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eedb6-6bd6-4a42-acc0-ca0c41c5c8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:02.449989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eedb6-6bd6-4a42-acc0-ca0c41c5c8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:02.450281 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eedb6-6bd6-4a42-acc0-ca0c41c5c8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:02.450561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eedb6-6bd6-4a42-acc0-ca0c41c5c8f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:02.451259 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6eedb6-6bd6-4a42-acc0-ca0c41c5c8f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:02.453352 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6eedb6-6bd6-4a42-acc0-ca0c41c5c8f9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:02.521160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1081/2183] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:11:02 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:11:02.527540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795ba75-6c7b-4379-966e-b1398e0d6e50 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:02.535563 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795ba75-6c7b-4379-966e-b1398e0d6e50 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:02.540360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbae3b-6d99-44bc-9af8-f0e127f25f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:02.541012 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbae3b-6d99-44bc-9af8-f0e127f25f48 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:02.541892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbae3b-6d99-44bc-9af8-f0e127f25f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:02.542165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbae3b-6d99-44bc-9af8-f0e127f25f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:02.542920 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbae3b-6d99-44bc-9af8-f0e127f25f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:02.544492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbae3b-6d99-44bc-9af8-f0e127f25f48 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:02.554986 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1103/2184] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:11:02.564549 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eedb6-6bd6-4a42-acc0-ca0c41c5c8f9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:02.574579 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eedb6-6bd6-4a42-acc0-ca0c41c5c8f9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:02.579216 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120896bd-e2d3-4db9-8c0f-f9dee3b970a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:02.580083 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120896bd-e2d3-4db9-8c0f-f9dee3b970a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:02.580363 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120896bd-e2d3-4db9-8c0f-f9dee3b970a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:02.580638 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120896bd-e2d3-4db9-8c0f-f9dee3b970a1 admin admin] PATH_INFO: `/v3/projects/84241fc1900a4dbb9a288d821d05b94e/users/50c6192fc1b544e7850feb4124e94cd1/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:02.594668 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120896bd-e2d3-4db9-8c0f-f9dee3b970a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84241fc1900a4dbb9a288d821d05b94e, user_id=50c6192fc1b544e7850feb4124e94cd1, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:02.597396 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120896bd-e2d3-4db9-8c0f-f9dee3b970a1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:02.657838 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1082/2185] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:11:02 2022] PUT /identity/v3/projects/84241fc1900a4dbb9a288d821d05b94e/users/50c6192fc1b544e7850feb4124e94cd1/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:02.661752 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbae3b-6d99-44bc-9af8-f0e127f25f48 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:02.672893 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbae3b-6d99-44bc-9af8-f0e127f25f48 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:02.726807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d4f70-ad16-468a-90e5-34e21dc9cbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:02.727471 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d4f70-ad16-468a-90e5-34e21dc9cbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:02.727753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d4f70-ad16-468a-90e5-34e21dc9cbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:02.728028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d4f70-ad16-468a-90e5-34e21dc9cbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:02.729407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d4f70-ad16-468a-90e5-34e21dc9cbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:02.731001 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d4f70-ad16-468a-90e5-34e21dc9cbe4 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:02.740394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1104/2186] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:11:02.744421 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120896bd-e2d3-4db9-8c0f-f9dee3b970a1 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:02.754478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120896bd-e2d3-4db9-8c0f-f9dee3b970a1 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:02.759303 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a0888-8a45-48e1-aa97-a461ebd15e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:02.760171 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a0888-8a45-48e1-aa97-a461ebd15e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:02.760450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a0888-8a45-48e1-aa97-a461ebd15e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:02.760722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a0888-8a45-48e1-aa97-a461ebd15e24 admin admin] PATH_INFO: `/v3/projects/84241fc1900a4dbb9a288d821d05b94e/users/50c6192fc1b544e7850feb4124e94cd1/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:02.762745 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a0888-8a45-48e1-aa97-a461ebd15e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84241fc1900a4dbb9a288d821d05b94e, user_id=50c6192fc1b544e7850feb4124e94cd1, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:02.765449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a0888-8a45-48e1-aa97-a461ebd15e24 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:02.776847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1083/2187] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:11:02 2022] PUT /identity/v3/projects/84241fc1900a4dbb9a288d821d05b94e/users/50c6192fc1b544e7850feb4124e94cd1/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:02.787998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951095c-afca-42f9-a45b-7fad2210e050 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:02.788288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951095c-afca-42f9-a45b-7fad2210e050 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:02.788569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951095c-afca-42f9-a45b-7fad2210e050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:02.815226 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5951095c-afca-42f9-a45b-7fad2210e050 None None] MFA Rules not processed for user `50c6192fc1b544e7850feb4124e94cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:02.816469 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5951095c-afca-42f9-a45b-7fad2210e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:02.882570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1105/2188] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:02.896190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a0888-8a45-48e1-aa97-a461ebd15e24 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:02.897931 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4b5a0888-8a45-48e1-aa97-a461ebd15e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:02.952477 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a0888-8a45-48e1-aa97-a461ebd15e24 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:02.956108 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafe5a0-6233-46a9-9a6e-dfd662d3e94c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:02.956734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafe5a0-6233-46a9-9a6e-dfd662d3e94c service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:02.957011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafe5a0-6233-46a9-9a6e-dfd662d3e94c service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:02.957316 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafe5a0-6233-46a9-9a6e-dfd662d3e94c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:03.011045 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafe5a0-6233-46a9-9a6e-dfd662d3e94c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:03.012510 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafe5a0-6233-46a9-9a6e-dfd662d3e94c service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:03.021188 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1084/2189] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:11:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:11:07.988522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951095c-afca-42f9-a45b-7fad2210e050 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:07.990198 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5951095c-afca-42f9-a45b-7fad2210e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:08.007258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951095c-afca-42f9-a45b-7fad2210e050 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:08.008763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8147e1e-3cc6-4ee8-aaaa-95a99b00ec89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:08.009457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8147e1e-3cc6-4ee8-aaaa-95a99b00ec89 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:08.010879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8147e1e-3cc6-4ee8-aaaa-95a99b00ec89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:08.011223 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8147e1e-3cc6-4ee8-aaaa-95a99b00ec89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:08.078517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8147e1e-3cc6-4ee8-aaaa-95a99b00ec89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:08.080136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8147e1e-3cc6-4ee8-aaaa-95a99b00ec89 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:08.090015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1106/2190] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:11:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:11:09.585065 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafe5a0-6233-46a9-9a6e-dfd662d3e94c service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:09.593356 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafe5a0-6233-46a9-9a6e-dfd662d3e94c service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:09.596863 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8fd7b-5f30-41f2-bd03-b4a6635e7566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:09.597511 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8fd7b-5f30-41f2-bd03-b4a6635e7566 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:09.597789 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8fd7b-5f30-41f2-bd03-b4a6635e7566 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:09.598061 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8fd7b-5f30-41f2-bd03-b4a6635e7566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:09.606807 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8fd7b-5f30-41f2-bd03-b4a6635e7566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:09.608247 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8fd7b-5f30-41f2-bd03-b4a6635e7566 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:09.617546 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1085/2191] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:11:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:11:17.790671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2029b0-c1d5-4950-8727-9d27263647cd None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:17.791142 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2029b0-c1d5-4950-8727-9d27263647cd None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:17.791234 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2029b0-c1d5-4950-8727-9d27263647cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:17.812367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-9e2029b0-c1d5-4950-8727-9d27263647cd None None] MFA Rules not processed for user `aaed14bffb5745349ea35289c4e30089`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:17.813619 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9e2029b0-c1d5-4950-8727-9d27263647cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:17.866960 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1107/2192] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:21.298414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8fd7b-5f30-41f2-bd03-b4a6635e7566 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:21.299870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0dc8fd7b-5f30-41f2-bd03-b4a6635e7566 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:21.387785 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8fd7b-5f30-41f2-bd03-b4a6635e7566 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:21.393179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec843137-e598-4760-bdab-0791ca4173ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd095449a5b44c6b1c9aca712edc11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:21.393880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec843137-e598-4760-bdab-0791ca4173ad service placement] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:21.394152 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec843137-e598-4760-bdab-0791ca4173ad service placement] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:21.394425 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec843137-e598-4760-bdab-0791ca4173ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:21.396165 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ec843137-e598-4760-bdab-0791ca4173ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:21.407523 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec843137-e598-4760-bdab-0791ca4173ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:21.409140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec843137-e598-4760-bdab-0791ca4173ad service placement] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:21.418885 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1086/2193] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:11:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:11:22.620157 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2029b0-c1d5-4950-8727-9d27263647cd None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:22.681432 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2029b0-c1d5-4950-8727-9d27263647cd None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:22.687190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e521f22-2584-45b0-880f-fd10f1b940cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:22.691591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e521f22-2584-45b0-880f-fd10f1b940cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:22.691591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e521f22-2584-45b0-880f-fd10f1b940cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:22.691591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e521f22-2584-45b0-880f-fd10f1b940cf admin admin] PATH_INFO: `/v3/users/627835c0090c4cafafe092bde6d35f8a` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:22.691591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e521f22-2584-45b0-880f-fd10f1b940cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=627835c0090c4cafafe092bde6d35f8a)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:22.692391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e521f22-2584-45b0-880f-fd10f1b940cf admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:22.907676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5e521f22-2584-45b0-880f-fd10f1b940cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627835c0090c4cafafe092bde6d35f8a'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:22.908404 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5e521f22-2584-45b0-880f-fd10f1b940cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627835c0090c4cafafe092bde6d35f8a'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:22.909024 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5e521f22-2584-45b0-880f-fd10f1b940cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627835c0090c4cafafe092bde6d35f8a'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:22.922454 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5e521f22-2584-45b0-880f-fd10f1b940cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627835c0090c4cafafe092bde6d35f8a'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:22.932435 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5e521f22-2584-45b0-880f-fd10f1b940cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627835c0090c4cafafe092bde6d35f8a'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:23.002942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1108/2194] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:11:22 2022] DELETE /identity/v3/users/627835c0090c4cafafe092bde6d35f8a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:23.007428 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4583c93-1986-4c3f-b0d8-13471a1c939c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:23.007889 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4583c93-1986-4c3f-b0d8-13471a1c939c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:23.007980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4583c93-1986-4c3f-b0d8-13471a1c939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:23.026148 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a4583c93-1986-4c3f-b0d8-13471a1c939c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:23.027410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a4583c93-1986-4c3f-b0d8-13471a1c939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:23.093207 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1087/2195] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:23.102725 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e521f22-2584-45b0-880f-fd10f1b940cf admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:23.104798 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5e521f22-2584-45b0-880f-fd10f1b940cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:23.166207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e521f22-2584-45b0-880f-fd10f1b940cf admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:23.169809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e299374-f5b5-4b1f-8d37-499dd293dbb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:23.170515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e299374-f5b5-4b1f-8d37-499dd293dbb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:23.170789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e299374-f5b5-4b1f-8d37-499dd293dbb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:23.171060 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e299374-f5b5-4b1f-8d37-499dd293dbb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:23.180341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e299374-f5b5-4b1f-8d37-499dd293dbb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:23.181946 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e299374-f5b5-4b1f-8d37-499dd293dbb6 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:23.191885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1109/2196] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:11:23.887354 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4583c93-1986-4c3f-b0d8-13471a1c939c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:23.888944 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a4583c93-1986-4c3f-b0d8-13471a1c939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:23.909966 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4583c93-1986-4c3f-b0d8-13471a1c939c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:23.916258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:23.917352 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:23.917959 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:23.918910 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] PATH_INFO: `/v3/projects/5aca1557255f463f979a304ceb6ec5d9` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:23.920333 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aca1557255f463f979a304ceb6ec5d9)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:23.922647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:24.026422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aca1557255f463f979a304ceb6ec5d9', 'request_id': 'req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:24.032955 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aca1557255f463f979a304ceb6ec5d9', 'request_id': 'req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:24.039053 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aca1557255f463f979a304ceb6ec5d9', 'request_id': 'req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:24.085514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] The token cache is being invalidate because project 5aca1557255f463f979a304ceb6ec5d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:11:24.086042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:24.086811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:24.088357 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1088/2197] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:11:23 2022] DELETE /identity/v3/projects/5aca1557255f463f979a304ceb6ec5d9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:24.093000 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e299374-f5b5-4b1f-8d37-499dd293dbb6 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:24.102735 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e299374-f5b5-4b1f-8d37-499dd293dbb6 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:24.160422 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68131369-9610-4fcf-9561-43a95357d653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:24.161423 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68131369-9610-4fcf-9561-43a95357d653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:24.161771 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68131369-9610-4fcf-9561-43a95357d653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:24.162112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68131369-9610-4fcf-9561-43a95357d653 admin admin] PATH_INFO: `/v3/users/aa49ff7036104d418a94f3e0314b4ca8` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:24.163399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68131369-9610-4fcf-9561-43a95357d653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa49ff7036104d418a94f3e0314b4ca8)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:24.165622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68131369-9610-4fcf-9561-43a95357d653 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:24.386296 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-68131369-9610-4fcf-9561-43a95357d653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa49ff7036104d418a94f3e0314b4ca8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:24.387676 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-68131369-9610-4fcf-9561-43a95357d653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa49ff7036104d418a94f3e0314b4ca8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:24.388427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-68131369-9610-4fcf-9561-43a95357d653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa49ff7036104d418a94f3e0314b4ca8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:24.400127 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-68131369-9610-4fcf-9561-43a95357d653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa49ff7036104d418a94f3e0314b4ca8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:24.406651 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-68131369-9610-4fcf-9561-43a95357d653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa49ff7036104d418a94f3e0314b4ca8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:24.498391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1110/2198] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:11:24 2022] DELETE /identity/v3/users/aa49ff7036104d418a94f3e0314b4ca8 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:24.923320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:24.924809 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:24.943440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c302ae-4913-47e6-a169-2ed0d83f7a0f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:25.003328 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:25.004189 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:25.004468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:25.004771 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] PATH_INFO: `/v3/projects/b40b7d4942d747848fa9e25467de54ba` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:25.005972 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40b7d4942d747848fa9e25467de54ba)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:25.007902 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:25.084876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40b7d4942d747848fa9e25467de54ba', 'request_id': 'req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:25.090724 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40b7d4942d747848fa9e25467de54ba', 'request_id': 'req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:25.095967 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40b7d4942d747848fa9e25467de54ba', 'request_id': 'req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:25.199966 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] The token cache is being invalidate because project b40b7d4942d747848fa9e25467de54ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:11:25.200268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:25.200862 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:25.202474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1089/2199] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:11:24 2022] DELETE /identity/v3/projects/b40b7d4942d747848fa9e25467de54ba => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:25.206454 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68131369-9610-4fcf-9561-43a95357d653 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:25.207844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-68131369-9610-4fcf-9561-43a95357d653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:25.221420 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68131369-9610-4fcf-9561-43a95357d653 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:25.277194 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119c3c1-bc61-4bcf-a594-d5b75a49e17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:25.278618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119c3c1-bc61-4bcf-a594-d5b75a49e17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:25.278953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119c3c1-bc61-4bcf-a594-d5b75a49e17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:25.279234 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119c3c1-bc61-4bcf-a594-d5b75a49e17c admin admin] PATH_INFO: `/v3/users/50c6192fc1b544e7850feb4124e94cd1` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:25.280439 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119c3c1-bc61-4bcf-a594-d5b75a49e17c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c6192fc1b544e7850feb4124e94cd1)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:25.282382 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119c3c1-bc61-4bcf-a594-d5b75a49e17c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:25.459767 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4119c3c1-bc61-4bcf-a594-d5b75a49e17c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c6192fc1b544e7850feb4124e94cd1'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:25.460465 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4119c3c1-bc61-4bcf-a594-d5b75a49e17c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c6192fc1b544e7850feb4124e94cd1'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:25.465819 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4119c3c1-bc61-4bcf-a594-d5b75a49e17c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c6192fc1b544e7850feb4124e94cd1'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:25.473468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4119c3c1-bc61-4bcf-a594-d5b75a49e17c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c6192fc1b544e7850feb4124e94cd1'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:25.480554 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4119c3c1-bc61-4bcf-a594-d5b75a49e17c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c6192fc1b544e7850feb4124e94cd1'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:25.542866 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1111/2200] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:11:25 2022] DELETE /identity/v3/users/50c6192fc1b544e7850feb4124e94cd1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:25.933228 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:25.935243 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:25.948072 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ec078-d23e-4ef6-9ed0-f174fa0e2e1d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:26.005687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad955f3-07d8-41cf-a5b4-bf47703c310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:26.006774 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad955f3-07d8-41cf-a5b4-bf47703c310f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:26.007077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad955f3-07d8-41cf-a5b4-bf47703c310f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:26.007359 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad955f3-07d8-41cf-a5b4-bf47703c310f admin admin] PATH_INFO: `/v3/projects/84241fc1900a4dbb9a288d821d05b94e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:26.008595 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad955f3-07d8-41cf-a5b4-bf47703c310f admin admin] RBAC: Authorizing `identity:delete_project(project_id=84241fc1900a4dbb9a288d821d05b94e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:26.010663 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad955f3-07d8-41cf-a5b4-bf47703c310f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:26.274867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dad955f3-07d8-41cf-a5b4-bf47703c310f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84241fc1900a4dbb9a288d821d05b94e', 'request_id': 'req-dad955f3-07d8-41cf-a5b4-bf47703c310f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:26.280898 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dad955f3-07d8-41cf-a5b4-bf47703c310f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84241fc1900a4dbb9a288d821d05b94e', 'request_id': 'req-dad955f3-07d8-41cf-a5b4-bf47703c310f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:26.286209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dad955f3-07d8-41cf-a5b4-bf47703c310f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84241fc1900a4dbb9a288d821d05b94e', 'request_id': 'req-dad955f3-07d8-41cf-a5b4-bf47703c310f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:26.354704 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dad955f3-07d8-41cf-a5b4-bf47703c310f admin admin] The token cache is being invalidate because project 84241fc1900a4dbb9a288d821d05b94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:11:26.354997 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dad955f3-07d8-41cf-a5b4-bf47703c310f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:26.355624 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dad955f3-07d8-41cf-a5b4-bf47703c310f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:26.357225 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1090/2201] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:11:25 2022] DELETE /identity/v3/projects/84241fc1900a4dbb9a288d821d05b94e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:34.754176 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119c3c1-bc61-4bcf-a594-d5b75a49e17c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:34.755831 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4119c3c1-bc61-4bcf-a594-d5b75a49e17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:34.768913 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119c3c1-bc61-4bcf-a594-d5b75a49e17c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:34.845450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecf459-4c7a-4182-b296-09277d1e8d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:34.846844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecf459-4c7a-4182-b296-09277d1e8d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:34.847343 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecf459-4c7a-4182-b296-09277d1e8d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:34.847840 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecf459-4c7a-4182-b296-09277d1e8d10 admin admin] PATH_INFO: `/v3/users/f72d09a184ad498b8358a7a2edb2ff12` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:34.849975 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecf459-4c7a-4182-b296-09277d1e8d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72d09a184ad498b8358a7a2edb2ff12)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:34.853809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecf459-4c7a-4182-b296-09277d1e8d10 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:35.019775 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1fecf459-4c7a-4182-b296-09277d1e8d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72d09a184ad498b8358a7a2edb2ff12'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:35.020454 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1fecf459-4c7a-4182-b296-09277d1e8d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72d09a184ad498b8358a7a2edb2ff12'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:35.021070 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1fecf459-4c7a-4182-b296-09277d1e8d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72d09a184ad498b8358a7a2edb2ff12'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:35.032193 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1fecf459-4c7a-4182-b296-09277d1e8d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72d09a184ad498b8358a7a2edb2ff12'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:35.038760 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1fecf459-4c7a-4182-b296-09277d1e8d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72d09a184ad498b8358a7a2edb2ff12'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:35.108189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1112/2202] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:11:34 2022] DELETE /identity/v3/users/f72d09a184ad498b8358a7a2edb2ff12 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:35.112639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c2eb9-658c-4cd3-ae83-2dbe28ebedd4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:35.113102 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c2eb9-658c-4cd3-ae83-2dbe28ebedd4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:35.113217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c2eb9-658c-4cd3-ae83-2dbe28ebedd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:35.130499 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4d5c2eb9-658c-4cd3-ae83-2dbe28ebedd4 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:35.131674 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4d5c2eb9-658c-4cd3-ae83-2dbe28ebedd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:35.190955 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1091/2203] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:35.200313 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecf459-4c7a-4182-b296-09277d1e8d10 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:35.202435 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1fecf459-4c7a-4182-b296-09277d1e8d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:35.258872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecf459-4c7a-4182-b296-09277d1e8d10 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:35.262637 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a081c7-9464-423e-b31f-c0fa5cd49447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:35.263309 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a081c7-9464-423e-b31f-c0fa5cd49447 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:35.263684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a081c7-9464-423e-b31f-c0fa5cd49447 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:35.263966 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a081c7-9464-423e-b31f-c0fa5cd49447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:35.273157 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a081c7-9464-423e-b31f-c0fa5cd49447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:35.274629 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a081c7-9464-423e-b31f-c0fa5cd49447 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:35.284157 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1113/2204] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:11:35.653830 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c2eb9-658c-4cd3-ae83-2dbe28ebedd4 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:35.655927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4d5c2eb9-658c-4cd3-ae83-2dbe28ebedd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:35.670349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c2eb9-658c-4cd3-ae83-2dbe28ebedd4 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:35.676117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:35.677027 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:35.677340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:35.677618 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] PATH_INFO: `/v3/projects/62eff4cea4114bb398eaabde1a67b664` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:35.678820 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=62eff4cea4114bb398eaabde1a67b664)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:35.680915 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:35.789262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62eff4cea4114bb398eaabde1a67b664', 'request_id': 'req-a0abb04c-1c85-4432-87b0-60fda08247fc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:35.796437 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62eff4cea4114bb398eaabde1a67b664', 'request_id': 'req-a0abb04c-1c85-4432-87b0-60fda08247fc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:35.802219 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62eff4cea4114bb398eaabde1a67b664', 'request_id': 'req-a0abb04c-1c85-4432-87b0-60fda08247fc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:35.868820 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] The token cache is being invalidate because project 62eff4cea4114bb398eaabde1a67b664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:11:35.869168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:35.873854 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:35.873854 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1092/2205] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:11:35 2022] DELETE /identity/v3/projects/62eff4cea4114bb398eaabde1a67b664 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:35.875368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a081c7-9464-423e-b31f-c0fa5cd49447 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:35.884961 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a081c7-9464-423e-b31f-c0fa5cd49447 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:35.942929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d3afb-351a-4c0f-9d2a-4915243896f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:35.943898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3afb-351a-4c0f-9d2a-4915243896f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:35.944177 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3afb-351a-4c0f-9d2a-4915243896f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:35.944448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3afb-351a-4c0f-9d2a-4915243896f9 admin admin] PATH_INFO: `/v3/users/e8ac11d22f0e4be19d21982c24749993` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:35.945656 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d3afb-351a-4c0f-9d2a-4915243896f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ac11d22f0e4be19d21982c24749993)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:35.947580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d3afb-351a-4c0f-9d2a-4915243896f9 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:36.104749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-260d3afb-351a-4c0f-9d2a-4915243896f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ac11d22f0e4be19d21982c24749993'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:36.105352 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-260d3afb-351a-4c0f-9d2a-4915243896f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ac11d22f0e4be19d21982c24749993'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:36.105968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-260d3afb-351a-4c0f-9d2a-4915243896f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ac11d22f0e4be19d21982c24749993'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:36.117772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-260d3afb-351a-4c0f-9d2a-4915243896f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ac11d22f0e4be19d21982c24749993'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:36.125034 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-260d3afb-351a-4c0f-9d2a-4915243896f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ac11d22f0e4be19d21982c24749993'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:36.193138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1114/2206] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:11:35 2022] DELETE /identity/v3/users/e8ac11d22f0e4be19d21982c24749993 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:36.572617 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:36.574256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:36.588726 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abb04c-1c85-4432-87b0-60fda08247fc admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:36.644063 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedcb37-f404-4703-b9da-7f6a2774e5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:36.644845 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedcb37-f404-4703-b9da-7f6a2774e5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:36.645158 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedcb37-f404-4703-b9da-7f6a2774e5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:36.645436 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedcb37-f404-4703-b9da-7f6a2774e5d2 admin admin] PATH_INFO: `/v3/projects/a3aedf0eba8d457889d8650412c9b205` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:36.646606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aedcb37-f404-4703-b9da-7f6a2774e5d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3aedf0eba8d457889d8650412c9b205)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:36.648576 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aedcb37-f404-4703-b9da-7f6a2774e5d2 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:36.736779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0aedcb37-f404-4703-b9da-7f6a2774e5d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3aedf0eba8d457889d8650412c9b205', 'request_id': 'req-0aedcb37-f404-4703-b9da-7f6a2774e5d2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:36.742772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0aedcb37-f404-4703-b9da-7f6a2774e5d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3aedf0eba8d457889d8650412c9b205', 'request_id': 'req-0aedcb37-f404-4703-b9da-7f6a2774e5d2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:36.748228 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0aedcb37-f404-4703-b9da-7f6a2774e5d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3aedf0eba8d457889d8650412c9b205', 'request_id': 'req-0aedcb37-f404-4703-b9da-7f6a2774e5d2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:36.787150 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0aedcb37-f404-4703-b9da-7f6a2774e5d2 admin admin] The token cache is being invalidate because project a3aedf0eba8d457889d8650412c9b205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:11:36.787433 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0aedcb37-f404-4703-b9da-7f6a2774e5d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:36.788066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0aedcb37-f404-4703-b9da-7f6a2774e5d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:36.789689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1093/2207] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:11:36 2022] DELETE /identity/v3/projects/a3aedf0eba8d457889d8650412c9b205 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:36.794681 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb870f-eed4-4a28-a50b-4bbdc22115d0 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:36.796693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb870f-eed4-4a28-a50b-4bbdc22115d0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:36.796693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb870f-eed4-4a28-a50b-4bbdc22115d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:36.813380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-76bb870f-eed4-4a28-a50b-4bbdc22115d0 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:36.814658 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-76bb870f-eed4-4a28-a50b-4bbdc22115d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:36.872045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1115/2208] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:36.879865 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0529d-f897-4772-b198-668357358b3f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:36.880153 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0529d-f897-4772-b198-668357358b3f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:36.880434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0529d-f897-4772-b198-668357358b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:36.898950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-60c0529d-f897-4772-b198-668357358b3f None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:36.900191 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-60c0529d-f897-4772-b198-668357358b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:36.908737 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1094/2209] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:36.912812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb870f-eed4-4a28-a50b-4bbdc22115d0 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:36.922914 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb870f-eed4-4a28-a50b-4bbdc22115d0 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:36.927521 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0bc3d-0663-4980-a76a-505d8793b463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:36.928419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bc3d-0663-4980-a76a-505d8793b463 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:36.928605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bc3d-0663-4980-a76a-505d8793b463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:36.928702 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bc3d-0663-4980-a76a-505d8793b463 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:36.929486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0bc3d-0663-4980-a76a-505d8793b463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:11:36.929795 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0bc3d-0663-4980-a76a-505d8793b463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:36.931394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0bc3d-0663-4980-a76a-505d8793b463 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:36.942912 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1116/2210] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:11:36.947047 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0529d-f897-4772-b198-668357358b3f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:36.961482 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0529d-f897-4772-b198-668357358b3f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:36.963221 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a21713-a736-405b-82ce-34f9e35f91b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:36.963876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a21713-a736-405b-82ce-34f9e35f91b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:36.964162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a21713-a736-405b-82ce-34f9e35f91b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:36.964445 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a21713-a736-405b-82ce-34f9e35f91b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:36.965180 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a21713-a736-405b-82ce-34f9e35f91b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:36.967768 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a21713-a736-405b-82ce-34f9e35f91b3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:37.045871 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1095/2211] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:11:36 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:11:37.048445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0bc3d-0663-4980-a76a-505d8793b463 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:37.059706 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0bc3d-0663-4980-a76a-505d8793b463 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:37.130702 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d93b7-8348-416a-b8f1-48985cd143ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:37.132981 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d93b7-8348-416a-b8f1-48985cd143ff admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:37.132981 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d93b7-8348-416a-b8f1-48985cd143ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:37.132981 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d93b7-8348-416a-b8f1-48985cd143ff admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:37.132981 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d93b7-8348-416a-b8f1-48985cd143ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:37.134733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d93b7-8348-416a-b8f1-48985cd143ff admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:37.197077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1117/2212] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:11:37 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:11:37.199163 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a21713-a736-405b-82ce-34f9e35f91b3 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:37.209742 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a21713-a736-405b-82ce-34f9e35f91b3 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:37.214470 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc505c-c5eb-4476-a90a-5a51f607a0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:37.215120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc505c-c5eb-4476-a90a-5a51f607a0da admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:37.215402 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc505c-c5eb-4476-a90a-5a51f607a0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:37.215678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc505c-c5eb-4476-a90a-5a51f607a0da admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:37.216396 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc505c-c5eb-4476-a90a-5a51f607a0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:37.218679 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc505c-c5eb-4476-a90a-5a51f607a0da admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:37.228804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1096/2213] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:11:37.233361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d93b7-8348-416a-b8f1-48985cd143ff admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:37.244239 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d93b7-8348-416a-b8f1-48985cd143ff admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:37.249315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92eb8c-dfd3-4bc1-a5d3-52ea6f758ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:37.249974 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92eb8c-dfd3-4bc1-a5d3-52ea6f758ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:37.250251 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92eb8c-dfd3-4bc1-a5d3-52ea6f758ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:37.250520 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92eb8c-dfd3-4bc1-a5d3-52ea6f758ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:37.251241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92eb8c-dfd3-4bc1-a5d3-52ea6f758ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:37.252823 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92eb8c-dfd3-4bc1-a5d3-52ea6f758ccb admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:37.262844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1118/2214] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:11:37.267063 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc505c-c5eb-4476-a90a-5a51f607a0da admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:37.276913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc505c-c5eb-4476-a90a-5a51f607a0da admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:37.282166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1514e-b5d3-4f6e-87fc-e86918140c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:37.283133 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1514e-b5d3-4f6e-87fc-e86918140c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:37.283420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1514e-b5d3-4f6e-87fc-e86918140c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:37.283695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1514e-b5d3-4f6e-87fc-e86918140c1c admin admin] PATH_INFO: `/v3/projects/91cc3a0abbcd45d6a5b00e83b6b143b3/users/57c8d645ea8145b48107c829fca6ae31/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:37.298401 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1514e-b5d3-4f6e-87fc-e86918140c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cc3a0abbcd45d6a5b00e83b6b143b3, user_id=57c8d645ea8145b48107c829fca6ae31, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:37.301101 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1514e-b5d3-4f6e-87fc-e86918140c1c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:37.383616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1097/2215] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:11:37 2022] PUT /identity/v3/projects/91cc3a0abbcd45d6a5b00e83b6b143b3/users/57c8d645ea8145b48107c829fca6ae31/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:37.394762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc467-6c0e-453a-83cd-6cb3a256d793 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:37.395284 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc467-6c0e-453a-83cd-6cb3a256d793 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:37.395571 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc467-6c0e-453a-83cd-6cb3a256d793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:37.422802 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e58cc467-6c0e-453a-83cd-6cb3a256d793 None None] MFA Rules not processed for user `57c8d645ea8145b48107c829fca6ae31`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:37.423946 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e58cc467-6c0e-453a-83cd-6cb3a256d793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:37.489407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1119/2216] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:37.493688 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1514e-b5d3-4f6e-87fc-e86918140c1c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:37.555239 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1514e-b5d3-4f6e-87fc-e86918140c1c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:37.560065 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87702a-5ceb-4ff7-bdd9-3db5df89fe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:37.561361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87702a-5ceb-4ff7-bdd9-3db5df89fe3a admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:37.561646 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87702a-5ceb-4ff7-bdd9-3db5df89fe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:37.561929 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87702a-5ceb-4ff7-bdd9-3db5df89fe3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:37.562629 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87702a-5ceb-4ff7-bdd9-3db5df89fe3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:37.564578 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87702a-5ceb-4ff7-bdd9-3db5df89fe3a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:37.664270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1098/2217] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:11:37 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:11:37.668533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cc467-6c0e-453a-83cd-6cb3a256d793 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:37.682499 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cc467-6c0e-453a-83cd-6cb3a256d793 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:37.737485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865c5e0-325b-4811-b2cb-1a357fd8757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:37.738159 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865c5e0-325b-4811-b2cb-1a357fd8757e admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:37.738446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865c5e0-325b-4811-b2cb-1a357fd8757e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:37.738721 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865c5e0-325b-4811-b2cb-1a357fd8757e admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:37.739416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865c5e0-325b-4811-b2cb-1a357fd8757e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:37.741362 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865c5e0-325b-4811-b2cb-1a357fd8757e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:37.834060 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1120/2218] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:11:37 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:11:37.844367 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87702a-5ceb-4ff7-bdd9-3db5df89fe3a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:37.854562 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87702a-5ceb-4ff7-bdd9-3db5df89fe3a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:37.859968 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d39d2e-beb8-42b9-a334-047a171af32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:37.860652 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39d2e-beb8-42b9-a334-047a171af32a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:37.860938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39d2e-beb8-42b9-a334-047a171af32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:37.861246 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39d2e-beb8-42b9-a334-047a171af32a admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:37.861974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d39d2e-beb8-42b9-a334-047a171af32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:37.863685 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d39d2e-beb8-42b9-a334-047a171af32a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:37.874146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1099/2219] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:11:37.878191 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865c5e0-325b-4811-b2cb-1a357fd8757e admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:37.888006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865c5e0-325b-4811-b2cb-1a357fd8757e admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:37.892734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbab455-a254-4176-b8d5-f40cfa2d140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:37.893642 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbab455-a254-4176-b8d5-f40cfa2d140c admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:37.893925 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbab455-a254-4176-b8d5-f40cfa2d140c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:37.894200 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbab455-a254-4176-b8d5-f40cfa2d140c admin admin] PATH_INFO: `/v3/projects/fe311d374af1460d98d1a613d68add07/users/7151da553d814791891026ea4e750867/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:37.908800 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbab455-a254-4176-b8d5-f40cfa2d140c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe311d374af1460d98d1a613d68add07, user_id=7151da553d814791891026ea4e750867, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:37.911506 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbab455-a254-4176-b8d5-f40cfa2d140c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:37.976808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1121/2220] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:11:37 2022] PUT /identity/v3/projects/fe311d374af1460d98d1a613d68add07/users/7151da553d814791891026ea4e750867/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:37.980900 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d39d2e-beb8-42b9-a334-047a171af32a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:37.991573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d39d2e-beb8-42b9-a334-047a171af32a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:38.046183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c41ef-55df-4438-8d39-65f552c0f60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:38.046834 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c41ef-55df-4438-8d39-65f552c0f60a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:38.047371 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c41ef-55df-4438-8d39-65f552c0f60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:38.047644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c41ef-55df-4438-8d39-65f552c0f60a admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:38.048387 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c41ef-55df-4438-8d39-65f552c0f60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:38.050131 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c41ef-55df-4438-8d39-65f552c0f60a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:38.059580 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1100/2221] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:11:38.063775 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbab455-a254-4176-b8d5-f40cfa2d140c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:38.074124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbab455-a254-4176-b8d5-f40cfa2d140c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:38.078743 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b8be8-22cd-4266-bf9f-88c1804623b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:38.088096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b8be8-22cd-4266-bf9f-88c1804623b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:38.088096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b8be8-22cd-4266-bf9f-88c1804623b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:38.088096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b8be8-22cd-4266-bf9f-88c1804623b8 admin admin] PATH_INFO: `/v3/projects/fe311d374af1460d98d1a613d68add07/users/7151da553d814791891026ea4e750867/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:38.088096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b8be8-22cd-4266-bf9f-88c1804623b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe311d374af1460d98d1a613d68add07, user_id=7151da553d814791891026ea4e750867, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:38.088096 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b8be8-22cd-4266-bf9f-88c1804623b8 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:38.095384 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1122/2222] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:11:38 2022] PUT /identity/v3/projects/fe311d374af1460d98d1a613d68add07/users/7151da553d814791891026ea4e750867/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:38.105360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e07bc-dfea-47bc-914a-c67a2fbe32a9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:38.110253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e07bc-dfea-47bc-914a-c67a2fbe32a9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:38.110253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e07bc-dfea-47bc-914a-c67a2fbe32a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:38.133423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-604e07bc-dfea-47bc-914a-c67a2fbe32a9 None None] MFA Rules not processed for user `7151da553d814791891026ea4e750867`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:38.134625 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-604e07bc-dfea-47bc-914a-c67a2fbe32a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:38.199122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1101/2223] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:38.209914 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b8be8-22cd-4266-bf9f-88c1804623b8 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:38.211619 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3d0b8be8-22cd-4266-bf9f-88c1804623b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:38.268619 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b8be8-22cd-4266-bf9f-88c1804623b8 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:38.272261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614615a-6836-4ff8-a407-e03ce2802210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:38.272983 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614615a-6836-4ff8-a407-e03ce2802210 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:38.273363 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614615a-6836-4ff8-a407-e03ce2802210 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:38.273643 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614615a-6836-4ff8-a407-e03ce2802210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:38.328422 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614615a-6836-4ff8-a407-e03ce2802210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:38.329856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614615a-6836-4ff8-a407-e03ce2802210 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:38.338399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1123/2224] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:11:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:11:42.309254 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e07bc-dfea-47bc-914a-c67a2fbe32a9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:42.371610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e07bc-dfea-47bc-914a-c67a2fbe32a9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:42.377507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b93e4-e2eb-455c-b763-f3a7e5298efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:42.378566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b93e4-e2eb-455c-b763-f3a7e5298efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:42.378829 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b93e4-e2eb-455c-b763-f3a7e5298efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:42.379183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b93e4-e2eb-455c-b763-f3a7e5298efd admin admin] PATH_INFO: `/v3/users/57c8d645ea8145b48107c829fca6ae31` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:42.380363 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b93e4-e2eb-455c-b763-f3a7e5298efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=57c8d645ea8145b48107c829fca6ae31)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:42.382415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b93e4-e2eb-455c-b763-f3a7e5298efd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:42.529207 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a3b93e4-e2eb-455c-b763-f3a7e5298efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57c8d645ea8145b48107c829fca6ae31'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:42.529908 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a3b93e4-e2eb-455c-b763-f3a7e5298efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57c8d645ea8145b48107c829fca6ae31'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:42.531175 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a3b93e4-e2eb-455c-b763-f3a7e5298efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57c8d645ea8145b48107c829fca6ae31'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:42.611750 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a3b93e4-e2eb-455c-b763-f3a7e5298efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57c8d645ea8145b48107c829fca6ae31'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:42.625884 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a3b93e4-e2eb-455c-b763-f3a7e5298efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57c8d645ea8145b48107c829fca6ae31'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:42.641773 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1102/2225] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:11:42 2022] DELETE /identity/v3/users/57c8d645ea8145b48107c829fca6ae31 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:42.643144 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4427c-f20d-49e2-8f12-150f709a9500 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:42.643583 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4427c-f20d-49e2-8f12-150f709a9500 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:42.643753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4427c-f20d-49e2-8f12-150f709a9500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:42.661527 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-46f4427c-f20d-49e2-8f12-150f709a9500 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:42.662743 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-46f4427c-f20d-49e2-8f12-150f709a9500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:42.724731 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1124/2226] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:42.735339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b93e4-e2eb-455c-b763-f3a7e5298efd admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:42.736871 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8a3b93e4-e2eb-455c-b763-f3a7e5298efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:42.795055 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b93e4-e2eb-455c-b763-f3a7e5298efd admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:42.798998 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d301b-4512-4dea-9110-96dc6ce07f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:42.799620 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d301b-4512-4dea-9110-96dc6ce07f7e service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:42.799903 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d301b-4512-4dea-9110-96dc6ce07f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:42.800180 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d301b-4512-4dea-9110-96dc6ce07f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:42.809557 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d301b-4512-4dea-9110-96dc6ce07f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:42.811104 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d301b-4512-4dea-9110-96dc6ce07f7e service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:42.821268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1103/2227] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:11:43.213430 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4427c-f20d-49e2-8f12-150f709a9500 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:43.214888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-46f4427c-f20d-49e2-8f12-150f709a9500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:43.230889 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4427c-f20d-49e2-8f12-150f709a9500 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:43.235743 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:43.236610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:43.236893 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:43.237216 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] PATH_INFO: `/v3/projects/91cc3a0abbcd45d6a5b00e83b6b143b3` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:43.238513 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=91cc3a0abbcd45d6a5b00e83b6b143b3)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:43.240397 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:43.343544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91cc3a0abbcd45d6a5b00e83b6b143b3', 'request_id': 'req-214c9310-2789-4d54-8869-29b0f49a52fb'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:43.405559 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91cc3a0abbcd45d6a5b00e83b6b143b3', 'request_id': 'req-214c9310-2789-4d54-8869-29b0f49a52fb'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:43.411737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91cc3a0abbcd45d6a5b00e83b6b143b3', 'request_id': 'req-214c9310-2789-4d54-8869-29b0f49a52fb'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:43.421424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] The token cache is being invalidate because project 91cc3a0abbcd45d6a5b00e83b6b143b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:11:43.421706 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:43.422563 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:43.424079 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1125/2228] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:11:43 2022] DELETE /identity/v3/projects/91cc3a0abbcd45d6a5b00e83b6b143b3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:43.428162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d301b-4512-4dea-9110-96dc6ce07f7e service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:43.438257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d301b-4512-4dea-9110-96dc6ce07f7e service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:43.491702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19609802-52a0-436a-aeed-e3a6067c50ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:43.492565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19609802-52a0-436a-aeed-e3a6067c50ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:43.492843 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19609802-52a0-436a-aeed-e3a6067c50ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:43.493147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19609802-52a0-436a-aeed-e3a6067c50ac admin admin] PATH_INFO: `/v3/users/7151da553d814791891026ea4e750867` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:43.494322 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19609802-52a0-436a-aeed-e3a6067c50ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=7151da553d814791891026ea4e750867)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:43.496287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19609802-52a0-436a-aeed-e3a6067c50ac admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:43.647769 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-19609802-52a0-436a-aeed-e3a6067c50ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7151da553d814791891026ea4e750867'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:43.648434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-19609802-52a0-436a-aeed-e3a6067c50ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7151da553d814791891026ea4e750867'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:43.649246 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-19609802-52a0-436a-aeed-e3a6067c50ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7151da553d814791891026ea4e750867'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:43.720108 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-19609802-52a0-436a-aeed-e3a6067c50ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7151da553d814791891026ea4e750867'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:43.732799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-19609802-52a0-436a-aeed-e3a6067c50ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7151da553d814791891026ea4e750867'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:43.744546 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1104/2229] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:11:43 2022] DELETE /identity/v3/users/7151da553d814791891026ea4e750867 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:44.116191 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:44.117656 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:44.130408 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c9310-2789-4d54-8869-29b0f49a52fb admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:44.187592 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f8fdf-5f86-4824-8b74-21509db9d8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:44.188456 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f8fdf-5f86-4824-8b74-21509db9d8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:44.188737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f8fdf-5f86-4824-8b74-21509db9d8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:44.189011 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f8fdf-5f86-4824-8b74-21509db9d8a0 admin admin] PATH_INFO: `/v3/projects/fe311d374af1460d98d1a613d68add07` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:44.190217 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f8fdf-5f86-4824-8b74-21509db9d8a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe311d374af1460d98d1a613d68add07)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:44.192105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f8fdf-5f86-4824-8b74-21509db9d8a0 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:44.308627 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-314f8fdf-5f86-4824-8b74-21509db9d8a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe311d374af1460d98d1a613d68add07', 'request_id': 'req-314f8fdf-5f86-4824-8b74-21509db9d8a0'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:44.365253 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-314f8fdf-5f86-4824-8b74-21509db9d8a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe311d374af1460d98d1a613d68add07', 'request_id': 'req-314f8fdf-5f86-4824-8b74-21509db9d8a0'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:44.371433 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-314f8fdf-5f86-4824-8b74-21509db9d8a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe311d374af1460d98d1a613d68add07', 'request_id': 'req-314f8fdf-5f86-4824-8b74-21509db9d8a0'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:44.381407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-314f8fdf-5f86-4824-8b74-21509db9d8a0 admin admin] The token cache is being invalidate because project fe311d374af1460d98d1a613d68add07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:11:44.381694 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-314f8fdf-5f86-4824-8b74-21509db9d8a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:44.382318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-314f8fdf-5f86-4824-8b74-21509db9d8a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:11:44.383855 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1126/2230] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:11:44 2022] DELETE /identity/v3/projects/fe311d374af1460d98d1a613d68add07 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:44.389305 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db4672-87b5-42a7-997c-95c2caca0282 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:44.389599 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db4672-87b5-42a7-997c-95c2caca0282 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:44.389878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db4672-87b5-42a7-997c-95c2caca0282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:44.407399 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-52db4672-87b5-42a7-997c-95c2caca0282 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:44.408606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-52db4672-87b5-42a7-997c-95c2caca0282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:44.464620 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1105/2231] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:44.473839 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ff72c-d89f-409d-abd6-bb03f72a9530 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:44.474132 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ff72c-d89f-409d-abd6-bb03f72a9530 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:44.474417 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ff72c-d89f-409d-abd6-bb03f72a9530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:44.492086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-8d4ff72c-d89f-409d-abd6-bb03f72a9530 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:44.493324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8d4ff72c-d89f-409d-abd6-bb03f72a9530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:44.501231 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1127/2232] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:44.505148 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db4672-87b5-42a7-997c-95c2caca0282 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:44.515445 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db4672-87b5-42a7-997c-95c2caca0282 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:44.519896 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a695f29-d5c6-42f2-9949-1ac41f2d7b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:44.520540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695f29-d5c6-42f2-9949-1ac41f2d7b14 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:44.520817 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695f29-d5c6-42f2-9949-1ac41f2d7b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:44.521122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695f29-d5c6-42f2-9949-1ac41f2d7b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:44.521840 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a695f29-d5c6-42f2-9949-1ac41f2d7b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:11:44.522143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a695f29-d5c6-42f2-9949-1ac41f2d7b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:44.523765 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a695f29-d5c6-42f2-9949-1ac41f2d7b14 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:44.535794 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1106/2233] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:11:44.539922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ff72c-d89f-409d-abd6-bb03f72a9530 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:44.549329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ff72c-d89f-409d-abd6-bb03f72a9530 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:44.554115 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2642a4-eb4a-4568-bec2-a65633f208ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:44.554757 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2642a4-eb4a-4568-bec2-a65633f208ab admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:44.555040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2642a4-eb4a-4568-bec2-a65633f208ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:44.555319 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2642a4-eb4a-4568-bec2-a65633f208ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:44.556001 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2642a4-eb4a-4568-bec2-a65633f208ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:44.557934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2642a4-eb4a-4568-bec2-a65633f208ab admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:44.624478 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1128/2234] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:11:44 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:11:44.628565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a695f29-d5c6-42f2-9949-1ac41f2d7b14 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:44.639254 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a695f29-d5c6-42f2-9949-1ac41f2d7b14 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:44.693413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0d333-254e-4d0f-ac68-a39c8058dfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:44.694077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0d333-254e-4d0f-ac68-a39c8058dfcf admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:44.694360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0d333-254e-4d0f-ac68-a39c8058dfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:44.694637 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0d333-254e-4d0f-ac68-a39c8058dfcf admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:44.695316 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0d333-254e-4d0f-ac68-a39c8058dfcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:44.697297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0d333-254e-4d0f-ac68-a39c8058dfcf admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:44.766319 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1107/2235] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:11:44 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:11:44.770466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2642a4-eb4a-4568-bec2-a65633f208ab admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:44.780864 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2642a4-eb4a-4568-bec2-a65633f208ab admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:44.785650 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023883cb-4df0-416a-95bd-2c16dfe15d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:44.786308 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023883cb-4df0-416a-95bd-2c16dfe15d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:44.786590 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023883cb-4df0-416a-95bd-2c16dfe15d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:44.786882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023883cb-4df0-416a-95bd-2c16dfe15d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:44.787584 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023883cb-4df0-416a-95bd-2c16dfe15d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:44.789237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023883cb-4df0-416a-95bd-2c16dfe15d42 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:44.799671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1129/2236] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:11:44.803603 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0d333-254e-4d0f-ac68-a39c8058dfcf admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:44.814143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0d333-254e-4d0f-ac68-a39c8058dfcf admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:44.818773 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccea3f1-3a60-4074-ab72-f7c50337897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:44.819418 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccea3f1-3a60-4074-ab72-f7c50337897e admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:44.819700 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccea3f1-3a60-4074-ab72-f7c50337897e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:44.819974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccea3f1-3a60-4074-ab72-f7c50337897e admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:44.820744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccea3f1-3a60-4074-ab72-f7c50337897e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:44.822454 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccea3f1-3a60-4074-ab72-f7c50337897e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:44.832610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1108/2237] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:11:44.836471 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023883cb-4df0-416a-95bd-2c16dfe15d42 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:44.846131 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023883cb-4df0-416a-95bd-2c16dfe15d42 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:44.850867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afb33a-c72d-4cfa-aaa7-30facb54e64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:44.851615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afb33a-c72d-4cfa-aaa7-30facb54e64a admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:44.851895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afb33a-c72d-4cfa-aaa7-30facb54e64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:44.852164 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afb33a-c72d-4cfa-aaa7-30facb54e64a admin admin] PATH_INFO: `/v3/projects/3bf518b73d33421badb2de2696a58e91/users/fea9bb96938b42aa938af6c5e4b9dcfe/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:44.866133 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afb33a-c72d-4cfa-aaa7-30facb54e64a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf518b73d33421badb2de2696a58e91, user_id=fea9bb96938b42aa938af6c5e4b9dcfe, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:44.868789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afb33a-c72d-4cfa-aaa7-30facb54e64a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:44.931955 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1130/2238] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:11:44 2022] PUT /identity/v3/projects/3bf518b73d33421badb2de2696a58e91/users/fea9bb96938b42aa938af6c5e4b9dcfe/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:11:44.937495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb9e1-66cf-40a7-872a-29a85ecf31fe None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:44.937786 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb9e1-66cf-40a7-872a-29a85ecf31fe None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:44.938065 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb9e1-66cf-40a7-872a-29a85ecf31fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:44.955894 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-45deb9e1-66cf-40a7-872a-29a85ecf31fe None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:44.957130 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-45deb9e1-66cf-40a7-872a-29a85ecf31fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:45.013461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1109/2239] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:45.022931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afb33a-c72d-4cfa-aaa7-30facb54e64a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:45.024712 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-06afb33a-c72d-4cfa-aaa7-30facb54e64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:45.081099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afb33a-c72d-4cfa-aaa7-30facb54e64a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:45.084832 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc455d2d-16d5-4e54-b029-f97719c023b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:45.085568 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc455d2d-16d5-4e54-b029-f97719c023b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:45.085857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc455d2d-16d5-4e54-b029-f97719c023b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:45.086131 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc455d2d-16d5-4e54-b029-f97719c023b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:45.095585 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc455d2d-16d5-4e54-b029-f97719c023b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:45.097040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc455d2d-16d5-4e54-b029-f97719c023b2 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:45.106707 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1131/2240] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:11:46.149497 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd86ed-dac9-4889-a1b2-cf1c2625ccb0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:46.150499 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd86ed-dac9-4889-a1b2-cf1c2625ccb0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:46.150499 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd86ed-dac9-4889-a1b2-cf1c2625ccb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:46.178013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2bcd86ed-dac9-4889-a1b2-cf1c2625ccb0 None None] MFA Rules not processed for user `fea9bb96938b42aa938af6c5e4b9dcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:46.179260 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2bcd86ed-dac9-4889-a1b2-cf1c2625ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:46.243674 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1110/2241] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:11:46.254566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc455d2d-16d5-4e54-b029-f97719c023b2 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:11:46.256004 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-cc455d2d-16d5-4e54-b029-f97719c023b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:46.312068 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc455d2d-16d5-4e54-b029-f97719c023b2 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:11:46.315789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc8973-4012-4bb5-9569-6d76f39a4877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:11:46.316429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc8973-4012-4bb5-9569-6d76f39a4877 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:46.316712 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc8973-4012-4bb5-9569-6d76f39a4877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:46.316988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc8973-4012-4bb5-9569-6d76f39a4877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:46.325181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc8973-4012-4bb5-9569-6d76f39a4877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:11:46.326601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc8973-4012-4bb5-9569-6d76f39a4877 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:11:46.335447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1132/2242] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:11:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:11:48.993699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29481bf7-cd05-4646-83e0-935f8c8d3a06 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:11:48.994221 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29481bf7-cd05-4646-83e0-935f8c8d3a06 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:11:48.994394 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29481bf7-cd05-4646-83e0-935f8c8d3a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:11:49.012128 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-29481bf7-cd05-4646-83e0-935f8c8d3a06 None None] MFA Rules not processed for user `fea9bb96938b42aa938af6c5e4b9dcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:11:49.013372 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-29481bf7-cd05-4646-83e0-935f8c8d3a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:11:49.020258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1111/2243] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:11:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:12:10.883215 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369623a8-7b2d-4f47-911a-a591b8657669 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:12:10.883804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369623a8-7b2d-4f47-911a-a591b8657669 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:12:10.883804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369623a8-7b2d-4f47-911a-a591b8657669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:12:10.900974 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-369623a8-7b2d-4f47-911a-a591b8657669 None None] MFA Rules not processed for user `fea9bb96938b42aa938af6c5e4b9dcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:12:10.902199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-369623a8-7b2d-4f47-911a-a591b8657669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:12:10.909876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1133/2244] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:12:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:12:24.852248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb84f9a-f660-4f7d-bc8e-a00eddad072d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:12:24.852776 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb84f9a-f660-4f7d-bc8e-a00eddad072d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:12:24.852776 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb84f9a-f660-4f7d-bc8e-a00eddad072d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:12:24.870336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1eb84f9a-f660-4f7d-bc8e-a00eddad072d None None] MFA Rules not processed for user `f506156c62014060ab9004b7abbb2369`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:12:24.871534 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1eb84f9a-f660-4f7d-bc8e-a00eddad072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:12:24.924826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1112/2245] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:12:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:12:46.049454 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5a89c-f73f-4f01-9194-b7f83987667f None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:12:46.050056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5a89c-f73f-4f01-9194-b7f83987667f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:12:46.050153 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5a89c-f73f-4f01-9194-b7f83987667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:12:46.107452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-30c5a89c-f73f-4f01-9194-b7f83987667f None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:12:46.108667 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-30c5a89c-f73f-4f01-9194-b7f83987667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:12:46.177967 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1134/2246] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:12:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:12:46.340560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb84f9a-f660-4f7d-bc8e-a00eddad072d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:12:46.342073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1eb84f9a-f660-4f7d-bc8e-a00eddad072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:12:46.431182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb84f9a-f660-4f7d-bc8e-a00eddad072d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:12:46.436402 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda3f8e-b999-46e6-9a3b-b9495157c6c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:12:46.437082 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda3f8e-b999-46e6-9a3b-b9495157c6c6 service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:12:46.437388 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda3f8e-b999-46e6-9a3b-b9495157c6c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:12:46.438199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda3f8e-b999-46e6-9a3b-b9495157c6c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:12:46.447084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda3f8e-b999-46e6-9a3b-b9495157c6c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:12:46.448538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda3f8e-b999-46e6-9a3b-b9495157c6c6 service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:12:46.457027 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1113/2247] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:12:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 11:12:48.056104 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9d475-f7f7-4fee-baf9-d1917bde0e3e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:12:48.056595 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9d475-f7f7-4fee-baf9-d1917bde0e3e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:12:48.056800 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9d475-f7f7-4fee-baf9-d1917bde0e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:12:48.082045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-ccc9d475-f7f7-4fee-baf9-d1917bde0e3e None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:12:48.083351 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ccc9d475-f7f7-4fee-baf9-d1917bde0e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:12:48.092235 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1135/2248] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:12:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:12:48.107526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda3f8e-b999-46e6-9a3b-b9495157c6c6 service swift] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:12:48.119980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda3f8e-b999-46e6-9a3b-b9495157c6c6 service swift] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:12:48.126912 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9a4d6-fbfe-46d6-a66d-e231c9936bd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:12:48.127579 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9a4d6-fbfe-46d6-a66d-e231c9936bd7 service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:12:48.127866 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9a4d6-fbfe-46d6-a66d-e231c9936bd7 service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:12:48.128164 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9a4d6-fbfe-46d6-a66d-e231c9936bd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:12:48.137007 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9a4d6-fbfe-46d6-a66d-e231c9936bd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:12:48.139257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9a4d6-fbfe-46d6-a66d-e231c9936bd7 service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:12:48.148794 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1114/2249] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:12:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 06 11:13:06.335507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99008d5-cd8b-4990-a857-71e50b5b1b80 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:06.336022 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99008d5-cd8b-4990-a857-71e50b5b1b80 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:06.336124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99008d5-cd8b-4990-a857-71e50b5b1b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:06.353514 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c99008d5-cd8b-4990-a857-71e50b5b1b80 None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:13:06.354697 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c99008d5-cd8b-4990-a857-71e50b5b1b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:06.362384 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1136/2250] 10.222.0.62 () {58 vars in 967 bytes} [Wed Apr 6 11:13:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:13:06.374750 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9a4d6-fbfe-46d6-a66d-e231c9936bd7 service swift] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:13:06.385194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9a4d6-fbfe-46d6-a66d-e231c9936bd7 service swift] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:13:06.390431 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a4e5c-942b-49e5-a657-582dcc5ef52a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:13:06.391331 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a4e5c-942b-49e5-a657-582dcc5ef52a service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:06.391664 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a4e5c-942b-49e5-a657-582dcc5ef52a service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:06.391999 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a4e5c-942b-49e5-a657-582dcc5ef52a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:06.400834 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a4e5c-942b-49e5-a657-582dcc5ef52a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:13:06.402554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a4e5c-942b-49e5-a657-582dcc5ef52a service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:13:06.411500 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1115/2251] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:13:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 11:13:08.944719 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c988b8-34e7-4e3b-be97-b677da53ca2a None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:08.945346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c988b8-34e7-4e3b-be97-b677da53ca2a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:08.945346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c988b8-34e7-4e3b-be97-b677da53ca2a None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:08.946733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1137/2252] 10.222.0.62 () {54 vars in 921 bytes} [Wed Apr 6 11:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:13:08.952597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c25b2-f47d-47f7-a151-ea4ef3d4c7d8 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:08.953026 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c25b2-f47d-47f7-a151-ea4ef3d4c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:08.953231 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c25b2-f47d-47f7-a151-ea4ef3d4c7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:09.000069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-574c25b2-f47d-47f7-a151-ea4ef3d4c7d8 None None] MFA Rules not processed for user `650c5809116e4bcd808044236c06dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:13:09.001971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-574c25b2-f47d-47f7-a151-ea4ef3d4c7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:09.076771 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1116/2253] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Apr 6 11:13:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:13:09.088778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c988b8-34e7-4e3b-be97-b677da53ca2a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:13:09.090573 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-49c988b8-34e7-4e3b-be97-b677da53ca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:09.178633 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c988b8-34e7-4e3b-be97-b677da53ca2a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:13:09.182394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9b719-cccd-41db-afde-4554cf049e55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42cd381cf5c745de9dac8f77a8cea554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:13:09.183044 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9b719-cccd-41db-afde-4554cf049e55 service glance] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:09.183329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9b719-cccd-41db-afde-4554cf049e55 service glance] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:09.183604 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9b719-cccd-41db-afde-4554cf049e55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:09.194636 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9b719-cccd-41db-afde-4554cf049e55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:13:09.196079 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9b719-cccd-41db-afde-4554cf049e55 service glance] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:13:09.206647 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1138/2254] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:13:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:13:09.256880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c25b2-f47d-47f7-a151-ea4ef3d4c7d8 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:13:09.268067 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c25b2-f47d-47f7-a151-ea4ef3d4c7d8 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:13:09.273182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28689600-444b-4b34-8fc1-f225c256853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:13:09.274071 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28689600-444b-4b34-8fc1-f225c256853f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:09.274353 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28689600-444b-4b34-8fc1-f225c256853f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:09.274631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28689600-444b-4b34-8fc1-f225c256853f admin admin] PATH_INFO: `/v3/users/fea9bb96938b42aa938af6c5e4b9dcfe` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:09.276010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28689600-444b-4b34-8fc1-f225c256853f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea9bb96938b42aa938af6c5e4b9dcfe)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:13:09.278021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28689600-444b-4b34-8fc1-f225c256853f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:13:09.430117 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad76600-1cad-4c47-a83c-e5abd05f6aca None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:09.430366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad76600-1cad-4c47-a83c-e5abd05f6aca None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:09.430658 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad76600-1cad-4c47-a83c-e5abd05f6aca None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:09.432030 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1139/2255] 10.222.0.62 () {54 vars in 921 bytes} [Wed Apr 6 11:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 11:13:09.436427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce36c79-6437-41c1-a97d-906b66a9e6e1 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:09.436713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce36c79-6437-41c1-a97d-906b66a9e6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:09.436992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce36c79-6437-41c1-a97d-906b66a9e6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:09.454463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-2ce36c79-6437-41c1-a97d-906b66a9e6e1 None None] MFA Rules not processed for user `e078c6efaf054f7489f7164fdafce714`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:13:09.455662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2ce36c79-6437-41c1-a97d-906b66a9e6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:09.462196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1140/2256] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Apr 6 11:13:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:13:09.479487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce36c79-6437-41c1-a97d-906b66a9e6e1 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:13:09.489890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce36c79-6437-41c1-a97d-906b66a9e6e1 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:13:09.494198 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce961308-0888-47b2-8e88-2100e16bcb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:13:09.495149 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce961308-0888-47b2-8e88-2100e16bcb27 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:09.495487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce961308-0888-47b2-8e88-2100e16bcb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:09.495691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce961308-0888-47b2-8e88-2100e16bcb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:09.498848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-28689600-444b-4b34-8fc1-f225c256853f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea9bb96938b42aa938af6c5e4b9dcfe'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:13:09.499513 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-28689600-444b-4b34-8fc1-f225c256853f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea9bb96938b42aa938af6c5e4b9dcfe'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:13:09.500143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-28689600-444b-4b34-8fc1-f225c256853f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea9bb96938b42aa938af6c5e4b9dcfe'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:13:09.503436 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce961308-0888-47b2-8e88-2100e16bcb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:13:09.504860 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce961308-0888-47b2-8e88-2100e16bcb27 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:13:09.513196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1141/2257] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:13:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:13:09.558712 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-28689600-444b-4b34-8fc1-f225c256853f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea9bb96938b42aa938af6c5e4b9dcfe'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:13:09.571977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-28689600-444b-4b34-8fc1-f225c256853f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea9bb96938b42aa938af6c5e4b9dcfe'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:13:09.587929 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1117/2258] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:13:09 2022] DELETE /identity/v3/users/fea9bb96938b42aa938af6c5e4b9dcfe => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:13:09.606079 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310131a-1ddf-4c01-bf7f-8ac049f9df43 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:09.606395 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310131a-1ddf-4c01-bf7f-8ac049f9df43 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:09.606639 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310131a-1ddf-4c01-bf7f-8ac049f9df43 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:09.608366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1142/2259] 10.222.0.62 () {54 vars in 921 bytes} [Wed Apr 6 11:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:13:09.615122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b2c07-be1b-40ea-b0b5-ca7fbd709d06 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:09.615415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b2c07-be1b-40ea-b0b5-ca7fbd709d06 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:09.615682 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b2c07-be1b-40ea-b0b5-ca7fbd709d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:09.635678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2e4b2c07-be1b-40ea-b0b5-ca7fbd709d06 None None] MFA Rules not processed for user `650c5809116e4bcd808044236c06dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:13:09.635678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2e4b2c07-be1b-40ea-b0b5-ca7fbd709d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:09.709789 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1118/2260] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Apr 6 11:13:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:13:09.720749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310131a-1ddf-4c01-bf7f-8ac049f9df43 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:13:09.722449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c310131a-1ddf-4c01-bf7f-8ac049f9df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:09.778788 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310131a-1ddf-4c01-bf7f-8ac049f9df43 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:13:09.783140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307dd9c-146e-45c5-b9c2-ec95c9a037ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:13:09.783769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307dd9c-146e-45c5-b9c2-ec95c9a037ad service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:09.784055 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307dd9c-146e-45c5-b9c2-ec95c9a037ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:09.784724 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307dd9c-146e-45c5-b9c2-ec95c9a037ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:09.794926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307dd9c-146e-45c5-b9c2-ec95c9a037ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:13:09.796869 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307dd9c-146e-45c5-b9c2-ec95c9a037ad service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:13:09.807655 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1143/2261] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:13:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:13:09.828749 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b2c07-be1b-40ea-b0b5-ca7fbd709d06 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:13:09.830816 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2e4b2c07-be1b-40ea-b0b5-ca7fbd709d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:09.906202 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b2c07-be1b-40ea-b0b5-ca7fbd709d06 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:13:09.911496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:13:09.912351 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:09.912626 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:09.912902 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] PATH_INFO: `/v3/projects/3bf518b73d33421badb2de2696a58e91` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:09.914098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf518b73d33421badb2de2696a58e91)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:13:09.916091 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:13:10.002545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf518b73d33421badb2de2696a58e91', 'request_id': 'req-61dec3bc-b303-4276-b1c7-c8d1ef07a129'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:13:10.007051 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf518b73d33421badb2de2696a58e91', 'request_id': 'req-61dec3bc-b303-4276-b1c7-c8d1ef07a129'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:13:10.012722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf518b73d33421badb2de2696a58e91', 'request_id': 'req-61dec3bc-b303-4276-b1c7-c8d1ef07a129'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:13:10.077906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] The token cache is being invalidate because project 3bf518b73d33421badb2de2696a58e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:13:10.078200 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:13:10.078841 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:13:10.081358 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1119/2262] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:13:09 2022] DELETE /identity/v3/projects/3bf518b73d33421badb2de2696a58e91 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:13:13.499050 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273843-9e92-43e1-8c0a-9de7ac0f40b3 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:13.499532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273843-9e92-43e1-8c0a-9de7ac0f40b3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:13.499625 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273843-9e92-43e1-8c0a-9de7ac0f40b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:13.525116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-59273843-9e92-43e1-8c0a-9de7ac0f40b3 None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:13:13.526425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-59273843-9e92-43e1-8c0a-9de7ac0f40b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:13.584949 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1144/2263] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:13:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:13:13.596857 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:13:13.598361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:13.666827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dec3bc-b303-4276-b1c7-c8d1ef07a129 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:13:13.672097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56697a-f001-4b5d-b043-33e74c502447 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:13:13.673273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56697a-f001-4b5d-b043-33e74c502447 service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:13.673560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56697a-f001-4b5d-b043-33e74c502447 service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:13.673835 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56697a-f001-4b5d-b043-33e74c502447 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:13.681950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56697a-f001-4b5d-b043-33e74c502447 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:13:13.683568 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56697a-f001-4b5d-b043-33e74c502447 service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:13:13.692525 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1120/2264] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:13:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 11:13:18.927723 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59273843-9e92-43e1-8c0a-9de7ac0f40b3 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:13:18.929211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-59273843-9e92-43e1-8c0a-9de7ac0f40b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:18.988475 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59273843-9e92-43e1-8c0a-9de7ac0f40b3 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:13:18.992107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a96e1-3c53-454d-9dd4-3a8846c8d893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:13:18.992753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a96e1-3c53-454d-9dd4-3a8846c8d893 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:18.993037 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a96e1-3c53-454d-9dd4-3a8846c8d893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:18.993336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a96e1-3c53-454d-9dd4-3a8846c8d893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:18.995214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-638a96e1-3c53-454d-9dd4-3a8846c8d893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:19.065693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a96e1-3c53-454d-9dd4-3a8846c8d893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:13:19.067131 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a96e1-3c53-454d-9dd4-3a8846c8d893 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:13:19.078146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1145/2265] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:13:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:13:19.704447 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56697a-f001-4b5d-b043-33e74c502447 service swift] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:13:19.705920 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-cb56697a-f001-4b5d-b043-33e74c502447 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:19.717666 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56697a-f001-4b5d-b043-33e74c502447 service swift] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:13:19.722082 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173c2f1-f668-4bf8-a4a9-f5d7574748fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:13:19.722733 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173c2f1-f668-4bf8-a4a9-f5d7574748fe service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:19.723015 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173c2f1-f668-4bf8-a4a9-f5d7574748fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:19.723293 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173c2f1-f668-4bf8-a4a9-f5d7574748fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:19.725089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7173c2f1-f668-4bf8-a4a9-f5d7574748fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:19.739300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173c2f1-f668-4bf8-a4a9-f5d7574748fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:13:19.740803 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173c2f1-f668-4bf8-a4a9-f5d7574748fe service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:13:19.753956 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1121/2266] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:13:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:13:30.294684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a96e1-3c53-454d-9dd4-3a8846c8d893 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:13:30.296331 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-638a96e1-3c53-454d-9dd4-3a8846c8d893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:30.311768 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a96e1-3c53-454d-9dd4-3a8846c8d893 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:13:30.319431 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d0cbd-9837-45c6-9b78-e8ae732af74f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:13:30.320649 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d0cbd-9837-45c6-9b78-e8ae732af74f service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:30.320649 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d0cbd-9837-45c6-9b78-e8ae732af74f service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:30.320844 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d0cbd-9837-45c6-9b78-e8ae732af74f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:30.322611 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ed2d0cbd-9837-45c6-9b78-e8ae732af74f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:30.382312 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d0cbd-9837-45c6-9b78-e8ae732af74f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:13:30.383925 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d0cbd-9837-45c6-9b78-e8ae732af74f service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:13:30.393950 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1146/2267] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:13:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:13:38.961990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173c2f1-f668-4bf8-a4a9-f5d7574748fe service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:13:38.963523 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7173c2f1-f668-4bf8-a4a9-f5d7574748fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:38.977526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173c2f1-f668-4bf8-a4a9-f5d7574748fe service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:13:38.982936 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4390e14-4de9-4f9b-902c-2a095d6442c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:13:38.983566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4390e14-4de9-4f9b-902c-2a095d6442c7 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:38.983844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4390e14-4de9-4f9b-902c-2a095d6442c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:38.984119 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4390e14-4de9-4f9b-902c-2a095d6442c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:38.985846 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a4390e14-4de9-4f9b-902c-2a095d6442c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:39.040625 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4390e14-4de9-4f9b-902c-2a095d6442c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:13:39.044207 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4390e14-4de9-4f9b-902c-2a095d6442c7 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:13:39.051534 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1122/2268] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:13:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:13:41.759188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d0cbd-9837-45c6-9b78-e8ae732af74f service nova] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:13:41.768476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d0cbd-9837-45c6-9b78-e8ae732af74f service nova] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:13:41.772076 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7109f-ca1e-4c2b-9273-e7afaf49f2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:13:41.772751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7109f-ca1e-4c2b-9273-e7afaf49f2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:41.773035 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7109f-ca1e-4c2b-9273-e7afaf49f2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:41.773345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7109f-ca1e-4c2b-9273-e7afaf49f2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:41.775143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-add7109f-ca1e-4c2b-9273-e7afaf49f2a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:41.785069 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7109f-ca1e-4c2b-9273-e7afaf49f2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:13:41.786522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7109f-ca1e-4c2b-9273-e7afaf49f2a8 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:13:41.794299 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1147/2269] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:13:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:13:44.345395 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d07682-1217-4a40-8d83-69fbbfa91858 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:44.345838 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d07682-1217-4a40-8d83-69fbbfa91858 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:44.345936 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d07682-1217-4a40-8d83-69fbbfa91858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:44.362827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d2d07682-1217-4a40-8d83-69fbbfa91858 None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:13:44.364001 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d2d07682-1217-4a40-8d83-69fbbfa91858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:13:44.370923 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1123/2270] 10.222.0.62 () {58 vars in 967 bytes} [Wed Apr 6 11:13:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:13:44.383358 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7109f-ca1e-4c2b-9273-e7afaf49f2a8 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:13:44.395189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7109f-ca1e-4c2b-9273-e7afaf49f2a8 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:13:44.400176 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754859a-4bfc-4024-b2bd-b31a85e7c7d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:13:44.400808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754859a-4bfc-4024-b2bd-b31a85e7c7d6 service swift] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:13:44.401143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754859a-4bfc-4024-b2bd-b31a85e7c7d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:13:44.401426 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754859a-4bfc-4024-b2bd-b31a85e7c7d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:13:44.409356 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754859a-4bfc-4024-b2bd-b31a85e7c7d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:13:44.410915 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754859a-4bfc-4024-b2bd-b31a85e7c7d6 service swift] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:13:44.418850 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1148/2271] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:13:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 11:14:09.925448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f91b02-e494-436b-a3e1-956d03c73b7c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:14:09.925951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f91b02-e494-436b-a3e1-956d03c73b7c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:14:09.925951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f91b02-e494-436b-a3e1-956d03c73b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:14:09.943384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-76f91b02-e494-436b-a3e1-956d03c73b7c None None] MFA Rules not processed for user `aaed14bffb5745349ea35289c4e30089`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:14:09.944579 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-76f91b02-e494-436b-a3e1-956d03c73b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:14:09.951423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1124/2272] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:14:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:14:17.478390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754859a-4bfc-4024-b2bd-b31a85e7c7d6 service swift] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:14:17.492434 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754859a-4bfc-4024-b2bd-b31a85e7c7d6 service swift] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:14:17.505147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d5e6a-5d3c-4486-88f1-c8c9c6f383f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:14:17.505816 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d5e6a-5d3c-4486-88f1-c8c9c6f383f8 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:14:17.506095 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d5e6a-5d3c-4486-88f1-c8c9c6f383f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:14:17.506365 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d5e6a-5d3c-4486-88f1-c8c9c6f383f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:14:17.508280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-157d5e6a-5d3c-4486-88f1-c8c9c6f383f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:14:17.521995 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d5e6a-5d3c-4486-88f1-c8c9c6f383f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:14:17.523566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d5e6a-5d3c-4486-88f1-c8c9c6f383f8 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:14:17.534253 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1149/2273] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:14:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:14:37.173375 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f91b02-e494-436b-a3e1-956d03c73b7c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:14:37.185871 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f91b02-e494-436b-a3e1-956d03c73b7c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:14:37.191248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4ee67-c9f4-4360-afa3-7e091133dce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:14:37.191990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4ee67-c9f4-4360-afa3-7e091133dce0 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:14:37.192275 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4ee67-c9f4-4360-afa3-7e091133dce0 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:14:37.192548 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4ee67-c9f4-4360-afa3-7e091133dce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:14:37.194351 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-60a4ee67-c9f4-4360-afa3-7e091133dce0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:14:37.249941 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4ee67-c9f4-4360-afa3-7e091133dce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:14:37.251563 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4ee67-c9f4-4360-afa3-7e091133dce0 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:14:37.262514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1125/2274] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:14:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:14:41.453233 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d5e6a-5d3c-4486-88f1-c8c9c6f383f8 service nova] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:14:41.466578 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d5e6a-5d3c-4486-88f1-c8c9c6f383f8 service nova] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:14:41.472280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c68c7-d201-458e-8f4c-4bd583dab7fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:14:41.472923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c68c7-d201-458e-8f4c-4bd583dab7fe service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:14:41.473261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c68c7-d201-458e-8f4c-4bd583dab7fe service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:14:41.473929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c68c7-d201-458e-8f4c-4bd583dab7fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:14:41.476335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9a1c68c7-d201-458e-8f4c-4bd583dab7fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:14:41.489144 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c68c7-d201-458e-8f4c-4bd583dab7fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:14:41.491893 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c68c7-d201-458e-8f4c-4bd583dab7fe service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:14:41.503542 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1150/2275] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:14:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:14:55.769919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b37b9-7e32-4916-99d6-e151c092a158 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:14:55.773864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b37b9-7e32-4916-99d6-e151c092a158 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:14:55.773864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b37b9-7e32-4916-99d6-e151c092a158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:14:55.788752 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-608b37b9-7e32-4916-99d6-e151c092a158 None None] MFA Rules not processed for user `f506156c62014060ab9004b7abbb2369`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:14:55.789992 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-608b37b9-7e32-4916-99d6-e151c092a158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:14:55.797260 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1126/2276] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:14:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:14:56.095186 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c68c7-d201-458e-8f4c-4bd583dab7fe service nova] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:14:56.104446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c68c7-d201-458e-8f4c-4bd583dab7fe service nova] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:14:56.108092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a508d-d67b-428a-8f3d-3070200cbd65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:14:56.108724 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a508d-d67b-428a-8f3d-3070200cbd65 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:14:56.109011 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a508d-d67b-428a-8f3d-3070200cbd65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:14:56.109317 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a508d-d67b-428a-8f3d-3070200cbd65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:14:56.111137 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-793a508d-d67b-428a-8f3d-3070200cbd65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:14:56.120387 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a508d-d67b-428a-8f3d-3070200cbd65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:14:56.122887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a508d-d67b-428a-8f3d-3070200cbd65 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:14:56.130080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1151/2277] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:14:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:14:57.506649 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b37b9-7e32-4916-99d6-e151c092a158 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:14:57.508153 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-608b37b9-7e32-4916-99d6-e151c092a158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:14:57.576594 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b37b9-7e32-4916-99d6-e151c092a158 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:14:57.581566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1514e4-1bb1-4d44-909a-4ae2f06a0b40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd095449a5b44c6b1c9aca712edc11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:14:57.582201 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1514e4-1bb1-4d44-909a-4ae2f06a0b40 service placement] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:14:57.582482 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1514e4-1bb1-4d44-909a-4ae2f06a0b40 service placement] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:14:57.582802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1514e4-1bb1-4d44-909a-4ae2f06a0b40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:14:57.584584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5b1514e4-1bb1-4d44-909a-4ae2f06a0b40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:14:57.595982 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1514e4-1bb1-4d44-909a-4ae2f06a0b40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:14:57.597628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1514e4-1bb1-4d44-909a-4ae2f06a0b40 service placement] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:14:57.607996 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1127/2278] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:14:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:15:07.524077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a508d-d67b-428a-8f3d-3070200cbd65 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:15:07.536992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a508d-d67b-428a-8f3d-3070200cbd65 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:15:07.542722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b35597-6f26-452d-90ea-ad924496ee59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:15:07.543363 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b35597-6f26-452d-90ea-ad924496ee59 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:15:07.543649 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b35597-6f26-452d-90ea-ad924496ee59 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:15:07.543928 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b35597-6f26-452d-90ea-ad924496ee59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:15:07.546026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-00b35597-6f26-452d-90ea-ad924496ee59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:15:07.558794 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b35597-6f26-452d-90ea-ad924496ee59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:15:07.560373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b35597-6f26-452d-90ea-ad924496ee59 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:15:07.571478 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1152/2279] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:15:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:15:18.682680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1514e4-1bb1-4d44-909a-4ae2f06a0b40 service placement] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:15:18.694829 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1514e4-1bb1-4d44-909a-4ae2f06a0b40 service placement] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:15:18.700357 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9a1cb-cec0-444f-b415-553624d22a5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:15:18.701009 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9a1cb-cec0-444f-b415-553624d22a5d service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:15:18.701325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9a1cb-cec0-444f-b415-553624d22a5d service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:15:18.701611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9a1cb-cec0-444f-b415-553624d22a5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:15:18.703412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-85e9a1cb-cec0-444f-b415-553624d22a5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:15:18.761384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9a1cb-cec0-444f-b415-553624d22a5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:15:18.762948 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9a1cb-cec0-444f-b415-553624d22a5d service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:15:18.772021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1128/2280] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:15:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:15:20.318180 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c3309-e608-4e1b-9005-e0fcd3765e04 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:15:20.324532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c3309-e608-4e1b-9005-e0fcd3765e04 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:15:20.324532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c3309-e608-4e1b-9005-e0fcd3765e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:15:20.346031 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-343c3309-e608-4e1b-9005-e0fcd3765e04 None None] MFA Rules not processed for user `145dbd68096f410d81b61b4c9f70ca3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:15:20.347444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-343c3309-e608-4e1b-9005-e0fcd3765e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:15:20.355387 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1153/2281] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:15:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:15:56.565957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9a1cb-cec0-444f-b415-553624d22a5d service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:15:56.575026 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9a1cb-cec0-444f-b415-553624d22a5d service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:15:56.578631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2c162-6a33-4a47-851e-ee385e5f2bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:15:56.579261 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2c162-6a33-4a47-851e-ee385e5f2bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:15:56.579542 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2c162-6a33-4a47-851e-ee385e5f2bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:15:56.579818 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2c162-6a33-4a47-851e-ee385e5f2bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:15:56.581609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4fc2c162-6a33-4a47-851e-ee385e5f2bf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:15:56.642349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2c162-6a33-4a47-851e-ee385e5f2bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:15:56.643821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2c162-6a33-4a47-851e-ee385e5f2bf0 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:15:56.654039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1129/2282] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:00.464881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c3309-e608-4e1b-9005-e0fcd3765e04 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:00.466515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-343c3309-e608-4e1b-9005-e0fcd3765e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:00.482071 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c3309-e608-4e1b-9005-e0fcd3765e04 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:00.486574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee28e20-5751-4366-8646-59642db78edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:00.487441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee28e20-5751-4366-8646-59642db78edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:00.487722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee28e20-5751-4366-8646-59642db78edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:00.487996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee28e20-5751-4366-8646-59642db78edb admin admin] PATH_INFO: `/v3/users/aaed14bffb5745349ea35289c4e30089` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:00.489281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee28e20-5751-4366-8646-59642db78edb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaed14bffb5745349ea35289c4e30089)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:00.491205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee28e20-5751-4366-8646-59642db78edb admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:00.619668 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4ee28e20-5751-4366-8646-59642db78edb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaed14bffb5745349ea35289c4e30089'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:00.621153 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4ee28e20-5751-4366-8646-59642db78edb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaed14bffb5745349ea35289c4e30089'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:00.621768 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4ee28e20-5751-4366-8646-59642db78edb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaed14bffb5745349ea35289c4e30089'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:00.633123 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4ee28e20-5751-4366-8646-59642db78edb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaed14bffb5745349ea35289c4e30089'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:00.639732 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4ee28e20-5751-4366-8646-59642db78edb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaed14bffb5745349ea35289c4e30089'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:00.699080 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1154/2283] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:16:00 2022] DELETE /identity/v3/users/aaed14bffb5745349ea35289c4e30089 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:00.923470 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2c162-6a33-4a47-851e-ee385e5f2bf0 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:00.933922 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2c162-6a33-4a47-851e-ee385e5f2bf0 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:00.988461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89da29-4313-486f-bd01-d992d7c6959a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:00.989311 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89da29-4313-486f-bd01-d992d7c6959a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:00.989576 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89da29-4313-486f-bd01-d992d7c6959a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:00.989851 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89da29-4313-486f-bd01-d992d7c6959a admin admin] PATH_INFO: `/v3/projects/570fcc7ba7fd442190ca2be7ca059e29` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:00.991035 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89da29-4313-486f-bd01-d992d7c6959a admin admin] RBAC: Authorizing `identity:delete_project(project_id=570fcc7ba7fd442190ca2be7ca059e29)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:00.992977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89da29-4313-486f-bd01-d992d7c6959a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:01.075656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-cf89da29-4313-486f-bd01-d992d7c6959a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570fcc7ba7fd442190ca2be7ca059e29', 'request_id': 'req-cf89da29-4313-486f-bd01-d992d7c6959a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:01.081571 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-cf89da29-4313-486f-bd01-d992d7c6959a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570fcc7ba7fd442190ca2be7ca059e29', 'request_id': 'req-cf89da29-4313-486f-bd01-d992d7c6959a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:01.086764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-cf89da29-4313-486f-bd01-d992d7c6959a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570fcc7ba7fd442190ca2be7ca059e29', 'request_id': 'req-cf89da29-4313-486f-bd01-d992d7c6959a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:01.160124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-cf89da29-4313-486f-bd01-d992d7c6959a admin admin] The token cache is being invalidate because project 570fcc7ba7fd442190ca2be7ca059e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:16:01.160415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-cf89da29-4313-486f-bd01-d992d7c6959a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:01.161112 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-cf89da29-4313-486f-bd01-d992d7c6959a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:01.162653 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1130/2284] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:16:00 2022] DELETE /identity/v3/projects/570fcc7ba7fd442190ca2be7ca059e29 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:01.168195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778448-b05e-4971-958a-7e2b34705b5d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:01.168508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778448-b05e-4971-958a-7e2b34705b5d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:01.168790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778448-b05e-4971-958a-7e2b34705b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:01.187729 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e6778448-b05e-4971-958a-7e2b34705b5d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:01.189008 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e6778448-b05e-4971-958a-7e2b34705b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:01.246586 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1155/2285] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:01.254258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518258-408c-4d1e-865e-f99c6a3a6228 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:01.254553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518258-408c-4d1e-865e-f99c6a3a6228 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:01.254836 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518258-408c-4d1e-865e-f99c6a3a6228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:01.272496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0a518258-408c-4d1e-865e-f99c6a3a6228 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:01.273734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0a518258-408c-4d1e-865e-f99c6a3a6228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:01.281868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1131/2286] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:01.286348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6778448-b05e-4971-958a-7e2b34705b5d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:01.296668 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6778448-b05e-4971-958a-7e2b34705b5d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:01.301327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2f194-a9b2-4b3c-9cd8-dd989cf0004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:01.301972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f194-a9b2-4b3c-9cd8-dd989cf0004f admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:01.302258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f194-a9b2-4b3c-9cd8-dd989cf0004f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:01.302523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f194-a9b2-4b3c-9cd8-dd989cf0004f admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:01.303343 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2f194-a9b2-4b3c-9cd8-dd989cf0004f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:16:01.303646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2f194-a9b2-4b3c-9cd8-dd989cf0004f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:01.305400 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2f194-a9b2-4b3c-9cd8-dd989cf0004f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:01.317712 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1156/2287] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:16:01.321982 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518258-408c-4d1e-865e-f99c6a3a6228 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:01.332321 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518258-408c-4d1e-865e-f99c6a3a6228 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:01.337048 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c6f3c-734b-4321-bb43-de99a9beec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:01.337729 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c6f3c-734b-4321-bb43-de99a9beec38 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:01.338012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c6f3c-734b-4321-bb43-de99a9beec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:01.338290 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c6f3c-734b-4321-bb43-de99a9beec38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:01.338981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c6f3c-734b-4321-bb43-de99a9beec38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:01.340977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c6f3c-734b-4321-bb43-de99a9beec38 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:01.442507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1132/2288] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:16:01 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:16:01.446626 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2f194-a9b2-4b3c-9cd8-dd989cf0004f admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:01.456809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2f194-a9b2-4b3c-9cd8-dd989cf0004f admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:01.512301 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb6c4-6a0a-4b37-961a-57d26968e9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:01.512936 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb6c4-6a0a-4b37-961a-57d26968e9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:01.513242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb6c4-6a0a-4b37-961a-57d26968e9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:01.513520 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb6c4-6a0a-4b37-961a-57d26968e9d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:01.514214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cb6c4-6a0a-4b37-961a-57d26968e9d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:01.516121 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cb6c4-6a0a-4b37-961a-57d26968e9d8 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:01.607436 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1157/2289] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:16:01 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:01.611610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c6f3c-734b-4321-bb43-de99a9beec38 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:01.622101 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c6f3c-734b-4321-bb43-de99a9beec38 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:01.626877 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de19c2-60cd-473c-aa0c-d8304fecbf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:01.627528 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de19c2-60cd-473c-aa0c-d8304fecbf04 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:01.627810 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de19c2-60cd-473c-aa0c-d8304fecbf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:01.628087 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de19c2-60cd-473c-aa0c-d8304fecbf04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:01.628817 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de19c2-60cd-473c-aa0c-d8304fecbf04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:01.630534 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de19c2-60cd-473c-aa0c-d8304fecbf04 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:01.640167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1133/2290] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:01.643960 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb6c4-6a0a-4b37-961a-57d26968e9d8 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:01.654845 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb6c4-6a0a-4b37-961a-57d26968e9d8 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:01.659558 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad02d1a-0e9f-407f-9f4a-fed47acba26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:01.660249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02d1a-0e9f-407f-9f4a-fed47acba26e admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:01.660533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02d1a-0e9f-407f-9f4a-fed47acba26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:01.660810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02d1a-0e9f-407f-9f4a-fed47acba26e admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:01.661576 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad02d1a-0e9f-407f-9f4a-fed47acba26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:01.663183 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad02d1a-0e9f-407f-9f4a-fed47acba26e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:01.674181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1158/2291] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:01.678275 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de19c2-60cd-473c-aa0c-d8304fecbf04 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:01.688503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de19c2-60cd-473c-aa0c-d8304fecbf04 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:01.693255 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c8eb2-b054-413c-816c-4a05bb3b52a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:01.694188 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8eb2-b054-413c-816c-4a05bb3b52a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:01.694467 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8eb2-b054-413c-816c-4a05bb3b52a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:01.694741 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8eb2-b054-413c-816c-4a05bb3b52a2 admin admin] PATH_INFO: `/v3/projects/dd796dd8c36a4bb7a248d1775adaa7f1/users/2487bbfec764448e9ebef30f67066d6f/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:01.708906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c8eb2-b054-413c-816c-4a05bb3b52a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd796dd8c36a4bb7a248d1775adaa7f1, user_id=2487bbfec764448e9ebef30f67066d6f, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:01.711650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c8eb2-b054-413c-816c-4a05bb3b52a2 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:01.778263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1134/2292] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:16:01 2022] PUT /identity/v3/projects/dd796dd8c36a4bb7a248d1775adaa7f1/users/2487bbfec764448e9ebef30f67066d6f/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:01.788077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a513-73b4-494f-8f6e-c1c9de089aca None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:01.788391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a513-73b4-494f-8f6e-c1c9de089aca None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:01.788666 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a513-73b4-494f-8f6e-c1c9de089aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:01.815332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7eb8a513-73b4-494f-8f6e-c1c9de089aca None None] MFA Rules not processed for user `2487bbfec764448e9ebef30f67066d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:01.816549 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7eb8a513-73b4-494f-8f6e-c1c9de089aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:01.876998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1159/2293] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:01.881399 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c8eb2-b054-413c-816c-4a05bb3b52a2 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:01.941970 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c8eb2-b054-413c-816c-4a05bb3b52a2 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:01.946679 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb2396-cfdc-447f-a29e-6dfa05ecf168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:01.947354 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb2396-cfdc-447f-a29e-6dfa05ecf168 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:01.947613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb2396-cfdc-447f-a29e-6dfa05ecf168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:01.947889 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb2396-cfdc-447f-a29e-6dfa05ecf168 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:01.949082 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb2396-cfdc-447f-a29e-6dfa05ecf168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:01.951054 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb2396-cfdc-447f-a29e-6dfa05ecf168 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:02.043348 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1135/2294] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:16:01 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:02.047552 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8a513-73b4-494f-8f6e-c1c9de089aca None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:02.060601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8a513-73b4-494f-8f6e-c1c9de089aca None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:02.113749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb30db2-e558-4d76-9d4e-ff8829f9b8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:02.114416 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30db2-e558-4d76-9d4e-ff8829f9b8ea admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:02.114702 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30db2-e558-4d76-9d4e-ff8829f9b8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:02.114983 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30db2-e558-4d76-9d4e-ff8829f9b8ea admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:02.115663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb30db2-e558-4d76-9d4e-ff8829f9b8ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:02.117641 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb30db2-e558-4d76-9d4e-ff8829f9b8ea admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:02.224293 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1160/2295] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:16:02 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:02.228218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb2396-cfdc-447f-a29e-6dfa05ecf168 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:02.239052 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb2396-cfdc-447f-a29e-6dfa05ecf168 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:02.243575 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9441d14-87e8-4721-a542-90977b547e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:02.258270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9441d14-87e8-4721-a542-90977b547e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:02.258270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9441d14-87e8-4721-a542-90977b547e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:02.258270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9441d14-87e8-4721-a542-90977b547e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:02.258270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9441d14-87e8-4721-a542-90977b547e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:02.258270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9441d14-87e8-4721-a542-90977b547e31 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:02.258270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1136/2296] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:02.261002 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb30db2-e558-4d76-9d4e-ff8829f9b8ea admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:02.271209 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb30db2-e558-4d76-9d4e-ff8829f9b8ea admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:02.275943 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18310fe-9feb-45f7-9e3a-fbe2a38c8ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:02.277344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18310fe-9feb-45f7-9e3a-fbe2a38c8ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:02.277626 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18310fe-9feb-45f7-9e3a-fbe2a38c8ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:02.277898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18310fe-9feb-45f7-9e3a-fbe2a38c8ce3 admin admin] PATH_INFO: `/v3/projects/7674fb981ab846f99f4b8f7647ead115/users/46524fc7094a4d3ba4435056474b528b/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:02.292830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18310fe-9feb-45f7-9e3a-fbe2a38c8ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7674fb981ab846f99f4b8f7647ead115, user_id=46524fc7094a4d3ba4435056474b528b, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:02.295905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18310fe-9feb-45f7-9e3a-fbe2a38c8ce3 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:02.366724 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1161/2297] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:16:02 2022] PUT /identity/v3/projects/7674fb981ab846f99f4b8f7647ead115/users/46524fc7094a4d3ba4435056474b528b/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:02.370869 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9441d14-87e8-4721-a542-90977b547e31 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:02.381146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9441d14-87e8-4721-a542-90977b547e31 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:02.434228 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43fedf-8a24-4758-8379-7050265f71fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:02.434871 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43fedf-8a24-4758-8379-7050265f71fc admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:02.435147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43fedf-8a24-4758-8379-7050265f71fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:02.435416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43fedf-8a24-4758-8379-7050265f71fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:02.436123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43fedf-8a24-4758-8379-7050265f71fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:02.437784 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43fedf-8a24-4758-8379-7050265f71fc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:02.447000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1137/2298] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:02.451192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18310fe-9feb-45f7-9e3a-fbe2a38c8ce3 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:02.461257 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18310fe-9feb-45f7-9e3a-fbe2a38c8ce3 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:02.466402 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf1e63-f10f-4214-9905-44f44b2cf85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:02.467273 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf1e63-f10f-4214-9905-44f44b2cf85a admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:02.467559 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf1e63-f10f-4214-9905-44f44b2cf85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:02.467837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf1e63-f10f-4214-9905-44f44b2cf85a admin admin] PATH_INFO: `/v3/projects/7674fb981ab846f99f4b8f7647ead115/users/46524fc7094a4d3ba4435056474b528b/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:02.469825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf1e63-f10f-4214-9905-44f44b2cf85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7674fb981ab846f99f4b8f7647ead115, user_id=46524fc7094a4d3ba4435056474b528b, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:02.472446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf1e63-f10f-4214-9905-44f44b2cf85a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:02.482914 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1162/2299] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:16:02 2022] PUT /identity/v3/projects/7674fb981ab846f99f4b8f7647ead115/users/46524fc7094a4d3ba4435056474b528b/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:02.493800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25eb27-6fed-48e5-83d4-644f787c0ea4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:02.494093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25eb27-6fed-48e5-83d4-644f787c0ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:02.494377 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25eb27-6fed-48e5-83d4-644f787c0ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:02.519547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-cb25eb27-6fed-48e5-83d4-644f787c0ea4 None None] MFA Rules not processed for user `46524fc7094a4d3ba4435056474b528b`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:02.520743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-cb25eb27-6fed-48e5-83d4-644f787c0ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:02.585925 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1138/2300] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:16:02.597922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf1e63-f10f-4214-9905-44f44b2cf85a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:02.599652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4fdf1e63-f10f-4214-9905-44f44b2cf85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:02.654123 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf1e63-f10f-4214-9905-44f44b2cf85a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:02.657988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21c5c2-8d6c-4f88-9dab-9b82d194767e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:02.658637 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21c5c2-8d6c-4f88-9dab-9b82d194767e service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:02.658923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21c5c2-8d6c-4f88-9dab-9b82d194767e service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:02.659202 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21c5c2-8d6c-4f88-9dab-9b82d194767e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:02.668234 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21c5c2-8d6c-4f88-9dab-9b82d194767e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:02.671033 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21c5c2-8d6c-4f88-9dab-9b82d194767e service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:02.679807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1163/2301] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:02.743139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25eb27-6fed-48e5-83d4-644f787c0ea4 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:02.802325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25eb27-6fed-48e5-83d4-644f787c0ea4 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:02.806875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c75493-78e2-4ca3-a335-4d3584e3c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:02.807760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75493-78e2-4ca3-a335-4d3584e3c0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:02.808039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75493-78e2-4ca3-a335-4d3584e3c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:02.808314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75493-78e2-4ca3-a335-4d3584e3c0e8 admin admin] PATH_INFO: `/v3/users/2487bbfec764448e9ebef30f67066d6f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:02.809521 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c75493-78e2-4ca3-a335-4d3584e3c0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2487bbfec764448e9ebef30f67066d6f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:02.811505 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c75493-78e2-4ca3-a335-4d3584e3c0e8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:02.980478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f0c75493-78e2-4ca3-a335-4d3584e3c0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2487bbfec764448e9ebef30f67066d6f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:02.981386 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f0c75493-78e2-4ca3-a335-4d3584e3c0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2487bbfec764448e9ebef30f67066d6f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:02.982178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f0c75493-78e2-4ca3-a335-4d3584e3c0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2487bbfec764448e9ebef30f67066d6f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:03.047295 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f0c75493-78e2-4ca3-a335-4d3584e3c0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2487bbfec764448e9ebef30f67066d6f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:03.059938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f0c75493-78e2-4ca3-a335-4d3584e3c0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2487bbfec764448e9ebef30f67066d6f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:03.071871 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1139/2302] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:16:02 2022] DELETE /identity/v3/users/2487bbfec764448e9ebef30f67066d6f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:03.076998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535b88c-2555-4ea6-b226-15c2ced72fbc None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:03.077319 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535b88c-2555-4ea6-b226-15c2ced72fbc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:03.077599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535b88c-2555-4ea6-b226-15c2ced72fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:03.094587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-1535b88c-2555-4ea6-b226-15c2ced72fbc None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:03.095765 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1535b88c-2555-4ea6-b226-15c2ced72fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:03.151923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1164/2303] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:03.161573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c75493-78e2-4ca3-a335-4d3584e3c0e8 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:03.162978 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f0c75493-78e2-4ca3-a335-4d3584e3c0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:03.218880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c75493-78e2-4ca3-a335-4d3584e3c0e8 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:03.222568 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f7f29-5ae9-4aa2-9437-5f7b1a19e7d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:03.223207 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f7f29-5ae9-4aa2-9437-5f7b1a19e7d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:03.223490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f7f29-5ae9-4aa2-9437-5f7b1a19e7d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:03.223768 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f7f29-5ae9-4aa2-9437-5f7b1a19e7d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:03.233268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f7f29-5ae9-4aa2-9437-5f7b1a19e7d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:03.234683 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f7f29-5ae9-4aa2-9437-5f7b1a19e7d1 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:03.243924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1140/2304] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:03.649275 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535b88c-2555-4ea6-b226-15c2ced72fbc None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:03.652094 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1535b88c-2555-4ea6-b226-15c2ced72fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:03.671609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535b88c-2555-4ea6-b226-15c2ced72fbc None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:03.677679 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:03.679408 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:03.679408 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:03.679408 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] PATH_INFO: `/v3/projects/dd796dd8c36a4bb7a248d1775adaa7f1` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:03.681427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd796dd8c36a4bb7a248d1775adaa7f1)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:03.686521 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:03.795607 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd796dd8c36a4bb7a248d1775adaa7f1', 'request_id': 'req-333c916b-8679-4f99-a6e2-5908d573866e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:03.887475 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd796dd8c36a4bb7a248d1775adaa7f1', 'request_id': 'req-333c916b-8679-4f99-a6e2-5908d573866e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:03.893804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd796dd8c36a4bb7a248d1775adaa7f1', 'request_id': 'req-333c916b-8679-4f99-a6e2-5908d573866e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:03.903728 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] The token cache is being invalidate because project dd796dd8c36a4bb7a248d1775adaa7f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:16:03.904013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:03.904808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:03.906365 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1165/2305] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:16:03 2022] DELETE /identity/v3/projects/dd796dd8c36a4bb7a248d1775adaa7f1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:03.910343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f7f29-5ae9-4aa2-9437-5f7b1a19e7d1 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:03.920138 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f7f29-5ae9-4aa2-9437-5f7b1a19e7d1 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:03.981025 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d04ca6-cab7-417c-afe0-7849aee714c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:03.981929 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d04ca6-cab7-417c-afe0-7849aee714c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:03.982212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d04ca6-cab7-417c-afe0-7849aee714c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:03.982518 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d04ca6-cab7-417c-afe0-7849aee714c7 admin admin] PATH_INFO: `/v3/users/46524fc7094a4d3ba4435056474b528b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:03.983716 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d04ca6-cab7-417c-afe0-7849aee714c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46524fc7094a4d3ba4435056474b528b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:03.985730 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d04ca6-cab7-417c-afe0-7849aee714c7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:04.128947 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16d04ca6-cab7-417c-afe0-7849aee714c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46524fc7094a4d3ba4435056474b528b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:04.129562 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16d04ca6-cab7-417c-afe0-7849aee714c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46524fc7094a4d3ba4435056474b528b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:04.130166 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16d04ca6-cab7-417c-afe0-7849aee714c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46524fc7094a4d3ba4435056474b528b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:04.184495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16d04ca6-cab7-417c-afe0-7849aee714c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46524fc7094a4d3ba4435056474b528b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:04.196319 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16d04ca6-cab7-417c-afe0-7849aee714c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46524fc7094a4d3ba4435056474b528b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:04.208392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1141/2306] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:16:03 2022] DELETE /identity/v3/users/46524fc7094a4d3ba4435056474b528b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:16:04.568587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:04.570040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:04.583641 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c916b-8679-4f99-a6e2-5908d573866e admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:04.639865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f6f11-d2d5-4ff4-be9c-07916371994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:04.640739 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f6f11-d2d5-4ff4-be9c-07916371994f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:04.641018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f6f11-d2d5-4ff4-be9c-07916371994f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:04.641324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f6f11-d2d5-4ff4-be9c-07916371994f admin admin] PATH_INFO: `/v3/projects/7674fb981ab846f99f4b8f7647ead115` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:04.642571 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f6f11-d2d5-4ff4-be9c-07916371994f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7674fb981ab846f99f4b8f7647ead115)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:04.644457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f6f11-d2d5-4ff4-be9c-07916371994f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:04.767603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5c5f6f11-d2d5-4ff4-be9c-07916371994f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7674fb981ab846f99f4b8f7647ead115', 'request_id': 'req-5c5f6f11-d2d5-4ff4-be9c-07916371994f'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:04.818505 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5c5f6f11-d2d5-4ff4-be9c-07916371994f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7674fb981ab846f99f4b8f7647ead115', 'request_id': 'req-5c5f6f11-d2d5-4ff4-be9c-07916371994f'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:04.825262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5c5f6f11-d2d5-4ff4-be9c-07916371994f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7674fb981ab846f99f4b8f7647ead115', 'request_id': 'req-5c5f6f11-d2d5-4ff4-be9c-07916371994f'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:04.835074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5c5f6f11-d2d5-4ff4-be9c-07916371994f admin admin] The token cache is being invalidate because project 7674fb981ab846f99f4b8f7647ead115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:16:04.835360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5c5f6f11-d2d5-4ff4-be9c-07916371994f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:04.835983 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5c5f6f11-d2d5-4ff4-be9c-07916371994f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:04.837545 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1166/2307] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:16:04 2022] DELETE /identity/v3/projects/7674fb981ab846f99f4b8f7647ead115 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:16:04.842502 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b50d7c-57bc-4a87-9863-71abaa6c21ca None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:04.842867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b50d7c-57bc-4a87-9863-71abaa6c21ca None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:04.843148 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b50d7c-57bc-4a87-9863-71abaa6c21ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:04.860558 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-67b50d7c-57bc-4a87-9863-71abaa6c21ca None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:04.861783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-67b50d7c-57bc-4a87-9863-71abaa6c21ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:04.919526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1142/2308] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:04.927147 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca39f4a-3d2e-47ae-b441-61fabeca4877 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:04.927466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca39f4a-3d2e-47ae-b441-61fabeca4877 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:04.927772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca39f4a-3d2e-47ae-b441-61fabeca4877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:04.946348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-2ca39f4a-3d2e-47ae-b441-61fabeca4877 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:04.947667 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2ca39f4a-3d2e-47ae-b441-61fabeca4877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:04.955761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1167/2309] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:16:04.959937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b50d7c-57bc-4a87-9863-71abaa6c21ca None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:04.969704 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b50d7c-57bc-4a87-9863-71abaa6c21ca None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:04.974561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e482be-2568-45d2-bcbc-a45e6476d627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:04.975220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e482be-2568-45d2-bcbc-a45e6476d627 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:04.975506 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e482be-2568-45d2-bcbc-a45e6476d627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:04.975785 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e482be-2568-45d2-bcbc-a45e6476d627 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:04.976566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e482be-2568-45d2-bcbc-a45e6476d627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:16:04.976875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e482be-2568-45d2-bcbc-a45e6476d627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:04.978614 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e482be-2568-45d2-bcbc-a45e6476d627 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:04.990371 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1143/2310] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:16:04.995417 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca39f4a-3d2e-47ae-b441-61fabeca4877 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:05.004519 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca39f4a-3d2e-47ae-b441-61fabeca4877 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:05.009212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf582875-23f6-428e-a1e9-8477fbd27a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:05.009853 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf582875-23f6-428e-a1e9-8477fbd27a2d admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:05.010136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf582875-23f6-428e-a1e9-8477fbd27a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:05.010417 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf582875-23f6-428e-a1e9-8477fbd27a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:05.011105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf582875-23f6-428e-a1e9-8477fbd27a2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:05.012987 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf582875-23f6-428e-a1e9-8477fbd27a2d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:05.093945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1168/2311] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:16:04 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:05.098064 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e482be-2568-45d2-bcbc-a45e6476d627 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:05.108812 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e482be-2568-45d2-bcbc-a45e6476d627 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:05.161250 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9291-119f-484f-8f0a-5f5822dd1342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:05.161917 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9291-119f-484f-8f0a-5f5822dd1342 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:05.162201 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9291-119f-484f-8f0a-5f5822dd1342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:05.162478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9291-119f-484f-8f0a-5f5822dd1342 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:05.163173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f9291-119f-484f-8f0a-5f5822dd1342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:05.165158 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f9291-119f-484f-8f0a-5f5822dd1342 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:05.241390 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1144/2312] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:16:05 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:05.245634 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf582875-23f6-428e-a1e9-8477fbd27a2d admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:05.255903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf582875-23f6-428e-a1e9-8477fbd27a2d admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:05.260612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1012e-f90c-401c-bf0a-5867a5c4404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:05.261324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1012e-f90c-401c-bf0a-5867a5c4404c admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:05.261609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1012e-f90c-401c-bf0a-5867a5c4404c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:05.261885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1012e-f90c-401c-bf0a-5867a5c4404c admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:05.262610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1012e-f90c-401c-bf0a-5867a5c4404c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:05.264194 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1012e-f90c-401c-bf0a-5867a5c4404c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:05.274315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1169/2313] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:05.282000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9291-119f-484f-8f0a-5f5822dd1342 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:05.292905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9291-119f-484f-8f0a-5f5822dd1342 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:05.297937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048c5ee-53ee-447c-bdcf-24aee4ffc848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:05.298596 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048c5ee-53ee-447c-bdcf-24aee4ffc848 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:05.298867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048c5ee-53ee-447c-bdcf-24aee4ffc848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:05.299144 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048c5ee-53ee-447c-bdcf-24aee4ffc848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:05.299867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048c5ee-53ee-447c-bdcf-24aee4ffc848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:05.301625 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048c5ee-53ee-447c-bdcf-24aee4ffc848 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:05.311181 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1145/2314] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:16:05.315171 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1012e-f90c-401c-bf0a-5867a5c4404c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:05.325021 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1012e-f90c-401c-bf0a-5867a5c4404c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:05.329760 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de615c-f3fa-4700-8fe0-e1c8b3ec6e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:05.330628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de615c-f3fa-4700-8fe0-e1c8b3ec6e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:05.330912 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de615c-f3fa-4700-8fe0-e1c8b3ec6e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:05.331188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de615c-f3fa-4700-8fe0-e1c8b3ec6e2e admin admin] PATH_INFO: `/v3/projects/64385b5a0b024c9bb5aecefd5b861f0b/users/07028a9303a84dd3b73b5ffe48139a81/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:05.345559 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de615c-f3fa-4700-8fe0-e1c8b3ec6e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64385b5a0b024c9bb5aecefd5b861f0b, user_id=07028a9303a84dd3b73b5ffe48139a81, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:05.348180 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de615c-f3fa-4700-8fe0-e1c8b3ec6e2e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:05.429299 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1170/2315] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:16:05 2022] PUT /identity/v3/projects/64385b5a0b024c9bb5aecefd5b861f0b/users/07028a9303a84dd3b73b5ffe48139a81/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:05.440655 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400b581-bfa7-4344-85ea-d6438e9e4e76 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:05.440968 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400b581-bfa7-4344-85ea-d6438e9e4e76 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:05.441287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400b581-bfa7-4344-85ea-d6438e9e4e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:05.467477 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7400b581-bfa7-4344-85ea-d6438e9e4e76 None None] MFA Rules not processed for user `07028a9303a84dd3b73b5ffe48139a81`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:05.468686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7400b581-bfa7-4344-85ea-d6438e9e4e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:05.531376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1146/2316] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:05.535806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de615c-f3fa-4700-8fe0-e1c8b3ec6e2e admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:05.596040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de615c-f3fa-4700-8fe0-e1c8b3ec6e2e admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:05.600697 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e0eb3-c7d0-41db-9ac8-e931c9c6c984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:05.604968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e0eb3-c7d0-41db-9ac8-e931c9c6c984 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:05.604968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e0eb3-c7d0-41db-9ac8-e931c9c6c984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:05.604968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e0eb3-c7d0-41db-9ac8-e931c9c6c984 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:05.604968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e0eb3-c7d0-41db-9ac8-e931c9c6c984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:05.604968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e0eb3-c7d0-41db-9ac8-e931c9c6c984 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:05.695098 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1171/2317] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:16:05 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:05.698991 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400b581-bfa7-4344-85ea-d6438e9e4e76 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:05.709901 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400b581-bfa7-4344-85ea-d6438e9e4e76 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:05.763747 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141b51c-588e-455d-8fc1-93bd3aa7a20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:05.764475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b51c-588e-455d-8fc1-93bd3aa7a20e admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:05.764755 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b51c-588e-455d-8fc1-93bd3aa7a20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:05.765028 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b51c-588e-455d-8fc1-93bd3aa7a20e admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:05.765743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141b51c-588e-455d-8fc1-93bd3aa7a20e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:05.767722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141b51c-588e-455d-8fc1-93bd3aa7a20e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:05.846552 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1147/2318] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:16:05 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:16:05.850458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e0eb3-c7d0-41db-9ac8-e931c9c6c984 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:05.860688 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e0eb3-c7d0-41db-9ac8-e931c9c6c984 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:05.865312 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518f5c8-a510-40c2-830f-fe685b5e18f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:05.865970 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518f5c8-a510-40c2-830f-fe685b5e18f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:05.866253 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518f5c8-a510-40c2-830f-fe685b5e18f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:05.866526 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518f5c8-a510-40c2-830f-fe685b5e18f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:05.867240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518f5c8-a510-40c2-830f-fe685b5e18f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:05.868835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518f5c8-a510-40c2-830f-fe685b5e18f3 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:05.879043 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1172/2319] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:05.883035 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141b51c-588e-455d-8fc1-93bd3aa7a20e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:05.893533 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141b51c-588e-455d-8fc1-93bd3aa7a20e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:05.898061 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991739f-0a03-4140-9da1-3b612f2fa750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:05.898922 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991739f-0a03-4140-9da1-3b612f2fa750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:05.899201 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991739f-0a03-4140-9da1-3b612f2fa750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:05.899478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991739f-0a03-4140-9da1-3b612f2fa750 admin admin] PATH_INFO: `/v3/projects/605053cc0e2e43a0a9f9fb70399b8e0a/users/eaf4c70c22544a87b30394a259bf91f0/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:05.913903 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991739f-0a03-4140-9da1-3b612f2fa750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=605053cc0e2e43a0a9f9fb70399b8e0a, user_id=eaf4c70c22544a87b30394a259bf91f0, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:05.916584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991739f-0a03-4140-9da1-3b612f2fa750 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:05.987176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1148/2320] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:16:05 2022] PUT /identity/v3/projects/605053cc0e2e43a0a9f9fb70399b8e0a/users/eaf4c70c22544a87b30394a259bf91f0/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:05.991526 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518f5c8-a510-40c2-830f-fe685b5e18f3 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:06.002242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518f5c8-a510-40c2-830f-fe685b5e18f3 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:06.056276 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45592a-8840-4460-b230-b7fe724e73f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:06.056940 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45592a-8840-4460-b230-b7fe724e73f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:06.057730 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45592a-8840-4460-b230-b7fe724e73f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:06.058018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45592a-8840-4460-b230-b7fe724e73f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:06.058734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45592a-8840-4460-b230-b7fe724e73f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:06.060335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45592a-8840-4460-b230-b7fe724e73f3 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:06.069699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1173/2321] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:06.074441 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991739f-0a03-4140-9da1-3b612f2fa750 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:06.084677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991739f-0a03-4140-9da1-3b612f2fa750 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:06.089316 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef0d50-775d-48e4-890b-b6224ba7b078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:06.090178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef0d50-775d-48e4-890b-b6224ba7b078 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:06.090455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef0d50-775d-48e4-890b-b6224ba7b078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:06.090728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef0d50-775d-48e4-890b-b6224ba7b078 admin admin] PATH_INFO: `/v3/projects/605053cc0e2e43a0a9f9fb70399b8e0a/users/eaf4c70c22544a87b30394a259bf91f0/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:06.092668 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef0d50-775d-48e4-890b-b6224ba7b078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=605053cc0e2e43a0a9f9fb70399b8e0a, user_id=eaf4c70c22544a87b30394a259bf91f0, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:06.095366 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef0d50-775d-48e4-890b-b6224ba7b078 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:06.105109 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1149/2322] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:16:06 2022] PUT /identity/v3/projects/605053cc0e2e43a0a9f9fb70399b8e0a/users/eaf4c70c22544a87b30394a259bf91f0/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:06.114805 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444f2d6-c31e-4230-af35-6d007fb77b52 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:06.115102 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444f2d6-c31e-4230-af35-6d007fb77b52 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:06.115387 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444f2d6-c31e-4230-af35-6d007fb77b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:06.141569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a444f2d6-c31e-4230-af35-6d007fb77b52 None None] MFA Rules not processed for user `eaf4c70c22544a87b30394a259bf91f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:06.142780 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a444f2d6-c31e-4230-af35-6d007fb77b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:06.209231 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1174/2323] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:06.226683 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef0d50-775d-48e4-890b-b6224ba7b078 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:06.228493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a8ef0d50-775d-48e4-890b-b6224ba7b078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:06.284423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef0d50-775d-48e4-890b-b6224ba7b078 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:06.288047 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b94820-56b8-4690-8fd3-d3b9d9d09f7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:06.288678 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b94820-56b8-4690-8fd3-d3b9d9d09f7c service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:06.288952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b94820-56b8-4690-8fd3-d3b9d9d09f7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:06.289330 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b94820-56b8-4690-8fd3-d3b9d9d09f7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:06.298806 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b94820-56b8-4690-8fd3-d3b9d9d09f7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:06.300274 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b94820-56b8-4690-8fd3-d3b9d9d09f7c service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:06.312288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1150/2324] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:07.194529 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444f2d6-c31e-4230-af35-6d007fb77b52 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:07.203971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444f2d6-c31e-4230-af35-6d007fb77b52 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:07.208506 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b50dcb-c22e-4d5e-b628-fe3bb4e07706 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaf4c70c22544a87b30394a259bf91f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '605053cc0e2e43a0a9f9fb70399b8e0a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:07.209191 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b50dcb-c22e-4d5e-b628-fe3bb4e07706 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:07.209480 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b50dcb-c22e-4d5e-b628-fe3bb4e07706 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:07.209757 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b50dcb-c22e-4d5e-b628-fe3bb4e07706 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:07.210479 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b50dcb-c22e-4d5e-b628-fe3bb4e07706 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:16:07.210787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b50dcb-c22e-4d5e-b628-fe3bb4e07706 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:07.212394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b50dcb-c22e-4d5e-b628-fe3bb4e07706 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:07.224316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1175/2325] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:16:07.228315 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b94820-56b8-4690-8fd3-d3b9d9d09f7c service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:07.237336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b94820-56b8-4690-8fd3-d3b9d9d09f7c service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:07.241956 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe85a9-4061-4b20-b731-98cfd50f1481 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaf4c70c22544a87b30394a259bf91f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '605053cc0e2e43a0a9f9fb70399b8e0a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:07.242592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe85a9-4061-4b20-b731-98cfd50f1481 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:07.242879 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe85a9-4061-4b20-b731-98cfd50f1481 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:07.243158 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe85a9-4061-4b20-b731-98cfd50f1481 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:07.243843 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe85a9-4061-4b20-b731-98cfd50f1481 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:07.245804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe85a9-4061-4b20-b731-98cfd50f1481 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:07.328726 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1151/2326] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:16:07 2022] POST /identity/v3/projects => generated 354 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:07.332979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b50dcb-c22e-4d5e-b628-fe3bb4e07706 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:07.343484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b50dcb-c22e-4d5e-b628-fe3bb4e07706 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:07.396315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f9bfb-28ce-48b6-9fda-2e287dccc13e tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaf4c70c22544a87b30394a259bf91f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '605053cc0e2e43a0a9f9fb70399b8e0a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:07.396971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9bfb-28ce-48b6-9fda-2e287dccc13e tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:07.397287 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9bfb-28ce-48b6-9fda-2e287dccc13e tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:07.397565 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9bfb-28ce-48b6-9fda-2e287dccc13e tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:07.398311 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f9bfb-28ce-48b6-9fda-2e287dccc13e tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:16:07.398622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f9bfb-28ce-48b6-9fda-2e287dccc13e tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:07.400221 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f9bfb-28ce-48b6-9fda-2e287dccc13e tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:07.411867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1176/2327] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:16:07.446391 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe85a9-4061-4b20-b731-98cfd50f1481 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:07.457006 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe85a9-4061-4b20-b731-98cfd50f1481 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:07.461571 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61bfa0-1840-4730-aec6-6c35e6ad3906 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eaf4c70c22544a87b30394a259bf91f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '605053cc0e2e43a0a9f9fb70399b8e0a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:07.462417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61bfa0-1840-4730-aec6-6c35e6ad3906 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:07.462704 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61bfa0-1840-4730-aec6-6c35e6ad3906 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:07.462981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61bfa0-1840-4730-aec6-6c35e6ad3906 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] PATH_INFO: `/v3/projects/65574f7250a647f98b1e6d85d797a8dc` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:07.464842 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61bfa0-1840-4730-aec6-6c35e6ad3906 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] RBAC: Authorizing `identity:delete_project(project_id=65574f7250a647f98b1e6d85d797a8dc)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:07.466830 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61bfa0-1840-4730-aec6-6c35e6ad3906 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:07.561241 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-bc61bfa0-1840-4730-aec6-6c35e6ad3906 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65574f7250a647f98b1e6d85d797a8dc', 'request_id': 'req-bc61bfa0-1840-4730-aec6-6c35e6ad3906'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:07.567533 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-bc61bfa0-1840-4730-aec6-6c35e6ad3906 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65574f7250a647f98b1e6d85d797a8dc', 'request_id': 'req-bc61bfa0-1840-4730-aec6-6c35e6ad3906'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:07.572800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-bc61bfa0-1840-4730-aec6-6c35e6ad3906 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65574f7250a647f98b1e6d85d797a8dc', 'request_id': 'req-bc61bfa0-1840-4730-aec6-6c35e6ad3906'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:07.669511 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-bc61bfa0-1840-4730-aec6-6c35e6ad3906 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] The token cache is being invalidate because project 65574f7250a647f98b1e6d85d797a8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:16:07.669741 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-bc61bfa0-1840-4730-aec6-6c35e6ad3906 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:07.670382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-bc61bfa0-1840-4730-aec6-6c35e6ad3906 tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:07.671948 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1152/2328] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:16:07 2022] DELETE /identity/v3/projects/65574f7250a647f98b1e6d85d797a8dc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:08.265963 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f9bfb-28ce-48b6-9fda-2e287dccc13e tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:08.267803 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f57f9bfb-28ce-48b6-9fda-2e287dccc13e tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:08.332621 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f9bfb-28ce-48b6-9fda-2e287dccc13e tempest-VolumeQuotaClassesTest-1032088488 tempest-VolumeQuotaClassesTest-1032088488-project-admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:08.386152 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9133ed5-9c1f-488c-a46c-171f38dd6454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:08.386944 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9133ed5-9c1f-488c-a46c-171f38dd6454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:08.387226 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9133ed5-9c1f-488c-a46c-171f38dd6454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:08.387501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9133ed5-9c1f-488c-a46c-171f38dd6454 admin admin] PATH_INFO: `/v3/users/07028a9303a84dd3b73b5ffe48139a81` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:08.388675 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9133ed5-9c1f-488c-a46c-171f38dd6454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07028a9303a84dd3b73b5ffe48139a81)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:08.390660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9133ed5-9c1f-488c-a46c-171f38dd6454 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:08.562591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-e9133ed5-9c1f-488c-a46c-171f38dd6454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07028a9303a84dd3b73b5ffe48139a81'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:08.563198 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-e9133ed5-9c1f-488c-a46c-171f38dd6454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07028a9303a84dd3b73b5ffe48139a81'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:08.563888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-e9133ed5-9c1f-488c-a46c-171f38dd6454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07028a9303a84dd3b73b5ffe48139a81'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:08.575869 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-e9133ed5-9c1f-488c-a46c-171f38dd6454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07028a9303a84dd3b73b5ffe48139a81'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:08.582609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-e9133ed5-9c1f-488c-a46c-171f38dd6454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07028a9303a84dd3b73b5ffe48139a81'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:08.664449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1177/2329] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:16:08 2022] DELETE /identity/v3/users/07028a9303a84dd3b73b5ffe48139a81 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:08.669436 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82b79d-c6ec-4367-a203-239b37227f4a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:08.669884 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82b79d-c6ec-4367-a203-239b37227f4a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:08.669976 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82b79d-c6ec-4367-a203-239b37227f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:08.686991 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7c82b79d-c6ec-4367-a203-239b37227f4a None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:08.688420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7c82b79d-c6ec-4367-a203-239b37227f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:08.744995 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1153/2330] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:08.754672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9133ed5-9c1f-488c-a46c-171f38dd6454 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:08.756086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e9133ed5-9c1f-488c-a46c-171f38dd6454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:08.811240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9133ed5-9c1f-488c-a46c-171f38dd6454 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:08.814805 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f0f28-f5f2-4f25-873c-c2e6191f992e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:08.815436 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f0f28-f5f2-4f25-873c-c2e6191f992e service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:08.815722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f0f28-f5f2-4f25-873c-c2e6191f992e service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:08.815992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f0f28-f5f2-4f25-873c-c2e6191f992e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:08.825214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f0f28-f5f2-4f25-873c-c2e6191f992e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:08.826622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f0f28-f5f2-4f25-873c-c2e6191f992e service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:08.835749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1178/2331] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:09.174758 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82b79d-c6ec-4367-a203-239b37227f4a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:09.175848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7c82b79d-c6ec-4367-a203-239b37227f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:09.192268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82b79d-c6ec-4367-a203-239b37227f4a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:09.197739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:09.199178 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:09.199449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:09.199782 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] PATH_INFO: `/v3/projects/64385b5a0b024c9bb5aecefd5b861f0b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:09.200882 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64385b5a0b024c9bb5aecefd5b861f0b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:09.202860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:09.338452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64385b5a0b024c9bb5aecefd5b861f0b', 'request_id': 'req-c62a109d-4080-48b2-8c34-14d411f32244'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:09.344372 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64385b5a0b024c9bb5aecefd5b861f0b', 'request_id': 'req-c62a109d-4080-48b2-8c34-14d411f32244'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:09.350041 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64385b5a0b024c9bb5aecefd5b861f0b', 'request_id': 'req-c62a109d-4080-48b2-8c34-14d411f32244'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:09.423818 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] The token cache is being invalidate because project 64385b5a0b024c9bb5aecefd5b861f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:16:09.424108 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:09.424728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:09.426360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1154/2332] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:16:09 2022] DELETE /identity/v3/projects/64385b5a0b024c9bb5aecefd5b861f0b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:16:09.430368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f0f28-f5f2-4f25-873c-c2e6191f992e service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:09.440684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f0f28-f5f2-4f25-873c-c2e6191f992e service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:09.493694 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38abb4-e9e5-495d-97e3-868d5a8dde76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:09.494558 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38abb4-e9e5-495d-97e3-868d5a8dde76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:09.495476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38abb4-e9e5-495d-97e3-868d5a8dde76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:09.495757 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38abb4-e9e5-495d-97e3-868d5a8dde76 admin admin] PATH_INFO: `/v3/users/eaf4c70c22544a87b30394a259bf91f0` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:09.496938 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38abb4-e9e5-495d-97e3-868d5a8dde76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf4c70c22544a87b30394a259bf91f0)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:09.498887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38abb4-e9e5-495d-97e3-868d5a8dde76 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:09.625698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-da38abb4-e9e5-495d-97e3-868d5a8dde76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf4c70c22544a87b30394a259bf91f0'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:09.626374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-da38abb4-e9e5-495d-97e3-868d5a8dde76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf4c70c22544a87b30394a259bf91f0'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:09.626971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-da38abb4-e9e5-495d-97e3-868d5a8dde76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf4c70c22544a87b30394a259bf91f0'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:09.638409 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-da38abb4-e9e5-495d-97e3-868d5a8dde76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf4c70c22544a87b30394a259bf91f0'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:09.645001 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-da38abb4-e9e5-495d-97e3-868d5a8dde76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf4c70c22544a87b30394a259bf91f0'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:09.721590 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1179/2333] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:16:09 2022] DELETE /identity/v3/users/eaf4c70c22544a87b30394a259bf91f0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:10.100317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:10.101850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:10.114895 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a109d-4080-48b2-8c34-14d411f32244 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:10.171721 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae79de-c8af-40ae-824c-16e82f67b874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:10.172592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae79de-c8af-40ae-824c-16e82f67b874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:10.172874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae79de-c8af-40ae-824c-16e82f67b874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:10.173291 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae79de-c8af-40ae-824c-16e82f67b874 admin admin] PATH_INFO: `/v3/projects/605053cc0e2e43a0a9f9fb70399b8e0a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:10.174486 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae79de-c8af-40ae-824c-16e82f67b874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=605053cc0e2e43a0a9f9fb70399b8e0a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:10.176453 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae79de-c8af-40ae-824c-16e82f67b874 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:10.280735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3dae79de-c8af-40ae-824c-16e82f67b874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605053cc0e2e43a0a9f9fb70399b8e0a', 'request_id': 'req-3dae79de-c8af-40ae-824c-16e82f67b874'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:10.286576 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3dae79de-c8af-40ae-824c-16e82f67b874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605053cc0e2e43a0a9f9fb70399b8e0a', 'request_id': 'req-3dae79de-c8af-40ae-824c-16e82f67b874'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:10.291940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3dae79de-c8af-40ae-824c-16e82f67b874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605053cc0e2e43a0a9f9fb70399b8e0a', 'request_id': 'req-3dae79de-c8af-40ae-824c-16e82f67b874'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:10.382821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3dae79de-c8af-40ae-824c-16e82f67b874 admin admin] The token cache is being invalidate because project 605053cc0e2e43a0a9f9fb70399b8e0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:16:10.383112 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3dae79de-c8af-40ae-824c-16e82f67b874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:10.383742 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3dae79de-c8af-40ae-824c-16e82f67b874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:10.385342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1155/2334] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:16:10 2022] DELETE /identity/v3/projects/605053cc0e2e43a0a9f9fb70399b8e0a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:10.390247 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3c4d-2c28-4ff3-98a5-0836cdf24e35 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:10.390540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3c4d-2c28-4ff3-98a5-0836cdf24e35 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:10.390849 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3c4d-2c28-4ff3-98a5-0836cdf24e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:10.408733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-12ac3c4d-2c28-4ff3-98a5-0836cdf24e35 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:10.409954 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-12ac3c4d-2c28-4ff3-98a5-0836cdf24e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:10.467726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1180/2335] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:10.475384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a426e4-67fb-45f3-8503-5ff471c96d73 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:10.475674 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a426e4-67fb-45f3-8503-5ff471c96d73 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:10.475969 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a426e4-67fb-45f3-8503-5ff471c96d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:10.494220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-30a426e4-67fb-45f3-8503-5ff471c96d73 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:10.495417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-30a426e4-67fb-45f3-8503-5ff471c96d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:10.503245 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1156/2336] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:10.507165 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac3c4d-2c28-4ff3-98a5-0836cdf24e35 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:10.516740 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac3c4d-2c28-4ff3-98a5-0836cdf24e35 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:10.521367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a22109-6aa0-4460-86fa-7fcb3ea550a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:10.522012 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a22109-6aa0-4460-86fa-7fcb3ea550a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:10.522297 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a22109-6aa0-4460-86fa-7fcb3ea550a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:10.522574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a22109-6aa0-4460-86fa-7fcb3ea550a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:10.523295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a22109-6aa0-4460-86fa-7fcb3ea550a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:16:10.523602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a22109-6aa0-4460-86fa-7fcb3ea550a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:10.525217 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a22109-6aa0-4460-86fa-7fcb3ea550a4 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:10.536956 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1181/2337] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:16:10.541183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a426e4-67fb-45f3-8503-5ff471c96d73 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:10.551098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a426e4-67fb-45f3-8503-5ff471c96d73 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:10.555779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905866f-8035-46e2-a668-b405ac563fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:10.556417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905866f-8035-46e2-a668-b405ac563fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:10.556702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905866f-8035-46e2-a668-b405ac563fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:10.556978 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905866f-8035-46e2-a668-b405ac563fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:10.557694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905866f-8035-46e2-a668-b405ac563fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:10.559625 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905866f-8035-46e2-a668-b405ac563fa4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:10.642156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1157/2338] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:16:10 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:16:10.646335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a22109-6aa0-4460-86fa-7fcb3ea550a4 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:10.657295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a22109-6aa0-4460-86fa-7fcb3ea550a4 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:10.712224 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d44e5a-20c1-466c-bc22-ca17c87d4ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:10.712927 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d44e5a-20c1-466c-bc22-ca17c87d4ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:10.713247 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d44e5a-20c1-466c-bc22-ca17c87d4ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:10.714011 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d44e5a-20c1-466c-bc22-ca17c87d4ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:10.714703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d44e5a-20c1-466c-bc22-ca17c87d4ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:10.716603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d44e5a-20c1-466c-bc22-ca17c87d4ba5 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:10.783652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1182/2339] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:16:10 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:10.787789 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905866f-8035-46e2-a668-b405ac563fa4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:10.798847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905866f-8035-46e2-a668-b405ac563fa4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:10.803480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff65b1-8640-4c14-bafb-1dbc193343a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:10.804126 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff65b1-8640-4c14-bafb-1dbc193343a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:10.804410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff65b1-8640-4c14-bafb-1dbc193343a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:10.804682 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff65b1-8640-4c14-bafb-1dbc193343a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:10.805442 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff65b1-8640-4c14-bafb-1dbc193343a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:10.807125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff65b1-8640-4c14-bafb-1dbc193343a0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:10.817418 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1158/2340] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:10.821350 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d44e5a-20c1-466c-bc22-ca17c87d4ba5 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:10.832087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d44e5a-20c1-466c-bc22-ca17c87d4ba5 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:10.836661 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4230f01-77a9-4520-aece-5a6b5867e0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:10.837342 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4230f01-77a9-4520-aece-5a6b5867e0dc admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:10.837623 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4230f01-77a9-4520-aece-5a6b5867e0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:10.837897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4230f01-77a9-4520-aece-5a6b5867e0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:10.839277 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4230f01-77a9-4520-aece-5a6b5867e0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:10.840929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4230f01-77a9-4520-aece-5a6b5867e0dc admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:10.850477 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1183/2341] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:10.854257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff65b1-8640-4c14-bafb-1dbc193343a0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:10.864054 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff65b1-8640-4c14-bafb-1dbc193343a0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:10.868571 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b6585-07ce-47a4-9b62-6a4049c32859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:10.869457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b6585-07ce-47a4-9b62-6a4049c32859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:10.869739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b6585-07ce-47a4-9b62-6a4049c32859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:10.870012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b6585-07ce-47a4-9b62-6a4049c32859 admin admin] PATH_INFO: `/v3/projects/37dcab1c4507426b95181a0c68d88e7e/users/52ad47fee34a4702ad377d09bdd9e5e7/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:10.884855 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b6585-07ce-47a4-9b62-6a4049c32859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dcab1c4507426b95181a0c68d88e7e, user_id=52ad47fee34a4702ad377d09bdd9e5e7, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:10.888263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b6585-07ce-47a4-9b62-6a4049c32859 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:10.937520 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1159/2342] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:16:10 2022] PUT /identity/v3/projects/37dcab1c4507426b95181a0c68d88e7e/users/52ad47fee34a4702ad377d09bdd9e5e7/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:10.949126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73317b58-7082-4fba-8dd1-eedf8cd8014b None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:10.949418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73317b58-7082-4fba-8dd1-eedf8cd8014b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:10.949694 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73317b58-7082-4fba-8dd1-eedf8cd8014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:10.976117 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-73317b58-7082-4fba-8dd1-eedf8cd8014b None None] MFA Rules not processed for user `52ad47fee34a4702ad377d09bdd9e5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:10.977437 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-73317b58-7082-4fba-8dd1-eedf8cd8014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:11.038281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1184/2343] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:11.042526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b6585-07ce-47a4-9b62-6a4049c32859 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:11.102063 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b6585-07ce-47a4-9b62-6a4049c32859 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:11.106818 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b44f7-f903-498c-bfea-2ad789ff572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:11.107466 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b44f7-f903-498c-bfea-2ad789ff572b admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:11.107748 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b44f7-f903-498c-bfea-2ad789ff572b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:11.108170 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b44f7-f903-498c-bfea-2ad789ff572b admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:11.108707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b44f7-f903-498c-bfea-2ad789ff572b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:11.110715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b44f7-f903-498c-bfea-2ad789ff572b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:11.179320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1160/2344] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:16:11 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:11.183608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73317b58-7082-4fba-8dd1-eedf8cd8014b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:11.194700 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73317b58-7082-4fba-8dd1-eedf8cd8014b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:11.251598 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1572f-a0e8-43fd-b4f1-9637779853bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:11.252271 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1572f-a0e8-43fd-b4f1-9637779853bf admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:11.252556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1572f-a0e8-43fd-b4f1-9637779853bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:11.252830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1572f-a0e8-43fd-b4f1-9637779853bf admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:11.253561 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1572f-a0e8-43fd-b4f1-9637779853bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:11.255470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1572f-a0e8-43fd-b4f1-9637779853bf admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:11.350363 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1185/2345] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:16:11 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:11.354292 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b44f7-f903-498c-bfea-2ad789ff572b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:11.365655 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b44f7-f903-498c-bfea-2ad789ff572b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:11.370820 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214abc0-a421-4ddb-98dc-85b322a2f5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:11.371517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214abc0-a421-4ddb-98dc-85b322a2f5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:11.371801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214abc0-a421-4ddb-98dc-85b322a2f5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:11.372078 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214abc0-a421-4ddb-98dc-85b322a2f5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:11.372798 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214abc0-a421-4ddb-98dc-85b322a2f5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:11.374475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214abc0-a421-4ddb-98dc-85b322a2f5d5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:11.384046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1161/2346] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:11.388719 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1572f-a0e8-43fd-b4f1-9637779853bf admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:11.398474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1572f-a0e8-43fd-b4f1-9637779853bf admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:11.403094 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac97937-3e13-4af6-b1d4-1624b10ce342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:11.403738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac97937-3e13-4af6-b1d4-1624b10ce342 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:11.404018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac97937-3e13-4af6-b1d4-1624b10ce342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:11.404289 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac97937-3e13-4af6-b1d4-1624b10ce342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:11.405000 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac97937-3e13-4af6-b1d4-1624b10ce342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:11.406599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac97937-3e13-4af6-b1d4-1624b10ce342 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:11.417496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1186/2347] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:11.421783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214abc0-a421-4ddb-98dc-85b322a2f5d5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:11.431545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214abc0-a421-4ddb-98dc-85b322a2f5d5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:11.436612 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280811a-9d79-4b0b-ae66-c982a14cc466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:11.437505 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280811a-9d79-4b0b-ae66-c982a14cc466 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:11.437786 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280811a-9d79-4b0b-ae66-c982a14cc466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:11.438057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280811a-9d79-4b0b-ae66-c982a14cc466 admin admin] PATH_INFO: `/v3/projects/8cfc65b932b14ef29b512d8bbfda8bb1/users/9fad639c2b8c411d94180a086b753be2/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:11.452691 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280811a-9d79-4b0b-ae66-c982a14cc466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfc65b932b14ef29b512d8bbfda8bb1, user_id=9fad639c2b8c411d94180a086b753be2, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:11.455402 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280811a-9d79-4b0b-ae66-c982a14cc466 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:11.527094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1162/2348] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:16:11 2022] PUT /identity/v3/projects/8cfc65b932b14ef29b512d8bbfda8bb1/users/9fad639c2b8c411d94180a086b753be2/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:11.537343 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef799c7a-e7d8-4190-94ae-f53895f6f5d7 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:11.537803 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef799c7a-e7d8-4190-94ae-f53895f6f5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:11.537949 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef799c7a-e7d8-4190-94ae-f53895f6f5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:11.564793 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-ef799c7a-e7d8-4190-94ae-f53895f6f5d7 None None] MFA Rules not processed for user `9fad639c2b8c411d94180a086b753be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:11.566046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ef799c7a-e7d8-4190-94ae-f53895f6f5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:11.627333 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1187/2349] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:11.631702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280811a-9d79-4b0b-ae66-c982a14cc466 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:11.691902 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280811a-9d79-4b0b-ae66-c982a14cc466 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:11.698079 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0f5fe-837a-4612-a64f-06019c915128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:11.698749 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0f5fe-837a-4612-a64f-06019c915128 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:11.699033 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0f5fe-837a-4612-a64f-06019c915128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:11.699309 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0f5fe-837a-4612-a64f-06019c915128 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:11.700021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0f5fe-837a-4612-a64f-06019c915128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:11.702018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0f5fe-837a-4612-a64f-06019c915128 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:11.769637 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1163/2350] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:16:11 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:11.773469 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef799c7a-e7d8-4190-94ae-f53895f6f5d7 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:11.784696 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef799c7a-e7d8-4190-94ae-f53895f6f5d7 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:11.839903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f20e0-73e6-4001-822b-6389211baecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:11.840583 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f20e0-73e6-4001-822b-6389211baecc admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:11.840867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f20e0-73e6-4001-822b-6389211baecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:11.841188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f20e0-73e6-4001-822b-6389211baecc admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:11.841885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f20e0-73e6-4001-822b-6389211baecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:11.843788 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f20e0-73e6-4001-822b-6389211baecc admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:11.938252 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1188/2351] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:16:11 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:11.942168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0f5fe-837a-4612-a64f-06019c915128 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:11.952849 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0f5fe-837a-4612-a64f-06019c915128 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:11.957527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2cc2c-a3b2-431c-b152-641e01356417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:11.958170 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2cc2c-a3b2-431c-b152-641e01356417 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:11.958450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2cc2c-a3b2-431c-b152-641e01356417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:11.958728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2cc2c-a3b2-431c-b152-641e01356417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:11.959443 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2cc2c-a3b2-431c-b152-641e01356417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:11.961101 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2cc2c-a3b2-431c-b152-641e01356417 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:11.971778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1164/2352] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:16:11.975720 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f20e0-73e6-4001-822b-6389211baecc admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:11.985560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f20e0-73e6-4001-822b-6389211baecc admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:11.990143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76a706-e31e-4ddb-a77b-36fe72cac32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:11.991013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76a706-e31e-4ddb-a77b-36fe72cac32b admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:11.991295 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76a706-e31e-4ddb-a77b-36fe72cac32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:11.991569 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76a706-e31e-4ddb-a77b-36fe72cac32b admin admin] PATH_INFO: `/v3/projects/5b0f5b30ece1443a9b9edbf8114ecae3/users/8437a486e8ab420d9d8b50d5fafa9df7/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:12.006138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76a706-e31e-4ddb-a77b-36fe72cac32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0f5b30ece1443a9b9edbf8114ecae3, user_id=8437a486e8ab420d9d8b50d5fafa9df7, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:12.008850 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76a706-e31e-4ddb-a77b-36fe72cac32b admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:12.064061 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1189/2353] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:16:11 2022] PUT /identity/v3/projects/5b0f5b30ece1443a9b9edbf8114ecae3/users/8437a486e8ab420d9d8b50d5fafa9df7/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:12.068273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2cc2c-a3b2-431c-b152-641e01356417 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:12.079492 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2cc2c-a3b2-431c-b152-641e01356417 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:12.131802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e0dda-6a89-4e1b-9073-42ee82dc5f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:12.132472 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e0dda-6a89-4e1b-9073-42ee82dc5f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:12.132727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e0dda-6a89-4e1b-9073-42ee82dc5f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:12.133002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e0dda-6a89-4e1b-9073-42ee82dc5f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:12.133744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e0dda-6a89-4e1b-9073-42ee82dc5f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:12.136021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e0dda-6a89-4e1b-9073-42ee82dc5f35 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:12.145277 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1165/2354] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:12.149487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76a706-e31e-4ddb-a77b-36fe72cac32b admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:12.159525 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76a706-e31e-4ddb-a77b-36fe72cac32b admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:12.164103 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e6760-782a-4499-836c-420d3e2ffd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:12.164971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e6760-782a-4499-836c-420d3e2ffd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:12.165280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e6760-782a-4499-836c-420d3e2ffd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:12.165551 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e6760-782a-4499-836c-420d3e2ffd07 admin admin] PATH_INFO: `/v3/projects/5b0f5b30ece1443a9b9edbf8114ecae3/users/8437a486e8ab420d9d8b50d5fafa9df7/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:12.167600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e6760-782a-4499-836c-420d3e2ffd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0f5b30ece1443a9b9edbf8114ecae3, user_id=8437a486e8ab420d9d8b50d5fafa9df7, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:12.170633 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e6760-782a-4499-836c-420d3e2ffd07 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:12.182089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1190/2355] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:16:12 2022] PUT /identity/v3/projects/5b0f5b30ece1443a9b9edbf8114ecae3/users/8437a486e8ab420d9d8b50d5fafa9df7/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:12.192571 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e3f5-80de-4ce3-87b1-85d191703a6f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:12.192797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e3f5-80de-4ce3-87b1-85d191703a6f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:12.193125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e3f5-80de-4ce3-87b1-85d191703a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:12.218645 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6880e3f5-80de-4ce3-87b1-85d191703a6f None None] MFA Rules not processed for user `8437a486e8ab420d9d8b50d5fafa9df7`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:12.219824 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6880e3f5-80de-4ce3-87b1-85d191703a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:12.283182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1166/2356] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:12.294722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e6760-782a-4499-836c-420d3e2ffd07 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:12.296381 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-017e6760-782a-4499-836c-420d3e2ffd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:12.351677 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e6760-782a-4499-836c-420d3e2ffd07 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:12.355871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ff0f2-11a9-4f93-ab3c-055650ea553e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:12.356508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ff0f2-11a9-4f93-ab3c-055650ea553e service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:12.356796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ff0f2-11a9-4f93-ab3c-055650ea553e service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:12.357113 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ff0f2-11a9-4f93-ab3c-055650ea553e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:12.366077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ff0f2-11a9-4f93-ab3c-055650ea553e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:12.367524 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ff0f2-11a9-4f93-ab3c-055650ea553e service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:12.377545 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1191/2357] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:13.355914 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880e3f5-80de-4ce3-87b1-85d191703a6f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:13.357383 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6880e3f5-80de-4ce3-87b1-85d191703a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:13.369026 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880e3f5-80de-4ce3-87b1-85d191703a6f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:13.372669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a287436-497f-4615-92b3-27602ab31e13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:13.376287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a287436-497f-4615-92b3-27602ab31e13 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:13.376287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a287436-497f-4615-92b3-27602ab31e13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:13.376287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a287436-497f-4615-92b3-27602ab31e13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:13.430239 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a287436-497f-4615-92b3-27602ab31e13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:13.431717 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a287436-497f-4615-92b3-27602ab31e13 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:13.440666 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1167/2358] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:20.323597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ff0f2-11a9-4f93-ab3c-055650ea553e service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:20.332163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ff0f2-11a9-4f93-ab3c-055650ea553e service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:20.335796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db92f08-2102-44a9-9049-2c747c74cc73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:20.336427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db92f08-2102-44a9-9049-2c747c74cc73 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:20.336756 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db92f08-2102-44a9-9049-2c747c74cc73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:20.337031 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db92f08-2102-44a9-9049-2c747c74cc73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:20.398855 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db92f08-2102-44a9-9049-2c747c74cc73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:20.400207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db92f08-2102-44a9-9049-2c747c74cc73 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:20.409684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1192/2359] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:24.044689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a287436-497f-4615-92b3-27602ab31e13 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:24.103350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a287436-497f-4615-92b3-27602ab31e13 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:24.107876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7adf0-bb87-489e-aea1-c73bf1f4f3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:24.108729 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7adf0-bb87-489e-aea1-c73bf1f4f3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:24.109012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7adf0-bb87-489e-aea1-c73bf1f4f3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:24.109325 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7adf0-bb87-489e-aea1-c73bf1f4f3c0 admin admin] PATH_INFO: `/v3/users/52ad47fee34a4702ad377d09bdd9e5e7` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:24.110494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7adf0-bb87-489e-aea1-c73bf1f4f3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ad47fee34a4702ad377d09bdd9e5e7)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:24.112456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7adf0-bb87-489e-aea1-c73bf1f4f3c0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:24.277621 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-41a7adf0-bb87-489e-aea1-c73bf1f4f3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ad47fee34a4702ad377d09bdd9e5e7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:24.278225 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-41a7adf0-bb87-489e-aea1-c73bf1f4f3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ad47fee34a4702ad377d09bdd9e5e7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:24.278805 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-41a7adf0-bb87-489e-aea1-c73bf1f4f3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ad47fee34a4702ad377d09bdd9e5e7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:24.332048 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-41a7adf0-bb87-489e-aea1-c73bf1f4f3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ad47fee34a4702ad377d09bdd9e5e7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:24.343563 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-41a7adf0-bb87-489e-aea1-c73bf1f4f3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ad47fee34a4702ad377d09bdd9e5e7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:24.355323 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1168/2360] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:16:24 2022] DELETE /identity/v3/users/52ad47fee34a4702ad377d09bdd9e5e7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:24.360375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee4bf-6d00-41c4-890b-df8785371f9d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:24.360862 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee4bf-6d00-41c4-890b-df8785371f9d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:24.360970 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee4bf-6d00-41c4-890b-df8785371f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:24.378639 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-415ee4bf-6d00-41c4-890b-df8785371f9d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:24.379845 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-415ee4bf-6d00-41c4-890b-df8785371f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:24.435733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1193/2361] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:24.446070 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7adf0-bb87-489e-aea1-c73bf1f4f3c0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:24.447455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-41a7adf0-bb87-489e-aea1-c73bf1f4f3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:24.502712 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7adf0-bb87-489e-aea1-c73bf1f4f3c0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:24.506408 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af75da3-0d3e-4b7e-b14f-0228e855831e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:24.507071 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af75da3-0d3e-4b7e-b14f-0228e855831e service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:24.507352 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af75da3-0d3e-4b7e-b14f-0228e855831e service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:24.507626 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af75da3-0d3e-4b7e-b14f-0228e855831e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:24.516494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af75da3-0d3e-4b7e-b14f-0228e855831e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:24.517994 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af75da3-0d3e-4b7e-b14f-0228e855831e service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:24.527276 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1169/2362] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:24.876344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ee4bf-6d00-41c4-890b-df8785371f9d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:24.878201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-415ee4bf-6d00-41c4-890b-df8785371f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:24.892202 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ee4bf-6d00-41c4-890b-df8785371f9d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:24.896715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:24.897742 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:24.897931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:24.898210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] PATH_INFO: `/v3/projects/37dcab1c4507426b95181a0c68d88e7e` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:24.899424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] RBAC: Authorizing `identity:delete_project(project_id=37dcab1c4507426b95181a0c68d88e7e)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:24.901371 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:25.011205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dcab1c4507426b95181a0c68d88e7e', 'request_id': 'req-01e3dd65-6dbc-491e-9fea-ff2825e4641c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:25.086672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dcab1c4507426b95181a0c68d88e7e', 'request_id': 'req-01e3dd65-6dbc-491e-9fea-ff2825e4641c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:25.095450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dcab1c4507426b95181a0c68d88e7e', 'request_id': 'req-01e3dd65-6dbc-491e-9fea-ff2825e4641c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:25.105735 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] The token cache is being invalidate because project 37dcab1c4507426b95181a0c68d88e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:16:25.106026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:25.106680 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:25.108230 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1194/2363] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:16:24 2022] DELETE /identity/v3/projects/37dcab1c4507426b95181a0c68d88e7e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:25.112143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af75da3-0d3e-4b7e-b14f-0228e855831e service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:25.123346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af75da3-0d3e-4b7e-b14f-0228e855831e service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:25.184511 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4120816-9852-43b2-91f2-1156905dd71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:25.185404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4120816-9852-43b2-91f2-1156905dd71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:25.185684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4120816-9852-43b2-91f2-1156905dd71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:25.185973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4120816-9852-43b2-91f2-1156905dd71e admin admin] PATH_INFO: `/v3/users/9fad639c2b8c411d94180a086b753be2` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:25.187133 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4120816-9852-43b2-91f2-1156905dd71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fad639c2b8c411d94180a086b753be2)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:25.189182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4120816-9852-43b2-91f2-1156905dd71e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:25.368892 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d4120816-9852-43b2-91f2-1156905dd71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fad639c2b8c411d94180a086b753be2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:25.369579 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d4120816-9852-43b2-91f2-1156905dd71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fad639c2b8c411d94180a086b753be2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:25.370176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d4120816-9852-43b2-91f2-1156905dd71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fad639c2b8c411d94180a086b753be2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:25.417815 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d4120816-9852-43b2-91f2-1156905dd71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fad639c2b8c411d94180a086b753be2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:25.430032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d4120816-9852-43b2-91f2-1156905dd71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fad639c2b8c411d94180a086b753be2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:25.442602 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1170/2364] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:16:25 2022] DELETE /identity/v3/users/9fad639c2b8c411d94180a086b753be2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:25.797933 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:25.799415 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:25.813696 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3dd65-6dbc-491e-9fea-ff2825e4641c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:25.867998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:25.868863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:25.869175 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:25.869451 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] PATH_INFO: `/v3/projects/8cfc65b932b14ef29b512d8bbfda8bb1` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:25.870624 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cfc65b932b14ef29b512d8bbfda8bb1)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:25.872546 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:25.966077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cfc65b932b14ef29b512d8bbfda8bb1', 'request_id': 'req-23d00d21-a1d4-48de-88c2-18ed920ea692'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.023568 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cfc65b932b14ef29b512d8bbfda8bb1', 'request_id': 'req-23d00d21-a1d4-48de-88c2-18ed920ea692'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.029730 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cfc65b932b14ef29b512d8bbfda8bb1', 'request_id': 'req-23d00d21-a1d4-48de-88c2-18ed920ea692'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.039957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] The token cache is being invalidate because project 8cfc65b932b14ef29b512d8bbfda8bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:16:26.040244 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.040867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.042542 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1195/2365] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:16:25 2022] DELETE /identity/v3/projects/8cfc65b932b14ef29b512d8bbfda8bb1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:26.047276 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4120816-9852-43b2-91f2-1156905dd71e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:26.048656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d4120816-9852-43b2-91f2-1156905dd71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:26.061075 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4120816-9852-43b2-91f2-1156905dd71e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:26.115501 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17102fa-8153-4e26-952c-17aca240b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:26.116365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17102fa-8153-4e26-952c-17aca240b9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:26.116639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17102fa-8153-4e26-952c-17aca240b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:26.116905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17102fa-8153-4e26-952c-17aca240b9fa admin admin] PATH_INFO: `/v3/users/8437a486e8ab420d9d8b50d5fafa9df7` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:26.118105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17102fa-8153-4e26-952c-17aca240b9fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8437a486e8ab420d9d8b50d5fafa9df7)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:26.120047 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17102fa-8153-4e26-952c-17aca240b9fa admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:26.276875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b17102fa-8153-4e26-952c-17aca240b9fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8437a486e8ab420d9d8b50d5fafa9df7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.277547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b17102fa-8153-4e26-952c-17aca240b9fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8437a486e8ab420d9d8b50d5fafa9df7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.278140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b17102fa-8153-4e26-952c-17aca240b9fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8437a486e8ab420d9d8b50d5fafa9df7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.326631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b17102fa-8153-4e26-952c-17aca240b9fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8437a486e8ab420d9d8b50d5fafa9df7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.338526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b17102fa-8153-4e26-952c-17aca240b9fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8437a486e8ab420d9d8b50d5fafa9df7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.350839 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1171/2366] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:16:26 2022] DELETE /identity/v3/users/8437a486e8ab420d9d8b50d5fafa9df7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:26.693973 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:26.695692 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:26.710970 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d00d21-a1d4-48de-88c2-18ed920ea692 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:26.774363 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb39bc-6e73-429a-8fab-d330f0a1dddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:26.775225 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb39bc-6e73-429a-8fab-d330f0a1dddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:26.775502 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb39bc-6e73-429a-8fab-d330f0a1dddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:26.775772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb39bc-6e73-429a-8fab-d330f0a1dddd admin admin] PATH_INFO: `/v3/projects/5b0f5b30ece1443a9b9edbf8114ecae3` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:26.776964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb39bc-6e73-429a-8fab-d330f0a1dddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0f5b30ece1443a9b9edbf8114ecae3)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:26.778934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb39bc-6e73-429a-8fab-d330f0a1dddd admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:26.868669 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-63eb39bc-6e73-429a-8fab-d330f0a1dddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0f5b30ece1443a9b9edbf8114ecae3', 'request_id': 'req-63eb39bc-6e73-429a-8fab-d330f0a1dddd'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.915100 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-63eb39bc-6e73-429a-8fab-d330f0a1dddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0f5b30ece1443a9b9edbf8114ecae3', 'request_id': 'req-63eb39bc-6e73-429a-8fab-d330f0a1dddd'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.921600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-63eb39bc-6e73-429a-8fab-d330f0a1dddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0f5b30ece1443a9b9edbf8114ecae3', 'request_id': 'req-63eb39bc-6e73-429a-8fab-d330f0a1dddd'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.931694 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-63eb39bc-6e73-429a-8fab-d330f0a1dddd admin admin] The token cache is being invalidate because project 5b0f5b30ece1443a9b9edbf8114ecae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:16:26.931977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-63eb39bc-6e73-429a-8fab-d330f0a1dddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.932596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-63eb39bc-6e73-429a-8fab-d330f0a1dddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:26.934190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1196/2367] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:16:26 2022] DELETE /identity/v3/projects/5b0f5b30ece1443a9b9edbf8114ecae3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:26.940849 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c7c50-bd6e-46ff-a1e4-9e1a3da23819 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:26.941172 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c7c50-bd6e-46ff-a1e4-9e1a3da23819 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:26.941452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c7c50-bd6e-46ff-a1e4-9e1a3da23819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:26.958897 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a49c7c50-bd6e-46ff-a1e4-9e1a3da23819 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:26.960079 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a49c7c50-bd6e-46ff-a1e4-9e1a3da23819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:27.016446 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1172/2368] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:27.024880 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c3f0d-341f-4497-a86f-746c7859a578 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:27.025197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c3f0d-341f-4497-a86f-746c7859a578 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:27.025477 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c3f0d-341f-4497-a86f-746c7859a578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:27.173151 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a70c3f0d-341f-4497-a86f-746c7859a578 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:27.174293 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a70c3f0d-341f-4497-a86f-746c7859a578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:27.182631 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1197/2369] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:27.187347 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c7c50-bd6e-46ff-a1e4-9e1a3da23819 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:27.196923 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c7c50-bd6e-46ff-a1e4-9e1a3da23819 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:27.201564 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7b992-a710-45f8-8af1-698c20d0fdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:27.202207 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7b992-a710-45f8-8af1-698c20d0fdfa admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:27.203074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7b992-a710-45f8-8af1-698c20d0fdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:27.203365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7b992-a710-45f8-8af1-698c20d0fdfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:27.204087 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7b992-a710-45f8-8af1-698c20d0fdfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:16:27.204394 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7b992-a710-45f8-8af1-698c20d0fdfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:27.206058 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7b992-a710-45f8-8af1-698c20d0fdfa admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:27.217334 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1173/2370] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:16:27.221538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c3f0d-341f-4497-a86f-746c7859a578 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:27.230581 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c3f0d-341f-4497-a86f-746c7859a578 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:27.235730 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e00845-92e8-4bbb-8608-404a5ee95782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:27.236369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e00845-92e8-4bbb-8608-404a5ee95782 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:27.236647 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e00845-92e8-4bbb-8608-404a5ee95782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:27.236915 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e00845-92e8-4bbb-8608-404a5ee95782 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:27.237653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e00845-92e8-4bbb-8608-404a5ee95782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:27.239572 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e00845-92e8-4bbb-8608-404a5ee95782 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:27.350857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1198/2371] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:16:27 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:27.355153 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7b992-a710-45f8-8af1-698c20d0fdfa admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:27.365671 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7b992-a710-45f8-8af1-698c20d0fdfa admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:27.418198 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab9780-167b-4710-a84e-2cf8d2bd9d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:27.418860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab9780-167b-4710-a84e-2cf8d2bd9d5f admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:27.419395 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab9780-167b-4710-a84e-2cf8d2bd9d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:27.419667 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab9780-167b-4710-a84e-2cf8d2bd9d5f admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:27.420362 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab9780-167b-4710-a84e-2cf8d2bd9d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:27.422849 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab9780-167b-4710-a84e-2cf8d2bd9d5f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:27.480970 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1174/2372] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:16:27 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:27.485594 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e00845-92e8-4bbb-8608-404a5ee95782 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:27.496216 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e00845-92e8-4bbb-8608-404a5ee95782 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:27.502242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909e608-70d5-4b9b-87e8-47f2a56122b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:27.502900 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909e608-70d5-4b9b-87e8-47f2a56122b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:27.503184 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909e608-70d5-4b9b-87e8-47f2a56122b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:27.503461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909e608-70d5-4b9b-87e8-47f2a56122b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:27.504186 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909e608-70d5-4b9b-87e8-47f2a56122b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:27.505816 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909e608-70d5-4b9b-87e8-47f2a56122b1 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:27.515708 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1199/2373] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:27.519703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab9780-167b-4710-a84e-2cf8d2bd9d5f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:27.529689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab9780-167b-4710-a84e-2cf8d2bd9d5f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:27.534341 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f450a-8f2d-48ce-989f-96ad4bfa3187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:27.534988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f450a-8f2d-48ce-989f-96ad4bfa3187 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:27.535272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f450a-8f2d-48ce-989f-96ad4bfa3187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:27.535551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f450a-8f2d-48ce-989f-96ad4bfa3187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:27.536273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f450a-8f2d-48ce-989f-96ad4bfa3187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:27.537956 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f450a-8f2d-48ce-989f-96ad4bfa3187 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:27.548313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1175/2374] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:16:27.552141 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909e608-70d5-4b9b-87e8-47f2a56122b1 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:27.561665 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909e608-70d5-4b9b-87e8-47f2a56122b1 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:27.566821 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49311a61-e964-4d81-815e-3d438bbf47d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:27.567675 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49311a61-e964-4d81-815e-3d438bbf47d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:27.567948 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49311a61-e964-4d81-815e-3d438bbf47d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:27.568211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49311a61-e964-4d81-815e-3d438bbf47d1 admin admin] PATH_INFO: `/v3/projects/c39898b06310419d8206953b11d0c6ed/users/cde2404fc4bc400c8474a25e4bd7a015/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:27.581904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49311a61-e964-4d81-815e-3d438bbf47d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39898b06310419d8206953b11d0c6ed, user_id=cde2404fc4bc400c8474a25e4bd7a015, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:27.584554 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49311a61-e964-4d81-815e-3d438bbf47d1 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:27.646590 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1200/2375] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:16:27 2022] PUT /identity/v3/projects/c39898b06310419d8206953b11d0c6ed/users/cde2404fc4bc400c8474a25e4bd7a015/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:27.662967 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788d2d4-17e4-46e4-90fd-b500790b77ec None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:27.663356 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788d2d4-17e4-46e4-90fd-b500790b77ec None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:27.663668 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788d2d4-17e4-46e4-90fd-b500790b77ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:27.690650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7788d2d4-17e4-46e4-90fd-b500790b77ec None None] MFA Rules not processed for user `cde2404fc4bc400c8474a25e4bd7a015`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:27.692003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7788d2d4-17e4-46e4-90fd-b500790b77ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:27.753250 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1176/2376] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:27.764177 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49311a61-e964-4d81-815e-3d438bbf47d1 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:27.766059 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-49311a61-e964-4d81-815e-3d438bbf47d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:27.821504 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49311a61-e964-4d81-815e-3d438bbf47d1 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:27.825192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e93cd6-8b75-42a1-acbf-ca55fb4c207b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:27.825826 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e93cd6-8b75-42a1-acbf-ca55fb4c207b service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:27.826108 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e93cd6-8b75-42a1-acbf-ca55fb4c207b service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:27.826399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e93cd6-8b75-42a1-acbf-ca55fb4c207b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:27.834518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e93cd6-8b75-42a1-acbf-ca55fb4c207b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:27.835919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e93cd6-8b75-42a1-acbf-ca55fb4c207b service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:27.845291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1201/2377] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:39.522969 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788d2d4-17e4-46e4-90fd-b500790b77ec None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:39.582930 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788d2d4-17e4-46e4-90fd-b500790b77ec None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:39.590003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff3802-aab7-465e-a091-69439de3584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:39.590003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3802-aab7-465e-a091-69439de3584c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:39.590003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3802-aab7-465e-a091-69439de3584c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:39.590003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3802-aab7-465e-a091-69439de3584c admin admin] PATH_INFO: `/v3/users/cde2404fc4bc400c8474a25e4bd7a015` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:39.590586 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff3802-aab7-465e-a091-69439de3584c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde2404fc4bc400c8474a25e4bd7a015)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:39.592180 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff3802-aab7-465e-a091-69439de3584c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:39.722639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6aff3802-aab7-465e-a091-69439de3584c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde2404fc4bc400c8474a25e4bd7a015'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:39.723287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6aff3802-aab7-465e-a091-69439de3584c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde2404fc4bc400c8474a25e4bd7a015'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:39.723883 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6aff3802-aab7-465e-a091-69439de3584c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde2404fc4bc400c8474a25e4bd7a015'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:39.771995 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6aff3802-aab7-465e-a091-69439de3584c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde2404fc4bc400c8474a25e4bd7a015'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:39.783338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6aff3802-aab7-465e-a091-69439de3584c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde2404fc4bc400c8474a25e4bd7a015'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:39.795882 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1177/2378] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:16:39 2022] DELETE /identity/v3/users/cde2404fc4bc400c8474a25e4bd7a015 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:39.801039 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554653c-ec92-45a5-af2b-771af5d6965b None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:39.802390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554653c-ec92-45a5-af2b-771af5d6965b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:39.802390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554653c-ec92-45a5-af2b-771af5d6965b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:39.818514 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-b554653c-ec92-45a5-af2b-771af5d6965b None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:39.819726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b554653c-ec92-45a5-af2b-771af5d6965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:39.874275 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1202/2379] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:39.883625 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff3802-aab7-465e-a091-69439de3584c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:39.885031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6aff3802-aab7-465e-a091-69439de3584c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:39.939786 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff3802-aab7-465e-a091-69439de3584c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:39.943388 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bb671-2209-428b-9230-5d8e9ecdda8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:39.944014 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bb671-2209-428b-9230-5d8e9ecdda8d service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:39.944295 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bb671-2209-428b-9230-5d8e9ecdda8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:39.944570 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bb671-2209-428b-9230-5d8e9ecdda8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:39.953455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bb671-2209-428b-9230-5d8e9ecdda8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:39.954910 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bb671-2209-428b-9230-5d8e9ecdda8d service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:39.964629 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1178/2380] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:40.379802 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554653c-ec92-45a5-af2b-771af5d6965b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:40.381245 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b554653c-ec92-45a5-af2b-771af5d6965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:40.393258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554653c-ec92-45a5-af2b-771af5d6965b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:40.398827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb933eb-6721-493b-ad78-d1c4ee491ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:40.399686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb933eb-6721-493b-ad78-d1c4ee491ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:40.399969 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb933eb-6721-493b-ad78-d1c4ee491ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:40.400247 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb933eb-6721-493b-ad78-d1c4ee491ae2 admin admin] PATH_INFO: `/v3/projects/c39898b06310419d8206953b11d0c6ed` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:40.401488 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb933eb-6721-493b-ad78-d1c4ee491ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39898b06310419d8206953b11d0c6ed)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:40.403409 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb933eb-6721-493b-ad78-d1c4ee491ae2 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:40.503953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5fb933eb-6721-493b-ad78-d1c4ee491ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39898b06310419d8206953b11d0c6ed', 'request_id': 'req-5fb933eb-6721-493b-ad78-d1c4ee491ae2'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:40.577972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5fb933eb-6721-493b-ad78-d1c4ee491ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39898b06310419d8206953b11d0c6ed', 'request_id': 'req-5fb933eb-6721-493b-ad78-d1c4ee491ae2'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:40.584855 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5fb933eb-6721-493b-ad78-d1c4ee491ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39898b06310419d8206953b11d0c6ed', 'request_id': 'req-5fb933eb-6721-493b-ad78-d1c4ee491ae2'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:40.594789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5fb933eb-6721-493b-ad78-d1c4ee491ae2 admin admin] The token cache is being invalidate because project c39898b06310419d8206953b11d0c6ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:16:40.595077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5fb933eb-6721-493b-ad78-d1c4ee491ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:40.595692 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5fb933eb-6721-493b-ad78-d1c4ee491ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:40.597250 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1203/2381] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:16:40 2022] DELETE /identity/v3/projects/c39898b06310419d8206953b11d0c6ed => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:40.602028 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0bdb-08f2-437a-a0fd-9bd00a3eea65 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:40.602531 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0bdb-08f2-437a-a0fd-9bd00a3eea65 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:40.602626 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0bdb-08f2-437a-a0fd-9bd00a3eea65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:40.620390 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3acb0bdb-08f2-437a-a0fd-9bd00a3eea65 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:40.621630 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3acb0bdb-08f2-437a-a0fd-9bd00a3eea65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:40.678890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1179/2382] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:40.687359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba619372-b92b-4410-af7e-4e6f68750803 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:40.687647 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba619372-b92b-4410-af7e-4e6f68750803 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:40.687927 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba619372-b92b-4410-af7e-4e6f68750803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:40.705755 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-ba619372-b92b-4410-af7e-4e6f68750803 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:40.707428 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ba619372-b92b-4410-af7e-4e6f68750803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:40.715219 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1204/2383] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:40.719306 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb0bdb-08f2-437a-a0fd-9bd00a3eea65 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:40.729635 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb0bdb-08f2-437a-a0fd-9bd00a3eea65 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:40.734253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a600c-7971-4609-a050-96dbe7345112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:40.734898 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a600c-7971-4609-a050-96dbe7345112 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:40.735183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a600c-7971-4609-a050-96dbe7345112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:40.735458 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a600c-7971-4609-a050-96dbe7345112 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:40.736176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a600c-7971-4609-a050-96dbe7345112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:16:40.736485 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a600c-7971-4609-a050-96dbe7345112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:40.738266 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a600c-7971-4609-a050-96dbe7345112 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:40.751944 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1180/2384] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:16:40.757107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba619372-b92b-4410-af7e-4e6f68750803 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:40.766332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba619372-b92b-4410-af7e-4e6f68750803 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:40.771601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfbebf-3f60-45e5-8034-895f9dea24c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:40.772251 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfbebf-3f60-45e5-8034-895f9dea24c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:40.772531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfbebf-3f60-45e5-8034-895f9dea24c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:40.772803 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfbebf-3f60-45e5-8034-895f9dea24c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:40.773550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfbebf-3f60-45e5-8034-895f9dea24c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:40.775431 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfbebf-3f60-45e5-8034-895f9dea24c1 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:40.858587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1205/2385] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:16:40 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:16:40.862953 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a600c-7971-4609-a050-96dbe7345112 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:40.872720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a600c-7971-4609-a050-96dbe7345112 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:40.927078 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3f442-4966-4e34-b66d-857a92d8677d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:40.927662 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3f442-4966-4e34-b66d-857a92d8677d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:40.927957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3f442-4966-4e34-b66d-857a92d8677d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:40.928241 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3f442-4966-4e34-b66d-857a92d8677d admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:40.928931 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3f442-4966-4e34-b66d-857a92d8677d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:40.930934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3f442-4966-4e34-b66d-857a92d8677d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:41.000137 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1181/2386] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:16:40 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:41.004702 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfbebf-3f60-45e5-8034-895f9dea24c1 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:41.015338 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfbebf-3f60-45e5-8034-895f9dea24c1 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:41.020645 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194524d7-df89-4d56-9a77-03f2a42bdba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:41.021450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194524d7-df89-4d56-9a77-03f2a42bdba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:41.021736 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194524d7-df89-4d56-9a77-03f2a42bdba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:41.022014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194524d7-df89-4d56-9a77-03f2a42bdba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:41.022733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194524d7-df89-4d56-9a77-03f2a42bdba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:41.024320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194524d7-df89-4d56-9a77-03f2a42bdba1 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:41.034431 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1206/2387] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:41.038142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3f442-4966-4e34-b66d-857a92d8677d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:41.048351 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3f442-4966-4e34-b66d-857a92d8677d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:41.052981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32064e20-3725-49ce-a43f-7ccbb4b26e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:41.053659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32064e20-3725-49ce-a43f-7ccbb4b26e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:41.053944 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32064e20-3725-49ce-a43f-7ccbb4b26e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:41.054226 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32064e20-3725-49ce-a43f-7ccbb4b26e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:41.054944 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32064e20-3725-49ce-a43f-7ccbb4b26e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:41.056571 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32064e20-3725-49ce-a43f-7ccbb4b26e97 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:41.066512 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1182/2388] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:41.070419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194524d7-df89-4d56-9a77-03f2a42bdba1 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:41.080252 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194524d7-df89-4d56-9a77-03f2a42bdba1 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:41.085632 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74a55a-8840-4b15-941f-ba14442c2f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:41.086515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74a55a-8840-4b15-941f-ba14442c2f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:41.086798 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74a55a-8840-4b15-941f-ba14442c2f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:41.087075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74a55a-8840-4b15-941f-ba14442c2f9c admin admin] PATH_INFO: `/v3/projects/a8a2991dc3184a869b48a4ea0ebec8c1/users/ff12b11cedfd471788a5b64d4d7428e8/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:41.101564 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74a55a-8840-4b15-941f-ba14442c2f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a2991dc3184a869b48a4ea0ebec8c1, user_id=ff12b11cedfd471788a5b64d4d7428e8, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:41.104198 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74a55a-8840-4b15-941f-ba14442c2f9c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:41.167136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1207/2389] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:16:41 2022] PUT /identity/v3/projects/a8a2991dc3184a869b48a4ea0ebec8c1/users/ff12b11cedfd471788a5b64d4d7428e8/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:41.178467 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ea48f-8ced-4322-aeea-8fb9b7159e93 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:41.178689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ea48f-8ced-4322-aeea-8fb9b7159e93 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:41.178971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ea48f-8ced-4322-aeea-8fb9b7159e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:41.208154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-818ea48f-8ced-4322-aeea-8fb9b7159e93 None None] MFA Rules not processed for user `ff12b11cedfd471788a5b64d4d7428e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:41.209478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-818ea48f-8ced-4322-aeea-8fb9b7159e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:41.282565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1183/2390] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:41.297281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74a55a-8840-4b15-941f-ba14442c2f9c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:41.299336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7b74a55a-8840-4b15-941f-ba14442c2f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:41.366265 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74a55a-8840-4b15-941f-ba14442c2f9c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:41.370562 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffc11f-4bce-42f9-a597-5435df4daf11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:41.373438 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffc11f-4bce-42f9-a597-5435df4daf11 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:41.373783 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffc11f-4bce-42f9-a597-5435df4daf11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:41.374053 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffc11f-4bce-42f9-a597-5435df4daf11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:41.383919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffc11f-4bce-42f9-a597-5435df4daf11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:41.385600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffc11f-4bce-42f9-a597-5435df4daf11 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:41.395945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1208/2391] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:42.418112 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ea48f-8ced-4322-aeea-8fb9b7159e93 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:42.422318 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-818ea48f-8ced-4322-aeea-8fb9b7159e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:42.493570 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ea48f-8ced-4322-aeea-8fb9b7159e93 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:42.501080 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2db4c2-ac16-4fdb-8f59-9b212acf0105 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd095449a5b44c6b1c9aca712edc11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:42.501811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db4c2-ac16-4fdb-8f59-9b212acf0105 service placement] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:42.502160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db4c2-ac16-4fdb-8f59-9b212acf0105 service placement] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:42.502500 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db4c2-ac16-4fdb-8f59-9b212acf0105 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:42.504868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2c2db4c2-ac16-4fdb-8f59-9b212acf0105 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:42.517611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2db4c2-ac16-4fdb-8f59-9b212acf0105 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:42.519908 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2db4c2-ac16-4fdb-8f59-9b212acf0105 service placement] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:42.533218 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1184/2392] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:46.516935 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffc11f-4bce-42f9-a597-5435df4daf11 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:46.581373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffc11f-4bce-42f9-a597-5435df4daf11 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:46.586005 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b56ce-4290-4940-88a7-9dac998f323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:46.587563 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b56ce-4290-4940-88a7-9dac998f323e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:46.587563 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b56ce-4290-4940-88a7-9dac998f323e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:46.587563 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b56ce-4290-4940-88a7-9dac998f323e admin admin] PATH_INFO: `/v3/users/ff12b11cedfd471788a5b64d4d7428e8` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:46.588610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b56ce-4290-4940-88a7-9dac998f323e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff12b11cedfd471788a5b64d4d7428e8)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:46.590576 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b56ce-4290-4940-88a7-9dac998f323e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:46.797616 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f39b56ce-4290-4940-88a7-9dac998f323e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff12b11cedfd471788a5b64d4d7428e8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:46.798196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f39b56ce-4290-4940-88a7-9dac998f323e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff12b11cedfd471788a5b64d4d7428e8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:46.798796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f39b56ce-4290-4940-88a7-9dac998f323e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff12b11cedfd471788a5b64d4d7428e8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:46.810056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f39b56ce-4290-4940-88a7-9dac998f323e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff12b11cedfd471788a5b64d4d7428e8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:46.816923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f39b56ce-4290-4940-88a7-9dac998f323e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff12b11cedfd471788a5b64d4d7428e8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:46.825138 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bac107-647a-46b9-be43-01e2b208dd02 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:46.825629 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bac107-647a-46b9-be43-01e2b208dd02 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:46.825753 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bac107-647a-46b9-be43-01e2b208dd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:46.845673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-47bac107-647a-46b9-be43-01e2b208dd02 None None] MFA Rules not processed for user `e9f1dd7aa9bc47f59656d326eb6cc751`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:46.849937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-47bac107-647a-46b9-be43-01e2b208dd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:46.899923 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1185/2393] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:16:46.903895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1209/2394] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:16:46 2022] DELETE /identity/v3/users/ff12b11cedfd471788a5b64d4d7428e8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:16:46.910661 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23314ac-81b6-42cc-85ef-baba7e663724 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:46.911313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23314ac-81b6-42cc-85ef-baba7e663724 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:46.911417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23314ac-81b6-42cc-85ef-baba7e663724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:46.929768 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a23314ac-81b6-42cc-85ef-baba7e663724 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:46.930992 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a23314ac-81b6-42cc-85ef-baba7e663724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:46.993270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1186/2395] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:47.003890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b56ce-4290-4940-88a7-9dac998f323e admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:47.005622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f39b56ce-4290-4940-88a7-9dac998f323e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:47.059929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b56ce-4290-4940-88a7-9dac998f323e admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:47.063423 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b3568-7dcb-41bc-bc98-f0f246c97c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:47.064062 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b3568-7dcb-41bc-bc98-f0f246c97c59 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:47.064338 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b3568-7dcb-41bc-bc98-f0f246c97c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:47.064606 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b3568-7dcb-41bc-bc98-f0f246c97c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:47.073504 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b3568-7dcb-41bc-bc98-f0f246c97c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:47.074917 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b3568-7dcb-41bc-bc98-f0f246c97c59 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:47.084500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1210/2396] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:47.202445 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23314ac-81b6-42cc-85ef-baba7e663724 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:47.203913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a23314ac-81b6-42cc-85ef-baba7e663724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:47.215320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23314ac-81b6-42cc-85ef-baba7e663724 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:47.220081 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe4878-3a78-4eac-919c-8dbdca8ddf68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:47.220081 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe4878-3a78-4eac-919c-8dbdca8ddf68 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:47.220081 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe4878-3a78-4eac-919c-8dbdca8ddf68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:47.220081 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe4878-3a78-4eac-919c-8dbdca8ddf68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:47.222470 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3abe4878-3a78-4eac-919c-8dbdca8ddf68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:47.231930 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe4878-3a78-4eac-919c-8dbdca8ddf68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:47.233520 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe4878-3a78-4eac-919c-8dbdca8ddf68 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:47.242171 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1187/2397] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:16:47.460425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b3568-7dcb-41bc-bc98-f0f246c97c59 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:47.462265 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-805b3568-7dcb-41bc-bc98-f0f246c97c59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:47.477923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b3568-7dcb-41bc-bc98-f0f246c97c59 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:47.482605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90e314-a946-46c7-9656-8d444dfbe89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:47.483931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90e314-a946-46c7-9656-8d444dfbe89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:47.484424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90e314-a946-46c7-9656-8d444dfbe89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:47.485437 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90e314-a946-46c7-9656-8d444dfbe89a admin admin] PATH_INFO: `/v3/projects/a8a2991dc3184a869b48a4ea0ebec8c1` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:47.486932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90e314-a946-46c7-9656-8d444dfbe89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a2991dc3184a869b48a4ea0ebec8c1)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:47.489107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90e314-a946-46c7-9656-8d444dfbe89a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:47.599066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ca90e314-a946-46c7-9656-8d444dfbe89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a2991dc3184a869b48a4ea0ebec8c1', 'request_id': 'req-ca90e314-a946-46c7-9656-8d444dfbe89a'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:47.673521 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ca90e314-a946-46c7-9656-8d444dfbe89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a2991dc3184a869b48a4ea0ebec8c1', 'request_id': 'req-ca90e314-a946-46c7-9656-8d444dfbe89a'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:47.680560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ca90e314-a946-46c7-9656-8d444dfbe89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a2991dc3184a869b48a4ea0ebec8c1', 'request_id': 'req-ca90e314-a946-46c7-9656-8d444dfbe89a'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:47.691989 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ca90e314-a946-46c7-9656-8d444dfbe89a admin admin] The token cache is being invalidate because project a8a2991dc3184a869b48a4ea0ebec8c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:16:47.692345 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ca90e314-a946-46c7-9656-8d444dfbe89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:47.693130 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ca90e314-a946-46c7-9656-8d444dfbe89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:16:47.694825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1211/2398] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:16:47 2022] DELETE /identity/v3/projects/a8a2991dc3184a869b48a4ea0ebec8c1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:47.701736 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f183aa-e2b1-4c24-80f0-f67e36c58732 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:47.702025 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f183aa-e2b1-4c24-80f0-f67e36c58732 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:47.702304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f183aa-e2b1-4c24-80f0-f67e36c58732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:47.721827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-43f183aa-e2b1-4c24-80f0-f67e36c58732 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:47.723605 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-43f183aa-e2b1-4c24-80f0-f67e36c58732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:47.780822 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1188/2399] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:47.788500 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86988a36-852e-4791-b1b3-51aa0bbfc038 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:47.788780 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86988a36-852e-4791-b1b3-51aa0bbfc038 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:47.789072 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86988a36-852e-4791-b1b3-51aa0bbfc038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:47.806934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-86988a36-852e-4791-b1b3-51aa0bbfc038 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:47.808118 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-86988a36-852e-4791-b1b3-51aa0bbfc038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:47.816571 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1212/2400] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:47.826515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f183aa-e2b1-4c24-80f0-f67e36c58732 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:47.837280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f183aa-e2b1-4c24-80f0-f67e36c58732 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:47.841801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fe48d-0aa7-4727-bf34-31f538932c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:47.842442 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fe48d-0aa7-4727-bf34-31f538932c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:47.842720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fe48d-0aa7-4727-bf34-31f538932c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:47.842990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fe48d-0aa7-4727-bf34-31f538932c82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:47.843704 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fe48d-0aa7-4727-bf34-31f538932c82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:16:47.844005 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fe48d-0aa7-4727-bf34-31f538932c82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:47.845806 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fe48d-0aa7-4727-bf34-31f538932c82 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:47.861375 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1189/2401] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:16:47.865621 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86988a36-852e-4791-b1b3-51aa0bbfc038 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:47.874694 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86988a36-852e-4791-b1b3-51aa0bbfc038 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:47.879845 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ed0c4-5ad6-4e9a-954f-e7429a66c710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:47.885879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ed0c4-5ad6-4e9a-954f-e7429a66c710 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:47.885879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ed0c4-5ad6-4e9a-954f-e7429a66c710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:47.885879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ed0c4-5ad6-4e9a-954f-e7429a66c710 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:47.885879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ed0c4-5ad6-4e9a-954f-e7429a66c710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:47.885879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ed0c4-5ad6-4e9a-954f-e7429a66c710 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:47.993949 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1213/2402] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:16:47 2022] POST /identity/v3/projects => generated 361 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:47.995039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fe48d-0aa7-4727-bf34-31f538932c82 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:48.005913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fe48d-0aa7-4727-bf34-31f538932c82 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:48.061438 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8c3dc-c890-4668-833e-8066ccf16703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:48.062105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8c3dc-c890-4668-833e-8066ccf16703 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:48.062474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8c3dc-c890-4668-833e-8066ccf16703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:48.062746 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8c3dc-c890-4668-833e-8066ccf16703 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:48.063435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8c3dc-c890-4668-833e-8066ccf16703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:48.065414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8c3dc-c890-4668-833e-8066ccf16703 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:48.167212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1190/2403] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:16:47 2022] POST /identity/v3/users => generated 281 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:16:48.171535 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ed0c4-5ad6-4e9a-954f-e7429a66c710 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:48.182307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ed0c4-5ad6-4e9a-954f-e7429a66c710 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:48.186947 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457e1bd-cc64-459a-8002-b72fc1933a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:48.187603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457e1bd-cc64-459a-8002-b72fc1933a16 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:48.187893 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457e1bd-cc64-459a-8002-b72fc1933a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:48.188170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457e1bd-cc64-459a-8002-b72fc1933a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:48.188891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457e1bd-cc64-459a-8002-b72fc1933a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:48.191248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457e1bd-cc64-459a-8002-b72fc1933a16 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:48.201420 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1214/2404] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:16:48.205409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8c3dc-c890-4668-833e-8066ccf16703 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:48.215625 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8c3dc-c890-4668-833e-8066ccf16703 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:48.220376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d106c66-a80c-4ed8-b729-9bf69e487caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:48.221028 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d106c66-a80c-4ed8-b729-9bf69e487caa admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:48.221346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d106c66-a80c-4ed8-b729-9bf69e487caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:48.221626 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d106c66-a80c-4ed8-b729-9bf69e487caa admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:48.222381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d106c66-a80c-4ed8-b729-9bf69e487caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:48.224070 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d106c66-a80c-4ed8-b729-9bf69e487caa admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:48.233944 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1191/2405] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:16:48.238452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457e1bd-cc64-459a-8002-b72fc1933a16 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:48.248443 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457e1bd-cc64-459a-8002-b72fc1933a16 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:48.255870 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda247d-7cf3-4a87-8fbe-907dd24aa152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:48.259920 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda247d-7cf3-4a87-8fbe-907dd24aa152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:48.260246 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda247d-7cf3-4a87-8fbe-907dd24aa152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:48.260528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda247d-7cf3-4a87-8fbe-907dd24aa152 admin admin] PATH_INFO: `/v3/projects/0ac6e0eb09be457fa2f9d37a5fd0cac9/users/8d47f6545f9640b7bae20aa9274ce820/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:48.276038 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda247d-7cf3-4a87-8fbe-907dd24aa152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac6e0eb09be457fa2f9d37a5fd0cac9, user_id=8d47f6545f9640b7bae20aa9274ce820, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:48.278704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda247d-7cf3-4a87-8fbe-907dd24aa152 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:48.384162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1215/2406] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:16:48 2022] PUT /identity/v3/projects/0ac6e0eb09be457fa2f9d37a5fd0cac9/users/8d47f6545f9640b7bae20aa9274ce820/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:16:48.395256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c520257-2be2-42e7-b341-e4255b3effe4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:48.395541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c520257-2be2-42e7-b341-e4255b3effe4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:48.395818 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c520257-2be2-42e7-b341-e4255b3effe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:48.421303 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6c520257-2be2-42e7-b341-e4255b3effe4 None None] MFA Rules not processed for user `8d47f6545f9640b7bae20aa9274ce820`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:16:48.422475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6c520257-2be2-42e7-b341-e4255b3effe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:48.483851 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1192/2407] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:16:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:16:48.495313 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda247d-7cf3-4a87-8fbe-907dd24aa152 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:16:48.497024 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6cda247d-7cf3-4a87-8fbe-907dd24aa152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:16:48.553433 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda247d-7cf3-4a87-8fbe-907dd24aa152 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:16:48.557015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81925a-17f4-4a78-b7a2-ce3ff91a0230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:16:48.557686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81925a-17f4-4a78-b7a2-ce3ff91a0230 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:16:48.557967 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81925a-17f4-4a78-b7a2-ce3ff91a0230 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:16:48.558237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81925a-17f4-4a78-b7a2-ce3ff91a0230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:16:48.566366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81925a-17f4-4a78-b7a2-ce3ff91a0230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:16:48.572446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81925a-17f4-4a78-b7a2-ce3ff91a0230 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:16:48.576343 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1216/2408] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:16:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:17:27.024923 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2404-9d3c-4d54-aa1e-2fbb0a03c3fd None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:27.025457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2404-9d3c-4d54-aa1e-2fbb0a03c3fd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:27.025559 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2404-9d3c-4d54-aa1e-2fbb0a03c3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:27.044471 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f33d2404-9d3c-4d54-aa1e-2fbb0a03c3fd None None] MFA Rules not processed for user `f506156c62014060ab9004b7abbb2369`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:17:27.045707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f33d2404-9d3c-4d54-aa1e-2fbb0a03c3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:17:27.097797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1193/2409] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:17:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:17:46.238904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81925a-17f4-4a78-b7a2-ce3ff91a0230 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:46.309488 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81925a-17f4-4a78-b7a2-ce3ff91a0230 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:46.314993 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577ec14-e655-426a-a232-98865ee82ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:46.315903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577ec14-e655-426a-a232-98865ee82ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:46.316187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577ec14-e655-426a-a232-98865ee82ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:46.316463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577ec14-e655-426a-a232-98865ee82ac2 admin admin] PATH_INFO: `/v3/users/8d47f6545f9640b7bae20aa9274ce820` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:46.317708 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577ec14-e655-426a-a232-98865ee82ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d47f6545f9640b7bae20aa9274ce820)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:46.319749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577ec14-e655-426a-a232-98865ee82ac2 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:46.481887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7577ec14-e655-426a-a232-98865ee82ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d47f6545f9640b7bae20aa9274ce820'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:17:46.482560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7577ec14-e655-426a-a232-98865ee82ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d47f6545f9640b7bae20aa9274ce820'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:17:46.483262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7577ec14-e655-426a-a232-98865ee82ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d47f6545f9640b7bae20aa9274ce820'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:17:46.497216 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7577ec14-e655-426a-a232-98865ee82ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d47f6545f9640b7bae20aa9274ce820'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:17:46.505789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7577ec14-e655-426a-a232-98865ee82ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d47f6545f9640b7bae20aa9274ce820'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:17:46.566008 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1217/2410] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:17:46 2022] DELETE /identity/v3/users/8d47f6545f9640b7bae20aa9274ce820 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:17:46.570621 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0014cc-2bad-4d3e-b68d-0e74604a9444 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:46.571119 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0014cc-2bad-4d3e-b68d-0e74604a9444 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:46.571231 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0014cc-2bad-4d3e-b68d-0e74604a9444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:46.589011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ce0014cc-2bad-4d3e-b68d-0e74604a9444 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:17:46.590422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ce0014cc-2bad-4d3e-b68d-0e74604a9444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:17:46.649129 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1194/2411] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:17:46.659570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577ec14-e655-426a-a232-98865ee82ac2 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:46.661101 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7577ec14-e655-426a-a232-98865ee82ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:17:46.726978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577ec14-e655-426a-a232-98865ee82ac2 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:46.737448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01052708-8314-445d-b0ab-f68eb75cd6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:46.737448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01052708-8314-445d-b0ab-f68eb75cd6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:46.737448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01052708-8314-445d-b0ab-f68eb75cd6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:46.737448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01052708-8314-445d-b0ab-f68eb75cd6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:46.744300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01052708-8314-445d-b0ab-f68eb75cd6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:46.745794 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01052708-8314-445d-b0ab-f68eb75cd6b9 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:46.757092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1218/2412] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:17:47.132666 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0014cc-2bad-4d3e-b68d-0e74604a9444 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:47.134253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ce0014cc-2bad-4d3e-b68d-0e74604a9444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:17:47.146355 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0014cc-2bad-4d3e-b68d-0e74604a9444 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:47.151023 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:47.151887 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:47.152167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:47.152444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd admin admin] PATH_INFO: `/v3/projects/0ac6e0eb09be457fa2f9d37a5fd0cac9` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:47.153651 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac6e0eb09be457fa2f9d37a5fd0cac9)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:47.156094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:47.255577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac6e0eb09be457fa2f9d37a5fd0cac9', 'request_id': 'req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:17:47.261799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac6e0eb09be457fa2f9d37a5fd0cac9', 'request_id': 'req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:17:47.267493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac6e0eb09be457fa2f9d37a5fd0cac9', 'request_id': 'req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:17:47.312797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd admin admin] The token cache is being invalidate because project 0ac6e0eb09be457fa2f9d37a5fd0cac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:17:47.313108 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:17:47.313799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7e2cd00e-3f1a-4ca9-aee1-334065b5b4cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:17:47.315313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1195/2413] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:17:47 2022] DELETE /identity/v3/projects/0ac6e0eb09be457fa2f9d37a5fd0cac9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:17:47.321877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b434b0-b5c9-4d79-9b4c-97d1eeb20f68 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:47.322366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b434b0-b5c9-4d79-9b4c-97d1eeb20f68 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:47.322473 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b434b0-b5c9-4d79-9b4c-97d1eeb20f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:47.340223 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e7b434b0-b5c9-4d79-9b4c-97d1eeb20f68 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:17:47.341476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e7b434b0-b5c9-4d79-9b4c-97d1eeb20f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:17:47.398638 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1219/2414] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:17:47.407604 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a073e5-de64-4e8e-bc40-b88c8cc4e56a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:47.407888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a073e5-de64-4e8e-bc40-b88c8cc4e56a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:47.408162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a073e5-de64-4e8e-bc40-b88c8cc4e56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:47.427327 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-78a073e5-de64-4e8e-bc40-b88c8cc4e56a None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:17:47.428525 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-78a073e5-de64-4e8e-bc40-b88c8cc4e56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:17:47.436384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1196/2415] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:17:47.440460 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b434b0-b5c9-4d79-9b4c-97d1eeb20f68 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:47.450032 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b434b0-b5c9-4d79-9b4c-97d1eeb20f68 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:47.455256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff387f53-11a3-4402-8ec8-e3339de6d0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:47.455905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff387f53-11a3-4402-8ec8-e3339de6d0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:47.456188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff387f53-11a3-4402-8ec8-e3339de6d0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:47.456463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff387f53-11a3-4402-8ec8-e3339de6d0c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:47.457227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff387f53-11a3-4402-8ec8-e3339de6d0c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:17:47.457540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff387f53-11a3-4402-8ec8-e3339de6d0c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:47.459121 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff387f53-11a3-4402-8ec8-e3339de6d0c3 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:47.471334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1220/2416] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:17:47.475504 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a073e5-de64-4e8e-bc40-b88c8cc4e56a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:47.485015 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a073e5-de64-4e8e-bc40-b88c8cc4e56a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:47.489766 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0afcd-829f-4064-acfc-be74b7ab6409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:47.490405 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0afcd-829f-4064-acfc-be74b7ab6409 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:47.490689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0afcd-829f-4064-acfc-be74b7ab6409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:47.491086 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0afcd-829f-4064-acfc-be74b7ab6409 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:47.491783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0afcd-829f-4064-acfc-be74b7ab6409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:47.493754 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0afcd-829f-4064-acfc-be74b7ab6409 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:47.560870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1197/2417] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:17:47 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:17:47.564946 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff387f53-11a3-4402-8ec8-e3339de6d0c3 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:47.574847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff387f53-11a3-4402-8ec8-e3339de6d0c3 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:47.630063 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8c0c4-671a-4f63-ae8a-1e5f59b6ce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:47.630726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c0c4-671a-4f63-ae8a-1e5f59b6ce49 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:47.631006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c0c4-671a-4f63-ae8a-1e5f59b6ce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:47.631279 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c0c4-671a-4f63-ae8a-1e5f59b6ce49 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:47.631997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8c0c4-671a-4f63-ae8a-1e5f59b6ce49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:47.633969 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8c0c4-671a-4f63-ae8a-1e5f59b6ce49 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:47.690808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1221/2418] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:17:47 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:17:47.694821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0afcd-829f-4064-acfc-be74b7ab6409 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:47.705830 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0afcd-829f-4064-acfc-be74b7ab6409 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:47.710554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c8ca9-042b-4cb7-a775-7863d21248dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:47.711204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c8ca9-042b-4cb7-a775-7863d21248dc admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:47.711487 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c8ca9-042b-4cb7-a775-7863d21248dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:47.711764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c8ca9-042b-4cb7-a775-7863d21248dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:47.712539 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c8ca9-042b-4cb7-a775-7863d21248dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:47.714206 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c8ca9-042b-4cb7-a775-7863d21248dc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:47.726268 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1198/2419] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:17:47.730210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8c0c4-671a-4f63-ae8a-1e5f59b6ce49 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:47.740039 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8c0c4-671a-4f63-ae8a-1e5f59b6ce49 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:47.744688 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa3d35-79b5-4083-ab94-8321f801b092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:47.745378 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3d35-79b5-4083-ab94-8321f801b092 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:47.745658 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3d35-79b5-4083-ab94-8321f801b092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:47.745932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3d35-79b5-4083-ab94-8321f801b092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:47.746653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa3d35-79b5-4083-ab94-8321f801b092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:47.748225 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa3d35-79b5-4083-ab94-8321f801b092 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:47.757915 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1222/2420] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:17:47.761946 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c8ca9-042b-4cb7-a775-7863d21248dc admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:47.772454 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c8ca9-042b-4cb7-a775-7863d21248dc admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:47.777199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2d4f3-b6c2-45ea-a7f1-f91058dff8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:47.778073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2d4f3-b6c2-45ea-a7f1-f91058dff8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:47.778356 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2d4f3-b6c2-45ea-a7f1-f91058dff8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:47.778635 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2d4f3-b6c2-45ea-a7f1-f91058dff8d4 admin admin] PATH_INFO: `/v3/projects/89551c23f02f4ee7a29f7ba8e8b63dc1/users/c20d98c8be114c6e87e109f74cb62fdc/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:47.793993 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2d4f3-b6c2-45ea-a7f1-f91058dff8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89551c23f02f4ee7a29f7ba8e8b63dc1, user_id=c20d98c8be114c6e87e109f74cb62fdc, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:47.796741 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2d4f3-b6c2-45ea-a7f1-f91058dff8d4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:47.878126 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1199/2421] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:17:47 2022] PUT /identity/v3/projects/89551c23f02f4ee7a29f7ba8e8b63dc1/users/c20d98c8be114c6e87e109f74cb62fdc/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:17:47.886234 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1b782-6893-4c62-a863-25314ef7a3a8 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:47.886523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1b782-6893-4c62-a863-25314ef7a3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:47.886820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1b782-6893-4c62-a863-25314ef7a3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:47.904492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0be1b782-6893-4c62-a863-25314ef7a3a8 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:17:47.905710 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0be1b782-6893-4c62-a863-25314ef7a3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:17:47.960192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1223/2422] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:17:47.969668 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2d4f3-b6c2-45ea-a7f1-f91058dff8d4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:47.971459 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2bb2d4f3-b6c2-45ea-a7f1-f91058dff8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:17:48.026074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2d4f3-b6c2-45ea-a7f1-f91058dff8d4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:48.029928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d882f62-f8e7-443a-998d-528bceb3d87b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:48.030567 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d882f62-f8e7-443a-998d-528bceb3d87b service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:48.030852 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d882f62-f8e7-443a-998d-528bceb3d87b service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:48.031131 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d882f62-f8e7-443a-998d-528bceb3d87b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:48.040029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d882f62-f8e7-443a-998d-528bceb3d87b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:48.041538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d882f62-f8e7-443a-998d-528bceb3d87b service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:48.051152 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1200/2423] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:17:53.112645 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21ceeb-28ff-4fc0-9d49-4dcce6cfab75 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:53.113248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21ceeb-28ff-4fc0-9d49-4dcce6cfab75 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:53.113248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21ceeb-28ff-4fc0-9d49-4dcce6cfab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:53.141524 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5a21ceeb-28ff-4fc0-9d49-4dcce6cfab75 None None] MFA Rules not processed for user `c20d98c8be114c6e87e109f74cb62fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:17:53.142768 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5a21ceeb-28ff-4fc0-9d49-4dcce6cfab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:17:53.207803 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1224/2424] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:17:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:17:53.212352 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d882f62-f8e7-443a-998d-528bceb3d87b service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:53.222380 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d882f62-f8e7-443a-998d-528bceb3d87b service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:53.227112 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644bd37-b33f-48ab-af03-34d2491083d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:53.227768 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644bd37-b33f-48ab-af03-34d2491083d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:53.228051 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644bd37-b33f-48ab-af03-34d2491083d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:53.228328 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644bd37-b33f-48ab-af03-34d2491083d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:53.229028 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644bd37-b33f-48ab-af03-34d2491083d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:53.231012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644bd37-b33f-48ab-af03-34d2491083d7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:53.304909 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1201/2425] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:17:53 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:17:53.310156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21ceeb-28ff-4fc0-9d49-4dcce6cfab75 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:53.321486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21ceeb-28ff-4fc0-9d49-4dcce6cfab75 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:53.378830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32e2d2-3733-400b-9c3f-7f17fdb3bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:53.379511 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32e2d2-3733-400b-9c3f-7f17fdb3bba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:53.379836 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32e2d2-3733-400b-9c3f-7f17fdb3bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:53.380060 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32e2d2-3733-400b-9c3f-7f17fdb3bba6 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:53.380747 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32e2d2-3733-400b-9c3f-7f17fdb3bba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:53.382827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32e2d2-3733-400b-9c3f-7f17fdb3bba6 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:53.463255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1225/2426] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:17:53 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:17:53.467486 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644bd37-b33f-48ab-af03-34d2491083d7 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:53.478554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644bd37-b33f-48ab-af03-34d2491083d7 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:53.483274 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0edaa6-645b-4c71-b18e-7bc7507d152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:53.483957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0edaa6-645b-4c71-b18e-7bc7507d152e admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:53.484280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0edaa6-645b-4c71-b18e-7bc7507d152e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:53.484556 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0edaa6-645b-4c71-b18e-7bc7507d152e admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:53.485314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0edaa6-645b-4c71-b18e-7bc7507d152e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:53.486957 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0edaa6-645b-4c71-b18e-7bc7507d152e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:53.497335 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1202/2427] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:17:53.501410 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32e2d2-3733-400b-9c3f-7f17fdb3bba6 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:53.511440 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32e2d2-3733-400b-9c3f-7f17fdb3bba6 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:53.516580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65f232-280d-4acb-96aa-c14b2724f015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:53.517487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65f232-280d-4acb-96aa-c14b2724f015 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:53.517770 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65f232-280d-4acb-96aa-c14b2724f015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:53.518046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65f232-280d-4acb-96aa-c14b2724f015 admin admin] PATH_INFO: `/v3/projects/a3ae17cdfbf1451b94bcf9387d4003ec/users/5f5b24c4d4e34fb8a81c4523610a48cc/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:53.532713 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65f232-280d-4acb-96aa-c14b2724f015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ae17cdfbf1451b94bcf9387d4003ec, user_id=5f5b24c4d4e34fb8a81c4523610a48cc, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:53.535385 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65f232-280d-4acb-96aa-c14b2724f015 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:53.588230 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1226/2428] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:17:53 2022] PUT /identity/v3/projects/a3ae17cdfbf1451b94bcf9387d4003ec/users/5f5b24c4d4e34fb8a81c4523610a48cc/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:17:53.592244 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0edaa6-645b-4c71-b18e-7bc7507d152e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:53.602779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0edaa6-645b-4c71-b18e-7bc7507d152e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:53.659562 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bbe44-3dba-4b9c-8540-36084536c6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:53.660225 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bbe44-3dba-4b9c-8540-36084536c6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:53.660505 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bbe44-3dba-4b9c-8540-36084536c6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:53.660777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bbe44-3dba-4b9c-8540-36084536c6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:53.661589 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bbe44-3dba-4b9c-8540-36084536c6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:53.663221 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bbe44-3dba-4b9c-8540-36084536c6e2 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:53.673435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1203/2429] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:17:53.677834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65f232-280d-4acb-96aa-c14b2724f015 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:53.688164 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65f232-280d-4acb-96aa-c14b2724f015 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:53.692735 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3055f-f554-4493-ad59-d1139b11b935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:53.693635 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3055f-f554-4493-ad59-d1139b11b935 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:53.693913 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3055f-f554-4493-ad59-d1139b11b935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:53.694178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3055f-f554-4493-ad59-d1139b11b935 admin admin] PATH_INFO: `/v3/projects/a3ae17cdfbf1451b94bcf9387d4003ec/users/5f5b24c4d4e34fb8a81c4523610a48cc/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:53.696162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3055f-f554-4493-ad59-d1139b11b935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ae17cdfbf1451b94bcf9387d4003ec, user_id=5f5b24c4d4e34fb8a81c4523610a48cc, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:53.698791 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3055f-f554-4493-ad59-d1139b11b935 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:53.709613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1227/2430] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:17:53 2022] PUT /identity/v3/projects/a3ae17cdfbf1451b94bcf9387d4003ec/users/5f5b24c4d4e34fb8a81c4523610a48cc/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:17:59.379172 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85efce-72a8-45c6-b7b4-7bed4bb7b5dd None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:59.379627 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85efce-72a8-45c6-b7b4-7bed4bb7b5dd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:59.380082 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85efce-72a8-45c6-b7b4-7bed4bb7b5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:59.416030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ea85efce-72a8-45c6-b7b4-7bed4bb7b5dd None None] MFA Rules not processed for user `5f5b24c4d4e34fb8a81c4523610a48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:17:59.417524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ea85efce-72a8-45c6-b7b4-7bed4bb7b5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:17:59.492646 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1204/2431] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:17:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:17:59.504060 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3055f-f554-4493-ad59-d1139b11b935 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:17:59.505821 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7ef3055f-f554-4493-ad59-d1139b11b935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:17:59.579934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3055f-f554-4493-ad59-d1139b11b935 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:17:59.586052 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bbb1d-4c7c-4aec-8c2d-ec00e89f1fa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:17:59.586761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bbb1d-4c7c-4aec-8c2d-ec00e89f1fa8 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:17:59.587043 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bbb1d-4c7c-4aec-8c2d-ec00e89f1fa8 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:17:59.587316 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bbb1d-4c7c-4aec-8c2d-ec00e89f1fa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:17:59.645308 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116bbb1d-4c7c-4aec-8c2d-ec00e89f1fa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:17:59.646916 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116bbb1d-4c7c-4aec-8c2d-ec00e89f1fa8 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:17:59.657731 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1228/2432] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:17:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:18:02.284500 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198902eb-b7c8-4eb2-a561-831f18067162 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:02.285080 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198902eb-b7c8-4eb2-a561-831f18067162 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:02.285080 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198902eb-b7c8-4eb2-a561-831f18067162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:02.311210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-198902eb-b7c8-4eb2-a561-831f18067162 None None] MFA Rules not processed for user `c20d98c8be114c6e87e109f74cb62fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:18:02.313177 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-198902eb-b7c8-4eb2-a561-831f18067162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:02.324175 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1205/2433] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:18:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:18:02.731628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64057891-d0e3-4950-959d-6d3bc7559d51 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:02.734387 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64057891-d0e3-4950-959d-6d3bc7559d51 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:02.734387 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64057891-d0e3-4950-959d-6d3bc7559d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:02.750166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-64057891-d0e3-4950-959d-6d3bc7559d51 None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:18:02.751348 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-64057891-d0e3-4950-959d-6d3bc7559d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:02.811253 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1229/2434] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:18:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:18:02.958728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198902eb-b7c8-4eb2-a561-831f18067162 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:18:02.960290 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-198902eb-b7c8-4eb2-a561-831f18067162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:03.030725 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198902eb-b7c8-4eb2-a561-831f18067162 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:18:03.036184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b739f9-e5b2-4579-aad7-09637067ef80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:18:03.036871 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b739f9-e5b2-4579-aad7-09637067ef80 service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:03.037204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b739f9-e5b2-4579-aad7-09637067ef80 service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:03.040380 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b739f9-e5b2-4579-aad7-09637067ef80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:03.046033 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b739f9-e5b2-4579-aad7-09637067ef80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:18:03.047611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b739f9-e5b2-4579-aad7-09637067ef80 service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:18:03.056452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1206/2435] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:18:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 11:18:19.192919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64057891-d0e3-4950-959d-6d3bc7559d51 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:18:19.253722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64057891-d0e3-4950-959d-6d3bc7559d51 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:18:19.258013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223003e-c224-4429-923b-2402abf2d0c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:18:19.258683 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223003e-c224-4429-923b-2402abf2d0c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:19.258951 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223003e-c224-4429-923b-2402abf2d0c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:19.259281 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223003e-c224-4429-923b-2402abf2d0c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:19.261177 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1223003e-c224-4429-923b-2402abf2d0c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:19.275308 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223003e-c224-4429-923b-2402abf2d0c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:18:19.276725 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223003e-c224-4429-923b-2402abf2d0c1 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:18:19.288023 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1230/2436] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:18:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:18:20.465444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b739f9-e5b2-4579-aad7-09637067ef80 service swift] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:18:20.467122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-49b739f9-e5b2-4579-aad7-09637067ef80 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:20.479515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b739f9-e5b2-4579-aad7-09637067ef80 service swift] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:18:20.483146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7a84f-bc57-4ff1-9748-583ee9d642ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:18:20.483774 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7a84f-bc57-4ff1-9748-583ee9d642ae service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:20.484053 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7a84f-bc57-4ff1-9748-583ee9d642ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:20.484327 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7a84f-bc57-4ff1-9748-583ee9d642ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:20.486033 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-15e7a84f-bc57-4ff1-9748-583ee9d642ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:20.500285 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7a84f-bc57-4ff1-9748-583ee9d642ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:18:20.501792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7a84f-bc57-4ff1-9748-583ee9d642ae service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:18:20.513515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1207/2437] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:18:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:18:26.001293 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e815d-a94f-4bb6-8680-956d5dcefeaf None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:26.001863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e815d-a94f-4bb6-8680-956d5dcefeaf None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:26.001863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e815d-a94f-4bb6-8680-956d5dcefeaf None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:26.003212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1231/2438] 10.222.0.62 () {54 vars in 921 bytes} [Wed Apr 6 11:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:18:26.009610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974ba19-0793-4ea3-a065-60ec81951b55 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:26.010081 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974ba19-0793-4ea3-a065-60ec81951b55 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:26.010250 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974ba19-0793-4ea3-a065-60ec81951b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:26.030639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c974ba19-0793-4ea3-a065-60ec81951b55 None None] MFA Rules not processed for user `650c5809116e4bcd808044236c06dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:18:26.030639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c974ba19-0793-4ea3-a065-60ec81951b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:26.039675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1208/2439] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Apr 6 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:18:26.051583 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e815d-a94f-4bb6-8680-956d5dcefeaf None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:18:26.053292 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ba6e815d-a94f-4bb6-8680-956d5dcefeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:26.110293 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e815d-a94f-4bb6-8680-956d5dcefeaf None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:18:26.113788 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522efa3-8749-4f15-b539-90ca3a1f01b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42cd381cf5c745de9dac8f77a8cea554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:18:26.114426 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522efa3-8749-4f15-b539-90ca3a1f01b4 service glance] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:26.114705 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522efa3-8749-4f15-b539-90ca3a1f01b4 service glance] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:26.114977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522efa3-8749-4f15-b539-90ca3a1f01b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:26.124711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522efa3-8749-4f15-b539-90ca3a1f01b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:18:26.126167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522efa3-8749-4f15-b539-90ca3a1f01b4 service glance] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:18:26.137146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1232/2440] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:18:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:18:26.332060 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79b0a9-2345-40e8-afe9-038fa1f58082 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:26.336681 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79b0a9-2345-40e8-afe9-038fa1f58082 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:26.336681 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79b0a9-2345-40e8-afe9-038fa1f58082 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:26.336681 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1209/2441] 10.222.0.62 () {54 vars in 921 bytes} [Wed Apr 6 11:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:18:26.343021 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989ac7e-1ce3-4c9b-bc9b-7e2d9acbfea2 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:26.343315 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989ac7e-1ce3-4c9b-bc9b-7e2d9acbfea2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:26.343593 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989ac7e-1ce3-4c9b-bc9b-7e2d9acbfea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:26.378211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-3989ac7e-1ce3-4c9b-bc9b-7e2d9acbfea2 None None] MFA Rules not processed for user `e078c6efaf054f7489f7164fdafce714`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:18:26.379399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3989ac7e-1ce3-4c9b-bc9b-7e2d9acbfea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:26.386593 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1233/2442] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Apr 6 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:18:26.398188 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79b0a9-2345-40e8-afe9-038fa1f58082 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:18:26.408822 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79b0a9-2345-40e8-afe9-038fa1f58082 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:18:26.412403 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab103d8-12fd-43c8-9c5d-b95ce4554937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:18:26.413030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab103d8-12fd-43c8-9c5d-b95ce4554937 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:26.413345 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab103d8-12fd-43c8-9c5d-b95ce4554937 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:26.413625 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab103d8-12fd-43c8-9c5d-b95ce4554937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:26.420773 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab103d8-12fd-43c8-9c5d-b95ce4554937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:18:26.422277 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab103d8-12fd-43c8-9c5d-b95ce4554937 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:18:26.430506 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1210/2443] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:18:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:18:26.553505 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4294ff-0ad4-4f69-ae2c-b8a1cbbe5c81 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:26.553736 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4294ff-0ad4-4f69-ae2c-b8a1cbbe5c81 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:26.554517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4294ff-0ad4-4f69-ae2c-b8a1cbbe5c81 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:26.555914 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1234/2444] 10.222.0.62 () {54 vars in 921 bytes} [Wed Apr 6 11:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 11:18:26.561421 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71932-baa4-4aaf-bfb1-1be34dcbfb00 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:26.561707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71932-baa4-4aaf-bfb1-1be34dcbfb00 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:26.561981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71932-baa4-4aaf-bfb1-1be34dcbfb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:26.580184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-91c71932-baa4-4aaf-bfb1-1be34dcbfb00 None None] MFA Rules not processed for user `650c5809116e4bcd808044236c06dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:18:26.581508 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-91c71932-baa4-4aaf-bfb1-1be34dcbfb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:26.590701 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1211/2445] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Apr 6 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:18:26.601532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4294ff-0ad4-4f69-ae2c-b8a1cbbe5c81 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:18:26.612325 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4294ff-0ad4-4f69-ae2c-b8a1cbbe5c81 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:18:26.616029 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdee650-54b9-429d-8aad-61b58bacef05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:18:26.617543 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdee650-54b9-429d-8aad-61b58bacef05 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:26.617833 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdee650-54b9-429d-8aad-61b58bacef05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:26.618105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdee650-54b9-429d-8aad-61b58bacef05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:26.628308 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdee650-54b9-429d-8aad-61b58bacef05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:18:26.629859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdee650-54b9-429d-8aad-61b58bacef05 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:18:26.640627 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1235/2446] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:18:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:18:28.838501 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ade605-3cb6-45a1-a12c-a327f9e152a2 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:28.838952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ade605-3cb6-45a1-a12c-a327f9e152a2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:28.839055 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ade605-3cb6-45a1-a12c-a327f9e152a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:28.856998 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-32ade605-3cb6-45a1-a12c-a327f9e152a2 None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:18:28.858229 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-32ade605-3cb6-45a1-a12c-a327f9e152a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:28.866318 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1212/2447] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:18:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:18:28.878202 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdee650-54b9-429d-8aad-61b58bacef05 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:18:28.889861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdee650-54b9-429d-8aad-61b58bacef05 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:18:28.894840 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774c4d1-270c-4b93-9927-f295ab2bd211 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:18:28.895474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774c4d1-270c-4b93-9927-f295ab2bd211 service swift] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:28.895758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774c4d1-270c-4b93-9927-f295ab2bd211 service swift] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:28.896037 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774c4d1-270c-4b93-9927-f295ab2bd211 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:28.904804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774c4d1-270c-4b93-9927-f295ab2bd211 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:18:28.906412 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774c4d1-270c-4b93-9927-f295ab2bd211 service swift] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:18:28.914311 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1236/2448] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:18:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 11:18:30.726455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ade605-3cb6-45a1-a12c-a327f9e152a2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:18:30.727923 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-32ade605-3cb6-45a1-a12c-a327f9e152a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:30.743273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ade605-3cb6-45a1-a12c-a327f9e152a2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:18:30.748740 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aeac4d-a4cb-4b7c-87f5-6bcc2cc5a640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:18:30.749415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeac4d-a4cb-4b7c-87f5-6bcc2cc5a640 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:30.749690 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeac4d-a4cb-4b7c-87f5-6bcc2cc5a640 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:30.749965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeac4d-a4cb-4b7c-87f5-6bcc2cc5a640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:30.751791 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-63aeac4d-a4cb-4b7c-87f5-6bcc2cc5a640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:30.839698 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aeac4d-a4cb-4b7c-87f5-6bcc2cc5a640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:18:30.841474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aeac4d-a4cb-4b7c-87f5-6bcc2cc5a640 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:18:30.862034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1213/2449] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:18:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:18:48.842424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774c4d1-270c-4b93-9927-f295ab2bd211 service swift] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:18:48.852672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774c4d1-270c-4b93-9927-f295ab2bd211 service swift] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:18:48.856470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b3002-57be-4eab-a8e6-c35a67911230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:18:48.857401 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b3002-57be-4eab-a8e6-c35a67911230 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:48.857686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b3002-57be-4eab-a8e6-c35a67911230 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:48.857961 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b3002-57be-4eab-a8e6-c35a67911230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:48.859719 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-100b3002-57be-4eab-a8e6-c35a67911230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:48.870067 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b3002-57be-4eab-a8e6-c35a67911230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:18:48.871169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b3002-57be-4eab-a8e6-c35a67911230 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:18:48.879445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1237/2450] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:18:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:18:53.562397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f045-821b-4f98-83b2-88ca21dc436e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:53.562940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f045-821b-4f98-83b2-88ca21dc436e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:53.562940 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f045-821b-4f98-83b2-88ca21dc436e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:53.583419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-da48f045-821b-4f98-83b2-88ca21dc436e None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:18:53.584899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-da48f045-821b-4f98-83b2-88ca21dc436e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:18:53.594339 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1214/2451] 10.222.0.62 () {58 vars in 967 bytes} [Wed Apr 6 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:18:53.609270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b3002-57be-4eab-a8e6-c35a67911230 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:18:53.622143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b3002-57be-4eab-a8e6-c35a67911230 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:18:53.627228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939cb1c-f600-4f57-ae9d-807bb70d80a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:18:53.630939 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939cb1c-f600-4f57-ae9d-807bb70d80a7 service swift] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:18:53.630939 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939cb1c-f600-4f57-ae9d-807bb70d80a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:18:53.630939 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939cb1c-f600-4f57-ae9d-807bb70d80a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:18:53.637471 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939cb1c-f600-4f57-ae9d-807bb70d80a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:18:53.639167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939cb1c-f600-4f57-ae9d-807bb70d80a7 service swift] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:18:53.647344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1238/2452] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:18:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 06 11:19:05.940695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48f045-821b-4f98-83b2-88ca21dc436e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:05.950431 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48f045-821b-4f98-83b2-88ca21dc436e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:05.954194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88724e63-c4f7-4e58-b639-93d64f3ce232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:05.954841 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88724e63-c4f7-4e58-b639-93d64f3ce232 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:05.955122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88724e63-c4f7-4e58-b639-93d64f3ce232 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:05.955397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88724e63-c4f7-4e58-b639-93d64f3ce232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:05.965267 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88724e63-c4f7-4e58-b639-93d64f3ce232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:05.967184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88724e63-c4f7-4e58-b639-93d64f3ce232 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:05.976975 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1215/2453] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:19:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:19:38.094388 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939cb1c-f600-4f57-ae9d-807bb70d80a7 service swift] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:38.097596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c939cb1c-f600-4f57-ae9d-807bb70d80a7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:19:38.153188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939cb1c-f600-4f57-ae9d-807bb70d80a7 service swift] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:38.157453 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ea726-4ae9-40f1-93a9-fc9484b25b3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:38.160945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ea726-4ae9-40f1-93a9-fc9484b25b3d service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:38.160945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ea726-4ae9-40f1-93a9-fc9484b25b3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:38.160945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ea726-4ae9-40f1-93a9-fc9484b25b3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:38.160945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fa4ea726-4ae9-40f1-93a9-fc9484b25b3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:19:38.238769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ea726-4ae9-40f1-93a9-fc9484b25b3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:38.240194 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ea726-4ae9-40f1-93a9-fc9484b25b3d service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:38.258193 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1239/2454] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:19:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:19:41.119744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88724e63-c4f7-4e58-b639-93d64f3ce232 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:41.128722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88724e63-c4f7-4e58-b639-93d64f3ce232 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:41.132284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40e1ea-580a-4575-8de9-ba5fcaee5f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:41.132902 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40e1ea-580a-4575-8de9-ba5fcaee5f84 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:41.133248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40e1ea-580a-4575-8de9-ba5fcaee5f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:41.133521 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40e1ea-580a-4575-8de9-ba5fcaee5f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:41.135246 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-aa40e1ea-580a-4575-8de9-ba5fcaee5f84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:19:41.195402 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40e1ea-580a-4575-8de9-ba5fcaee5f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:41.196860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40e1ea-580a-4575-8de9-ba5fcaee5f84 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:41.206586 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1216/2455] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:19:45.403737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ea726-4ae9-40f1-93a9-fc9484b25b3d service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:45.405255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fa4ea726-4ae9-40f1-93a9-fc9484b25b3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:19:45.419291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ea726-4ae9-40f1-93a9-fc9484b25b3d service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:45.423934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81981d55-f002-4277-bd19-8c09bc5f95ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:45.424838 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981d55-f002-4277-bd19-8c09bc5f95ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:45.425169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981d55-f002-4277-bd19-8c09bc5f95ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:45.425443 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981d55-f002-4277-bd19-8c09bc5f95ab admin admin] PATH_INFO: `/v3/users/e9f1dd7aa9bc47f59656d326eb6cc751` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:45.426621 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81981d55-f002-4277-bd19-8c09bc5f95ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f1dd7aa9bc47f59656d326eb6cc751)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:45.428527 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81981d55-f002-4277-bd19-8c09bc5f95ab admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:45.565208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-81981d55-f002-4277-bd19-8c09bc5f95ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f1dd7aa9bc47f59656d326eb6cc751'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:19:45.565886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-81981d55-f002-4277-bd19-8c09bc5f95ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f1dd7aa9bc47f59656d326eb6cc751'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:19:45.566493 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-81981d55-f002-4277-bd19-8c09bc5f95ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f1dd7aa9bc47f59656d326eb6cc751'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:19:45.577682 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-81981d55-f002-4277-bd19-8c09bc5f95ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f1dd7aa9bc47f59656d326eb6cc751'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:19:45.584184 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-81981d55-f002-4277-bd19-8c09bc5f95ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f1dd7aa9bc47f59656d326eb6cc751'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:19:45.648104 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1240/2456] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:19:45 2022] DELETE /identity/v3/users/e9f1dd7aa9bc47f59656d326eb6cc751 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:19:45.880360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40e1ea-580a-4575-8de9-ba5fcaee5f84 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:45.892415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40e1ea-580a-4575-8de9-ba5fcaee5f84 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:45.950231 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:45.951176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:45.951419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:45.951691 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7 admin admin] PATH_INFO: `/v3/projects/866279fd7e7342ada14b63bbbd3d64be` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:45.952876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=866279fd7e7342ada14b63bbbd3d64be)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:45.954866 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:46.055183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866279fd7e7342ada14b63bbbd3d64be', 'request_id': 'req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:19:46.061273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866279fd7e7342ada14b63bbbd3d64be', 'request_id': 'req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:19:46.066559 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866279fd7e7342ada14b63bbbd3d64be', 'request_id': 'req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:19:46.139626 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7 admin admin] The token cache is being invalidate because project 866279fd7e7342ada14b63bbbd3d64be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:19:46.139942 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:19:46.140606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3cf5207c-6d11-4d07-aa80-0fcbfc6df2c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:19:46.142304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1217/2457] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:19:45 2022] DELETE /identity/v3/projects/866279fd7e7342ada14b63bbbd3d64be => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:19:46.147146 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19071e63-ec21-42ed-9908-059b755addff None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:46.147494 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19071e63-ec21-42ed-9908-059b755addff None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:46.147783 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19071e63-ec21-42ed-9908-059b755addff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:46.165932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-19071e63-ec21-42ed-9908-059b755addff None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:19:46.167395 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-19071e63-ec21-42ed-9908-059b755addff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:19:46.223557 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1241/2458] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:19:46.231766 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985a33c-be7a-4a05-b6db-81e3af375a65 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:46.232053 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985a33c-be7a-4a05-b6db-81e3af375a65 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:46.232933 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985a33c-be7a-4a05-b6db-81e3af375a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:46.250590 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d985a33c-be7a-4a05-b6db-81e3af375a65 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:19:46.251794 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d985a33c-be7a-4a05-b6db-81e3af375a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:19:46.259663 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1218/2459] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:19:46.263617 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19071e63-ec21-42ed-9908-059b755addff None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:46.272895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19071e63-ec21-42ed-9908-059b755addff None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:46.277395 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16975d47-4f78-4ed4-a573-54f7b7406385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:46.278032 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16975d47-4f78-4ed4-a573-54f7b7406385 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:46.278310 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16975d47-4f78-4ed4-a573-54f7b7406385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:46.278577 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16975d47-4f78-4ed4-a573-54f7b7406385 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:46.279895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16975d47-4f78-4ed4-a573-54f7b7406385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:19:46.280198 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16975d47-4f78-4ed4-a573-54f7b7406385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:46.281808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16975d47-4f78-4ed4-a573-54f7b7406385 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:46.293604 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1242/2460] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:19:46.298225 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985a33c-be7a-4a05-b6db-81e3af375a65 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:46.307141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985a33c-be7a-4a05-b6db-81e3af375a65 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:46.311787 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363a1bc-65e6-4224-9497-68ceac844cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:46.312419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363a1bc-65e6-4224-9497-68ceac844cfd admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:46.312699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363a1bc-65e6-4224-9497-68ceac844cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:46.312973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363a1bc-65e6-4224-9497-68ceac844cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:46.313682 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363a1bc-65e6-4224-9497-68ceac844cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:46.315628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363a1bc-65e6-4224-9497-68ceac844cfd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:46.393701 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1219/2461] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:19:46 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:19:46.398076 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16975d47-4f78-4ed4-a573-54f7b7406385 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:46.408968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16975d47-4f78-4ed4-a573-54f7b7406385 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:46.462706 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacba82-b65b-4e09-bf5f-10dc50291fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:46.463381 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacba82-b65b-4e09-bf5f-10dc50291fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:46.463672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacba82-b65b-4e09-bf5f-10dc50291fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:46.463946 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacba82-b65b-4e09-bf5f-10dc50291fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:46.464628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacba82-b65b-4e09-bf5f-10dc50291fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:46.466557 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacba82-b65b-4e09-bf5f-10dc50291fc1 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:46.586238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1243/2462] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:19:46 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:19:46.590588 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363a1bc-65e6-4224-9497-68ceac844cfd admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:46.601699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363a1bc-65e6-4224-9497-68ceac844cfd admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:46.606409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeea98-3093-4357-888e-64475ed56302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:46.607125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeea98-3093-4357-888e-64475ed56302 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:46.607409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeea98-3093-4357-888e-64475ed56302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:46.607689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeea98-3093-4357-888e-64475ed56302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:46.608433 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeea98-3093-4357-888e-64475ed56302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:46.610153 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeea98-3093-4357-888e-64475ed56302 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:46.620610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1220/2463] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:19:46.624582 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacba82-b65b-4e09-bf5f-10dc50291fc1 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:46.634724 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacba82-b65b-4e09-bf5f-10dc50291fc1 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:46.640257 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03536ee-bbf6-4a05-8326-dc183ad54196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:46.641026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03536ee-bbf6-4a05-8326-dc183ad54196 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:46.641405 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03536ee-bbf6-4a05-8326-dc183ad54196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:46.641773 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03536ee-bbf6-4a05-8326-dc183ad54196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:46.642560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03536ee-bbf6-4a05-8326-dc183ad54196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:46.644326 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03536ee-bbf6-4a05-8326-dc183ad54196 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:46.656566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1244/2464] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:19:46.660694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeea98-3093-4357-888e-64475ed56302 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:46.671570 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeea98-3093-4357-888e-64475ed56302 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:46.676789 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bac253-4f04-41cc-8298-83088b3ca31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:46.677756 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bac253-4f04-41cc-8298-83088b3ca31a admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:46.678034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bac253-4f04-41cc-8298-83088b3ca31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:46.678310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bac253-4f04-41cc-8298-83088b3ca31a admin admin] PATH_INFO: `/v3/projects/04c08aac593243d8ad8303ccf387011a/users/58ed2c26ad8c4464a2ac192d700ba5ac/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:46.695305 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bac253-4f04-41cc-8298-83088b3ca31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c08aac593243d8ad8303ccf387011a, user_id=58ed2c26ad8c4464a2ac192d700ba5ac, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:46.698034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bac253-4f04-41cc-8298-83088b3ca31a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:46.774983 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1221/2465] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:19:46 2022] PUT /identity/v3/projects/04c08aac593243d8ad8303ccf387011a/users/58ed2c26ad8c4464a2ac192d700ba5ac/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:19:46.785196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d7f6-2731-44a8-83bc-88ecd0725f9e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:46.785492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d7f6-2731-44a8-83bc-88ecd0725f9e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:46.785777 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d7f6-2731-44a8-83bc-88ecd0725f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:46.814229 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e8b5d7f6-2731-44a8-83bc-88ecd0725f9e None None] MFA Rules not processed for user `58ed2c26ad8c4464a2ac192d700ba5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:19:46.815005 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e8b5d7f6-2731-44a8-83bc-88ecd0725f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:19:46.880931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1245/2466] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:19:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:19:46.885305 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bac253-4f04-41cc-8298-83088b3ca31a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:46.952986 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bac253-4f04-41cc-8298-83088b3ca31a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:46.957612 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0193f-9aff-4597-bc56-2c2ac5f3ff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:46.958272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0193f-9aff-4597-bc56-2c2ac5f3ff86 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:46.958552 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0193f-9aff-4597-bc56-2c2ac5f3ff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:46.958852 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0193f-9aff-4597-bc56-2c2ac5f3ff86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:46.959538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0193f-9aff-4597-bc56-2c2ac5f3ff86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:46.961564 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0193f-9aff-4597-bc56-2c2ac5f3ff86 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:47.033524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1222/2467] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:19:46 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:19:47.037625 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5d7f6-2731-44a8-83bc-88ecd0725f9e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:47.050271 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5d7f6-2731-44a8-83bc-88ecd0725f9e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:47.106478 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb52e3-fb30-49c0-ab0b-f44bcca1da16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:47.107190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb52e3-fb30-49c0-ab0b-f44bcca1da16 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:47.107471 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb52e3-fb30-49c0-ab0b-f44bcca1da16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:47.107750 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb52e3-fb30-49c0-ab0b-f44bcca1da16 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:47.108476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb52e3-fb30-49c0-ab0b-f44bcca1da16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:47.110424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb52e3-fb30-49c0-ab0b-f44bcca1da16 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:47.166433 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1246/2468] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:19:47 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:19:47.167975 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0193f-9aff-4597-bc56-2c2ac5f3ff86 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:47.178907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0193f-9aff-4597-bc56-2c2ac5f3ff86 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:47.183585 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5270849-d051-485a-8064-87f6b45e579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:47.184248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270849-d051-485a-8064-87f6b45e579d admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:47.184538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270849-d051-485a-8064-87f6b45e579d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:47.184814 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270849-d051-485a-8064-87f6b45e579d admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:47.185601 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5270849-d051-485a-8064-87f6b45e579d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:47.187415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5270849-d051-485a-8064-87f6b45e579d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:47.200818 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1223/2469] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:19:47.202521 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb52e3-fb30-49c0-ab0b-f44bcca1da16 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:47.215255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb52e3-fb30-49c0-ab0b-f44bcca1da16 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:47.219195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351a912-fd98-44f5-ace0-59bb21674b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:47.220159 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351a912-fd98-44f5-ace0-59bb21674b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:47.220446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351a912-fd98-44f5-ace0-59bb21674b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:47.220725 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351a912-fd98-44f5-ace0-59bb21674b33 admin admin] PATH_INFO: `/v3/projects/4274792f674748e29d1dbdf2c6c28fef/users/d6c42bd6aa5d4ea89c01dcefe89a2a98/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:47.237983 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351a912-fd98-44f5-ace0-59bb21674b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4274792f674748e29d1dbdf2c6c28fef, user_id=d6c42bd6aa5d4ea89c01dcefe89a2a98, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:47.243071 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351a912-fd98-44f5-ace0-59bb21674b33 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:47.306061 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1247/2470] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:19:47 2022] PUT /identity/v3/projects/4274792f674748e29d1dbdf2c6c28fef/users/d6c42bd6aa5d4ea89c01dcefe89a2a98/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:19:47.310049 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5270849-d051-485a-8064-87f6b45e579d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:47.321889 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5270849-d051-485a-8064-87f6b45e579d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:47.378989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f0f27-ba6b-4f8b-b57b-6f3d3f8602d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:47.379673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f0f27-ba6b-4f8b-b57b-6f3d3f8602d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:47.379934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f0f27-ba6b-4f8b-b57b-6f3d3f8602d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:47.380210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f0f27-ba6b-4f8b-b57b-6f3d3f8602d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:47.380923 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f0f27-ba6b-4f8b-b57b-6f3d3f8602d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:47.382584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f0f27-ba6b-4f8b-b57b-6f3d3f8602d3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:47.392872 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1224/2471] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:19:47.397176 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351a912-fd98-44f5-ace0-59bb21674b33 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:47.408111 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351a912-fd98-44f5-ace0-59bb21674b33 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:47.412763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1facc-499f-4577-8fcc-e86549053c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:47.413686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1facc-499f-4577-8fcc-e86549053c52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:47.413968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1facc-499f-4577-8fcc-e86549053c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:47.414245 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1facc-499f-4577-8fcc-e86549053c52 admin admin] PATH_INFO: `/v3/projects/4274792f674748e29d1dbdf2c6c28fef/users/d6c42bd6aa5d4ea89c01dcefe89a2a98/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:47.416242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1facc-499f-4577-8fcc-e86549053c52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4274792f674748e29d1dbdf2c6c28fef, user_id=d6c42bd6aa5d4ea89c01dcefe89a2a98, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:47.419213 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1facc-499f-4577-8fcc-e86549053c52 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:47.429646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1248/2472] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:19:47 2022] PUT /identity/v3/projects/4274792f674748e29d1dbdf2c6c28fef/users/d6c42bd6aa5d4ea89c01dcefe89a2a98/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:19:47.440111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a005cc-72c4-461c-b2ae-422ff5ba7e4d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:47.440586 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a005cc-72c4-461c-b2ae-422ff5ba7e4d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:47.440868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a005cc-72c4-461c-b2ae-422ff5ba7e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:47.467387 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-63a005cc-72c4-461c-b2ae-422ff5ba7e4d None None] MFA Rules not processed for user `d6c42bd6aa5d4ea89c01dcefe89a2a98`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:19:47.468514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-63a005cc-72c4-461c-b2ae-422ff5ba7e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:19:47.535007 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1225/2473] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:19:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:19:47.547850 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1facc-499f-4577-8fcc-e86549053c52 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:47.548496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-08d1facc-499f-4577-8fcc-e86549053c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:19:47.618318 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a005cc-72c4-461c-b2ae-422ff5ba7e4d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:47.619687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-63a005cc-72c4-461c-b2ae-422ff5ba7e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:19:47.621446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1facc-499f-4577-8fcc-e86549053c52 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:47.627849 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565f446-acb8-429c-9ead-69fb5fdc2e21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:47.628491 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565f446-acb8-429c-9ead-69fb5fdc2e21 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:47.628776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565f446-acb8-429c-9ead-69fb5fdc2e21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:47.629074 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565f446-acb8-429c-9ead-69fb5fdc2e21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:47.638829 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565f446-acb8-429c-9ead-69fb5fdc2e21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:47.640832 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565f446-acb8-429c-9ead-69fb5fdc2e21 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:47.659824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1249/2474] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:19:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:19:47.701361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a005cc-72c4-461c-b2ae-422ff5ba7e4d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:47.707495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed70b2-d1ca-4c95-9c35-192599027008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:47.708145 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed70b2-d1ca-4c95-9c35-192599027008 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:47.708520 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed70b2-d1ca-4c95-9c35-192599027008 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:47.708686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed70b2-d1ca-4c95-9c35-192599027008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:47.710776 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-26ed70b2-d1ca-4c95-9c35-192599027008 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:19:47.728188 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed70b2-d1ca-4c95-9c35-192599027008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:47.728188 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed70b2-d1ca-4c95-9c35-192599027008 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:47.737751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1226/2475] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:19:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:19:47.880630 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565f446-acb8-429c-9ead-69fb5fdc2e21 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:47.889083 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565f446-acb8-429c-9ead-69fb5fdc2e21 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:47.893335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98080542-b9be-49c1-8c75-78f30daa50b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:47.893979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98080542-b9be-49c1-8c75-78f30daa50b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:47.894254 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98080542-b9be-49c1-8c75-78f30daa50b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:47.894526 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98080542-b9be-49c1-8c75-78f30daa50b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:47.953284 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98080542-b9be-49c1-8c75-78f30daa50b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:47.957386 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98080542-b9be-49c1-8c75-78f30daa50b5 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:47.965759 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1250/2476] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:19:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:19:59.313720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed70b2-d1ca-4c95-9c35-192599027008 service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:19:59.315157 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-26ed70b2-d1ca-4c95-9c35-192599027008 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:19:59.369497 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed70b2-d1ca-4c95-9c35-192599027008 service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:19:59.373095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a9719-24b1-46a7-8c27-50fd15182cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:19:59.373735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a9719-24b1-46a7-8c27-50fd15182cec service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:19:59.374021 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a9719-24b1-46a7-8c27-50fd15182cec service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:19:59.374299 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a9719-24b1-46a7-8c27-50fd15182cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:19:59.376672 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-789a9719-24b1-46a7-8c27-50fd15182cec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:19:59.436220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a9719-24b1-46a7-8c27-50fd15182cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:19:59.437722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a9719-24b1-46a7-8c27-50fd15182cec service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:19:59.447227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1227/2477] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:01.282488 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98080542-b9be-49c1-8c75-78f30daa50b5 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:01.300684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98080542-b9be-49c1-8c75-78f30daa50b5 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:01.305457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727bccd-7ded-49e6-81de-9fce264c68a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:01.306435 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727bccd-7ded-49e6-81de-9fce264c68a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:01.306853 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727bccd-7ded-49e6-81de-9fce264c68a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:01.307196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727bccd-7ded-49e6-81de-9fce264c68a2 admin admin] PATH_INFO: `/v3/users/58ed2c26ad8c4464a2ac192d700ba5ac` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:01.308473 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727bccd-7ded-49e6-81de-9fce264c68a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ed2c26ad8c4464a2ac192d700ba5ac)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:01.310497 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727bccd-7ded-49e6-81de-9fce264c68a2 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:01.463637 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f727bccd-7ded-49e6-81de-9fce264c68a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ed2c26ad8c4464a2ac192d700ba5ac'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:01.464223 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f727bccd-7ded-49e6-81de-9fce264c68a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ed2c26ad8c4464a2ac192d700ba5ac'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:01.464872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f727bccd-7ded-49e6-81de-9fce264c68a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ed2c26ad8c4464a2ac192d700ba5ac'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:01.476467 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f727bccd-7ded-49e6-81de-9fce264c68a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ed2c26ad8c4464a2ac192d700ba5ac'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:01.483128 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f727bccd-7ded-49e6-81de-9fce264c68a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ed2c26ad8c4464a2ac192d700ba5ac'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:01.557278 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1251/2478] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:01 2022] DELETE /identity/v3/users/58ed2c26ad8c4464a2ac192d700ba5ac => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:01.561795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82269da3-258e-42d5-aee5-6d76ddf90d84 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:01.562281 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82269da3-258e-42d5-aee5-6d76ddf90d84 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:01.562595 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82269da3-258e-42d5-aee5-6d76ddf90d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:01.579906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-82269da3-258e-42d5-aee5-6d76ddf90d84 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:01.583552 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-82269da3-258e-42d5-aee5-6d76ddf90d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:01.644306 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1228/2479] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:01.651174 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727bccd-7ded-49e6-81de-9fce264c68a2 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:01.652943 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f727bccd-7ded-49e6-81de-9fce264c68a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:01.711961 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727bccd-7ded-49e6-81de-9fce264c68a2 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:01.715736 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fabeb-fc89-40d9-a440-e4767160730e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:01.716331 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fabeb-fc89-40d9-a440-e4767160730e service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:01.716613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fabeb-fc89-40d9-a440-e4767160730e service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:01.716892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fabeb-fc89-40d9-a440-e4767160730e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:01.726504 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fabeb-fc89-40d9-a440-e4767160730e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:01.727935 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fabeb-fc89-40d9-a440-e4767160730e service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:01.737998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1252/2480] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:02.165284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82269da3-258e-42d5-aee5-6d76ddf90d84 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:02.167952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-82269da3-258e-42d5-aee5-6d76ddf90d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:02.250491 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82269da3-258e-42d5-aee5-6d76ddf90d84 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:02.255851 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:02.256738 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:02.257098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:02.257380 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] PATH_INFO: `/v3/projects/04c08aac593243d8ad8303ccf387011a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:02.258633 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c08aac593243d8ad8303ccf387011a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:02.260637 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:02.356344 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c08aac593243d8ad8303ccf387011a', 'request_id': 'req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:02.362636 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c08aac593243d8ad8303ccf387011a', 'request_id': 'req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:02.368311 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c08aac593243d8ad8303ccf387011a', 'request_id': 'req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:02.420858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] The token cache is being invalidate because project 04c08aac593243d8ad8303ccf387011a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:02.421245 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:02.422048 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:02.427283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1229/2481] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:02 2022] DELETE /identity/v3/projects/04c08aac593243d8ad8303ccf387011a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:02.427801 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fabeb-fc89-40d9-a440-e4767160730e service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:02.490158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fabeb-fc89-40d9-a440-e4767160730e service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:02.561978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c071550-df1e-4fa3-bd81-a90b1c9bf2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:02.563612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c071550-df1e-4fa3-bd81-a90b1c9bf2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:02.563902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c071550-df1e-4fa3-bd81-a90b1c9bf2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:02.564178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c071550-df1e-4fa3-bd81-a90b1c9bf2e2 admin admin] PATH_INFO: `/v3/users/d6c42bd6aa5d4ea89c01dcefe89a2a98` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:02.565942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c071550-df1e-4fa3-bd81-a90b1c9bf2e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c42bd6aa5d4ea89c01dcefe89a2a98)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:02.568138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c071550-df1e-4fa3-bd81-a90b1c9bf2e2 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:02.754180 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5c071550-df1e-4fa3-bd81-a90b1c9bf2e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c42bd6aa5d4ea89c01dcefe89a2a98'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:02.754835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5c071550-df1e-4fa3-bd81-a90b1c9bf2e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c42bd6aa5d4ea89c01dcefe89a2a98'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:02.756086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5c071550-df1e-4fa3-bd81-a90b1c9bf2e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c42bd6aa5d4ea89c01dcefe89a2a98'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:02.767932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5c071550-df1e-4fa3-bd81-a90b1c9bf2e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c42bd6aa5d4ea89c01dcefe89a2a98'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:02.774864 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5c071550-df1e-4fa3-bd81-a90b1c9bf2e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c42bd6aa5d4ea89c01dcefe89a2a98'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:02.838261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1253/2482] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:02 2022] DELETE /identity/v3/users/d6c42bd6aa5d4ea89c01dcefe89a2a98 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:02.944710 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:02.946766 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:02.959899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11ccb7-805f-4ade-924d-1ca02d7fcc70 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:03.015209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b377e6-7ff0-4bf2-871c-19f6c649eb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:03.016023 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b377e6-7ff0-4bf2-871c-19f6c649eb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:03.016298 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b377e6-7ff0-4bf2-871c-19f6c649eb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:03.016565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b377e6-7ff0-4bf2-871c-19f6c649eb7e admin admin] PATH_INFO: `/v3/users/f506156c62014060ab9004b7abbb2369` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:03.017764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b377e6-7ff0-4bf2-871c-19f6c649eb7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f506156c62014060ab9004b7abbb2369)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:03.026291 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b377e6-7ff0-4bf2-871c-19f6c649eb7e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:03.161002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b0b377e6-7ff0-4bf2-871c-19f6c649eb7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f506156c62014060ab9004b7abbb2369'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.162724 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b0b377e6-7ff0-4bf2-871c-19f6c649eb7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f506156c62014060ab9004b7abbb2369'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.163933 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b0b377e6-7ff0-4bf2-871c-19f6c649eb7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f506156c62014060ab9004b7abbb2369'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.214817 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b0b377e6-7ff0-4bf2-871c-19f6c649eb7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f506156c62014060ab9004b7abbb2369'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.228186 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b0b377e6-7ff0-4bf2-871c-19f6c649eb7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f506156c62014060ab9004b7abbb2369'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.241728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1230/2483] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:02 2022] DELETE /identity/v3/users/f506156c62014060ab9004b7abbb2369 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:03.530134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c071550-df1e-4fa3-bd81-a90b1c9bf2e2 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:03.531691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5c071550-df1e-4fa3-bd81-a90b1c9bf2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:03.542145 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b377e6-7ff0-4bf2-871c-19f6c649eb7e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:03.543463 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b0b377e6-7ff0-4bf2-871c-19f6c649eb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:03.562266 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c071550-df1e-4fa3-bd81-a90b1c9bf2e2 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:03.610990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b377e6-7ff0-4bf2-871c-19f6c649eb7e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:03.615690 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7d9b6-47f8-4049-9691-11e04018f755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:03.616544 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7d9b6-47f8-4049-9691-11e04018f755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:03.616826 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7d9b6-47f8-4049-9691-11e04018f755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:03.617124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7d9b6-47f8-4049-9691-11e04018f755 admin admin] PATH_INFO: `/v3/projects/4274792f674748e29d1dbdf2c6c28fef` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:03.618308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7d9b6-47f8-4049-9691-11e04018f755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4274792f674748e29d1dbdf2c6c28fef)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:03.620253 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7d9b6-47f8-4049-9691-11e04018f755 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:03.624539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e3ad5-4dff-4fb1-a13f-3a63c55da821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:03.625498 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e3ad5-4dff-4fb1-a13f-3a63c55da821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:03.625778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e3ad5-4dff-4fb1-a13f-3a63c55da821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:03.626051 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e3ad5-4dff-4fb1-a13f-3a63c55da821 admin admin] PATH_INFO: `/v3/projects/8bcfb6262bb7416b985b1d670dcdf4ec` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:03.627219 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e3ad5-4dff-4fb1-a13f-3a63c55da821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bcfb6262bb7416b985b1d670dcdf4ec)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:03.629103 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e3ad5-4dff-4fb1-a13f-3a63c55da821 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:03.728810 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0de7d9b6-47f8-4049-9691-11e04018f755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4274792f674748e29d1dbdf2c6c28fef', 'request_id': 'req-0de7d9b6-47f8-4049-9691-11e04018f755'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.735530 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0de7d9b6-47f8-4049-9691-11e04018f755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4274792f674748e29d1dbdf2c6c28fef', 'request_id': 'req-0de7d9b6-47f8-4049-9691-11e04018f755'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.740851 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0de7d9b6-47f8-4049-9691-11e04018f755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4274792f674748e29d1dbdf2c6c28fef', 'request_id': 'req-0de7d9b6-47f8-4049-9691-11e04018f755'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.770230 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-641e3ad5-4dff-4fb1-a13f-3a63c55da821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bcfb6262bb7416b985b1d670dcdf4ec', 'request_id': 'req-641e3ad5-4dff-4fb1-a13f-3a63c55da821'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.796692 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0de7d9b6-47f8-4049-9691-11e04018f755 admin admin] The token cache is being invalidate because project 4274792f674748e29d1dbdf2c6c28fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:03.797593 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0de7d9b6-47f8-4049-9691-11e04018f755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.798229 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0de7d9b6-47f8-4049-9691-11e04018f755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.799839 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1231/2484] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:03 2022] DELETE /identity/v3/projects/4274792f674748e29d1dbdf2c6c28fef => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:03.804600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ccb1b-8338-4c05-af16-233a6b95b09b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:03.810321 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ccb1b-8338-4c05-af16-233a6b95b09b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:03.810321 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ccb1b-8338-4c05-af16-233a6b95b09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:03.837238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-641e3ad5-4dff-4fb1-a13f-3a63c55da821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bcfb6262bb7416b985b1d670dcdf4ec', 'request_id': 'req-641e3ad5-4dff-4fb1-a13f-3a63c55da821'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.843834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-641e3ad5-4dff-4fb1-a13f-3a63c55da821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bcfb6262bb7416b985b1d670dcdf4ec', 'request_id': 'req-641e3ad5-4dff-4fb1-a13f-3a63c55da821'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.849143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8e7ccb1b-8338-4c05-af16-233a6b95b09b None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:03.850368 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8e7ccb1b-8338-4c05-af16-233a6b95b09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:03.854490 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-641e3ad5-4dff-4fb1-a13f-3a63c55da821 admin admin] The token cache is being invalidate because project 8bcfb6262bb7416b985b1d670dcdf4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:03.854776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-641e3ad5-4dff-4fb1-a13f-3a63c55da821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.855404 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-641e3ad5-4dff-4fb1-a13f-3a63c55da821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:03.857004 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1254/2485] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:03 2022] DELETE /identity/v3/projects/8bcfb6262bb7416b985b1d670dcdf4ec => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:03.862172 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5613e-1a49-420e-a45f-f4b94dabf7de None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:03.862464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5613e-1a49-420e-a45f-f4b94dabf7de None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:03.862751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5613e-1a49-420e-a45f-f4b94dabf7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:03.880698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-ccd5613e-1a49-420e-a45f-f4b94dabf7de None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:03.881918 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ccd5613e-1a49-420e-a45f-f4b94dabf7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:03.911380 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1232/2486] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:03.919282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4d116-810c-4251-9d31-e81247c9b229 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:03.919573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4d116-810c-4251-9d31-e81247c9b229 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:03.919856 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4d116-810c-4251-9d31-e81247c9b229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:03.937542 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4ee4d116-810c-4251-9d31-e81247c9b229 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:03.938725 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4ee4d116-810c-4251-9d31-e81247c9b229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:03.940896 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1255/2487] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:03.947122 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6a24d-fd43-4078-aaa8-a916e9a96dbd None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:03.947261 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1233/2488] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:03.947675 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6a24d-fd43-4078-aaa8-a916e9a96dbd None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:03.947809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6a24d-fd43-4078-aaa8-a916e9a96dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:03.951007 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4d116-810c-4251-9d31-e81247c9b229 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:03.959812 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4d116-810c-4251-9d31-e81247c9b229 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:03.964398 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e011a2-3f72-44a0-b557-21a288a7eb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:03.965030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e011a2-3f72-44a0-b557-21a288a7eb51 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:03.965337 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e011a2-3f72-44a0-b557-21a288a7eb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:03.965609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e011a2-3f72-44a0-b557-21a288a7eb51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:03.966319 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e011a2-3f72-44a0-b557-21a288a7eb51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:20:03.966620 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e011a2-3f72-44a0-b557-21a288a7eb51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:03.966897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4dc6a24d-fd43-4078-aaa8-a916e9a96dbd None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:03.968158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4dc6a24d-fd43-4078-aaa8-a916e9a96dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:03.968282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e011a2-3f72-44a0-b557-21a288a7eb51 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:03.976513 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1256/2489] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:03.980601 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6a24d-fd43-4078-aaa8-a916e9a96dbd None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:03.983893 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1234/2490] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 11:20:03.985261 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e011a2-3f72-44a0-b557-21a288a7eb51 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:03.990306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6a24d-fd43-4078-aaa8-a916e9a96dbd None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:03.994425 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e011a2-3f72-44a0-b557-21a288a7eb51 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:03.995738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7b9c1-3190-433a-aeba-42ff08852a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:03.996382 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b9c1-3190-433a-aeba-42ff08852a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:03.996666 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b9c1-3190-433a-aeba-42ff08852a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:03.996940 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b9c1-3190-433a-aeba-42ff08852a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:03.997703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7b9c1-3190-433a-aeba-42ff08852a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:20:03.998036 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7b9c1-3190-433a-aeba-42ff08852a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:03.999051 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6c313-1355-46e0-8ff8-776a3c4f972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:03.999618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7b9c1-3190-433a-aeba-42ff08852a4e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:03.999741 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6c313-1355-46e0-8ff8-776a3c4f972d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:03.999956 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6c313-1355-46e0-8ff8-776a3c4f972d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.000231 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6c313-1355-46e0-8ff8-776a3c4f972d admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.001000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6c313-1355-46e0-8ff8-776a3c4f972d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.002828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6c313-1355-46e0-8ff8-776a3c4f972d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.010934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1257/2491] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 11:20:04.015018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7b9c1-3190-433a-aeba-42ff08852a4e admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.024266 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7b9c1-3190-433a-aeba-42ff08852a4e admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.028947 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633127-0ca3-44e1-a65b-57315cac5b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.031812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633127-0ca3-44e1-a65b-57315cac5b50 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.031812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633127-0ca3-44e1-a65b-57315cac5b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.031812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633127-0ca3-44e1-a65b-57315cac5b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.031812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49633127-0ca3-44e1-a65b-57315cac5b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.033394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49633127-0ca3-44e1-a65b-57315cac5b50 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.078675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1235/2492] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:03 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:04.082420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6c313-1355-46e0-8ff8-776a3c4f972d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.124636 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1258/2493] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:04 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:04.128755 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633127-0ca3-44e1-a65b-57315cac5b50 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.143989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6c313-1355-46e0-8ff8-776a3c4f972d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.188319 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633127-0ca3-44e1-a65b-57315cac5b50 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.195232 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641977cd-b2eb-441b-b03b-a060b5fc72a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.195902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641977cd-b2eb-441b-b03b-a060b5fc72a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.196178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641977cd-b2eb-441b-b03b-a060b5fc72a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.196445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641977cd-b2eb-441b-b03b-a060b5fc72a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.197162 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641977cd-b2eb-441b-b03b-a060b5fc72a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.201232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ab0cc-2131-48b9-8d77-7c8624250c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.201447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641977cd-b2eb-441b-b03b-a060b5fc72a4 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.201908 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ab0cc-2131-48b9-8d77-7c8624250c9e admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.202194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ab0cc-2131-48b9-8d77-7c8624250c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.202472 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ab0cc-2131-48b9-8d77-7c8624250c9e admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.203169 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ab0cc-2131-48b9-8d77-7c8624250c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.205168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ab0cc-2131-48b9-8d77-7c8624250c9e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.294953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1259/2494] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:04 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:04.298924 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641977cd-b2eb-441b-b03b-a060b5fc72a4 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.308919 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1236/2495] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:04 2022] POST /identity/v3/users => generated 295 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:04.309105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641977cd-b2eb-441b-b03b-a060b5fc72a4 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.310308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ab0cc-2131-48b9-8d77-7c8624250c9e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.313163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564778d7-8ac8-491f-937d-df27f7baf764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.313814 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564778d7-8ac8-491f-937d-df27f7baf764 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.318501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564778d7-8ac8-491f-937d-df27f7baf764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.318501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564778d7-8ac8-491f-937d-df27f7baf764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.318501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564778d7-8ac8-491f-937d-df27f7baf764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.318501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564778d7-8ac8-491f-937d-df27f7baf764 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.319929 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ab0cc-2131-48b9-8d77-7c8624250c9e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.324723 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1a96d-9104-4d26-a0d3-10cff20ca320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.325399 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1a96d-9104-4d26-a0d3-10cff20ca320 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.325681 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1a96d-9104-4d26-a0d3-10cff20ca320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.325959 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1a96d-9104-4d26-a0d3-10cff20ca320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.330001 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1260/2496] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:04.330149 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1a96d-9104-4d26-a0d3-10cff20ca320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.330149 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1a96d-9104-4d26-a0d3-10cff20ca320 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.331533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564778d7-8ac8-491f-937d-df27f7baf764 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.348373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1237/2497] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:04.348531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564778d7-8ac8-491f-937d-df27f7baf764 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.349519 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1a96d-9104-4d26-a0d3-10cff20ca320 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.351901 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becea74-88cd-4204-97e1-d641d0788cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.352592 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becea74-88cd-4204-97e1-d641d0788cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.352986 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becea74-88cd-4204-97e1-d641d0788cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.353400 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becea74-88cd-4204-97e1-d641d0788cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.354185 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becea74-88cd-4204-97e1-d641d0788cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.356253 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becea74-88cd-4204-97e1-d641d0788cf7 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.359425 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1a96d-9104-4d26-a0d3-10cff20ca320 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.364061 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a816af2-b3c9-47d8-96eb-94ad5e5040cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.364684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a816af2-b3c9-47d8-96eb-94ad5e5040cd admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.364965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a816af2-b3c9-47d8-96eb-94ad5e5040cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.365267 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a816af2-b3c9-47d8-96eb-94ad5e5040cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.365969 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a816af2-b3c9-47d8-96eb-94ad5e5040cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.366280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1261/2498] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:04.367671 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a816af2-b3c9-47d8-96eb-94ad5e5040cd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.370114 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becea74-88cd-4204-97e1-d641d0788cf7 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.380475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1238/2499] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:04.380624 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becea74-88cd-4204-97e1-d641d0788cf7 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.381727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a816af2-b3c9-47d8-96eb-94ad5e5040cd admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.383738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8b3d6-e5b4-46dd-84d6-b7e4540ad962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.384584 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8b3d6-e5b4-46dd-84d6-b7e4540ad962 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.384863 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8b3d6-e5b4-46dd-84d6-b7e4540ad962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.385163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8b3d6-e5b4-46dd-84d6-b7e4540ad962 admin admin] PATH_INFO: `/v3/projects/c89a057a0d804b5c893e220fda1d50af/users/e7d7f75e2d2b429ca63ee2351cf735d0/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.391609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a816af2-b3c9-47d8-96eb-94ad5e5040cd admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.396280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a0ea8-4fd3-4513-97f9-aca333de0af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.397155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a0ea8-4fd3-4513-97f9-aca333de0af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.397434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a0ea8-4fd3-4513-97f9-aca333de0af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.397707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a0ea8-4fd3-4513-97f9-aca333de0af5 admin admin] PATH_INFO: `/v3/projects/88607eed43604d1485151cb4a72c49cf/users/a4966646242a4bd19af080c497d69737/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.399768 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8b3d6-e5b4-46dd-84d6-b7e4540ad962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89a057a0d804b5c893e220fda1d50af, user_id=e7d7f75e2d2b429ca63ee2351cf735d0, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.402755 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8b3d6-e5b4-46dd-84d6-b7e4540ad962 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.412194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a0ea8-4fd3-4513-97f9-aca333de0af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88607eed43604d1485151cb4a72c49cf, user_id=a4966646242a4bd19af080c497d69737, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.414899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a0ea8-4fd3-4513-97f9-aca333de0af5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.499705 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1262/2500] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:04 2022] PUT /identity/v3/projects/c89a057a0d804b5c893e220fda1d50af/users/e7d7f75e2d2b429ca63ee2351cf735d0/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:04.509704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897c51c-aeed-4fa2-8a60-2fbe96b2e70d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.509996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897c51c-aeed-4fa2-8a60-2fbe96b2e70d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.510306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897c51c-aeed-4fa2-8a60-2fbe96b2e70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.532303 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1239/2501] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:04 2022] PUT /identity/v3/projects/88607eed43604d1485151cb4a72c49cf/users/a4966646242a4bd19af080c497d69737/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:04.539034 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4897c51c-aeed-4fa2-8a60-2fbe96b2e70d None None] MFA Rules not processed for user `e7d7f75e2d2b429ca63ee2351cf735d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:04.540237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4897c51c-aeed-4fa2-8a60-2fbe96b2e70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:04.547466 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0bbec-fbac-4652-a87e-ccb928e53a4a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.552877 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0bbec-fbac-4652-a87e-ccb928e53a4a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.552877 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0bbec-fbac-4652-a87e-ccb928e53a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.577979 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c5f0bbec-fbac-4652-a87e-ccb928e53a4a None None] MFA Rules not processed for user `a4966646242a4bd19af080c497d69737`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:04.579715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c5f0bbec-fbac-4652-a87e-ccb928e53a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:04.608813 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1263/2502] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:04.613410 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897c51c-aeed-4fa2-8a60-2fbe96b2e70d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.644295 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1240/2503] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:04.651901 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0bbec-fbac-4652-a87e-ccb928e53a4a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.675492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897c51c-aeed-4fa2-8a60-2fbe96b2e70d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.680255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968eed32-b1f4-4c94-b0b8-8af9445a3db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.680916 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968eed32-b1f4-4c94-b0b8-8af9445a3db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.681294 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968eed32-b1f4-4c94-b0b8-8af9445a3db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.685690 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968eed32-b1f4-4c94-b0b8-8af9445a3db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.685690 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968eed32-b1f4-4c94-b0b8-8af9445a3db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.685690 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968eed32-b1f4-4c94-b0b8-8af9445a3db6 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.711276 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0bbec-fbac-4652-a87e-ccb928e53a4a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.715829 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926577a8-ec6a-473d-8aa5-772760d63c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.716590 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926577a8-ec6a-473d-8aa5-772760d63c9d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.716875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926577a8-ec6a-473d-8aa5-772760d63c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.717185 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926577a8-ec6a-473d-8aa5-772760d63c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.717880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926577a8-ec6a-473d-8aa5-772760d63c9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.719844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926577a8-ec6a-473d-8aa5-772760d63c9d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.741367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1264/2504] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:04 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:04.745334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968eed32-b1f4-4c94-b0b8-8af9445a3db6 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.790458 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1241/2505] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:04 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:04.791546 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926577a8-ec6a-473d-8aa5-772760d63c9d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.805652 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968eed32-b1f4-4c94-b0b8-8af9445a3db6 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.854494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926577a8-ec6a-473d-8aa5-772760d63c9d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.859362 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245d407-f34c-4c3c-af16-ba216edc3ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.861013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d407-f34c-4c3c-af16-ba216edc3ced admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.861013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d407-f34c-4c3c-af16-ba216edc3ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.861013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d407-f34c-4c3c-af16-ba216edc3ced admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.861306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2af03-d2cf-4483-8c2e-4a5f77ac8f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.861429 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245d407-f34c-4c3c-af16-ba216edc3ced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.861531 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2af03-d2cf-4483-8c2e-4a5f77ac8f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.861761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2af03-d2cf-4483-8c2e-4a5f77ac8f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.862035 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2af03-d2cf-4483-8c2e-4a5f77ac8f4d admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.862722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2af03-d2cf-4483-8c2e-4a5f77ac8f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.863244 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245d407-f34c-4c3c-af16-ba216edc3ced admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.864711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2af03-d2cf-4483-8c2e-4a5f77ac8f4d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.952084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1242/2506] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:04 2022] POST /identity/v3/users => generated 303 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:04.956622 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245d407-f34c-4c3c-af16-ba216edc3ced admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.966549 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245d407-f34c-4c3c-af16-ba216edc3ced admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.973157 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1265/2507] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:04 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:04.973299 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb6ad7-48fc-4214-bc9c-e4f525f52ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.973299 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb6ad7-48fc-4214-bc9c-e4f525f52ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.973299 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb6ad7-48fc-4214-bc9c-e4f525f52ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.973299 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb6ad7-48fc-4214-bc9c-e4f525f52ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.973649 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb6ad7-48fc-4214-bc9c-e4f525f52ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.974874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb6ad7-48fc-4214-bc9c-e4f525f52ce6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.974996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2af03-d2cf-4483-8c2e-4a5f77ac8f4d admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.985404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1243/2508] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:04.988598 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2af03-d2cf-4483-8c2e-4a5f77ac8f4d admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:04.989392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb6ad7-48fc-4214-bc9c-e4f525f52ce6 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:04.993957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9dac4-f6e3-48be-8830-9408b2529e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:04.994617 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9dac4-f6e3-48be-8830-9408b2529e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:04.994897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9dac4-f6e3-48be-8830-9408b2529e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:04.995177 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9dac4-f6e3-48be-8830-9408b2529e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:04.995895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9dac4-f6e3-48be-8830-9408b2529e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:04.997514 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9dac4-f6e3-48be-8830-9408b2529e32 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:04.998725 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb6ad7-48fc-4214-bc9c-e4f525f52ce6 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:05.004022 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67ad88-d3c4-4e1e-9712-a157c23feac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:05.004869 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67ad88-d3c4-4e1e-9712-a157c23feac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:05.005181 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67ad88-d3c4-4e1e-9712-a157c23feac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:05.005463 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67ad88-d3c4-4e1e-9712-a157c23feac4 admin admin] PATH_INFO: `/v3/projects/e66c3f989d954a56a3a074e396bf0d6b/users/d704bf73d5094d7da8087e8f8f4e8f03/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:05.007968 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1266/2509] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:05.011857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9dac4-f6e3-48be-8830-9408b2529e32 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:05.019735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67ad88-d3c4-4e1e-9712-a157c23feac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66c3f989d954a56a3a074e396bf0d6b, user_id=d704bf73d5094d7da8087e8f8f4e8f03, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:05.021108 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9dac4-f6e3-48be-8830-9408b2529e32 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:05.022429 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67ad88-d3c4-4e1e-9712-a157c23feac4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:05.025697 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db25e6-853e-446b-b9d7-a24ea36c090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:05.026549 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db25e6-853e-446b-b9d7-a24ea36c090c admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:05.026827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db25e6-853e-446b-b9d7-a24ea36c090c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:05.027101 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db25e6-853e-446b-b9d7-a24ea36c090c admin admin] PATH_INFO: `/v3/projects/d51092f5893d46f0b3dabe142404af0e/users/1e424e0354d94086bdb8a22535d3bd45/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:05.041204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db25e6-853e-446b-b9d7-a24ea36c090c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51092f5893d46f0b3dabe142404af0e, user_id=1e424e0354d94086bdb8a22535d3bd45, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:05.044081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db25e6-853e-446b-b9d7-a24ea36c090c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:05.088360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1244/2510] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:04 2022] PUT /identity/v3/projects/e66c3f989d954a56a3a074e396bf0d6b/users/d704bf73d5094d7da8087e8f8f4e8f03/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:05.092138 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67ad88-d3c4-4e1e-9712-a157c23feac4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:05.105572 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1267/2511] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:05 2022] PUT /identity/v3/projects/d51092f5893d46f0b3dabe142404af0e/users/1e424e0354d94086bdb8a22535d3bd45/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:05.115792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db25e6-853e-446b-b9d7-a24ea36c090c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:05.151937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67ad88-d3c4-4e1e-9712-a157c23feac4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:05.174390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db25e6-853e-446b-b9d7-a24ea36c090c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:05.179017 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1d179-98d1-4e77-9c68-52876ee405a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:05.179693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1d179-98d1-4e77-9c68-52876ee405a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:05.179972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1d179-98d1-4e77-9c68-52876ee405a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:05.180248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1d179-98d1-4e77-9c68-52876ee405a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:05.180961 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1d179-98d1-4e77-9c68-52876ee405a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:05.182565 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1d179-98d1-4e77-9c68-52876ee405a9 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:05.192712 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1268/2512] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:05.196662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1d179-98d1-4e77-9c68-52876ee405a9 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:05.205839 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1d179-98d1-4e77-9c68-52876ee405a9 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:05.207222 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a5445-1bf4-4f73-8bb5-b4b7c9d2c94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:05.207892 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a5445-1bf4-4f73-8bb5-b4b7c9d2c94a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:05.208180 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a5445-1bf4-4f73-8bb5-b4b7c9d2c94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:05.208457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a5445-1bf4-4f73-8bb5-b4b7c9d2c94a admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:05.209245 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a5445-1bf4-4f73-8bb5-b4b7c9d2c94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:05.210663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295d019-ee93-47fc-b519-07fe50d01271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:05.210877 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a5445-1bf4-4f73-8bb5-b4b7c9d2c94a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:05.211693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295d019-ee93-47fc-b519-07fe50d01271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:05.211978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295d019-ee93-47fc-b519-07fe50d01271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:05.212251 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295d019-ee93-47fc-b519-07fe50d01271 admin admin] PATH_INFO: `/v3/projects/d51092f5893d46f0b3dabe142404af0e/users/1e424e0354d94086bdb8a22535d3bd45/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:05.214298 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295d019-ee93-47fc-b519-07fe50d01271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51092f5893d46f0b3dabe142404af0e, user_id=1e424e0354d94086bdb8a22535d3bd45, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:05.217076 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295d019-ee93-47fc-b519-07fe50d01271 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:05.220674 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1245/2513] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:05.224643 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a5445-1bf4-4f73-8bb5-b4b7c9d2c94a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:05.227952 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1269/2514] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:05 2022] PUT /identity/v3/projects/d51092f5893d46f0b3dabe142404af0e/users/1e424e0354d94086bdb8a22535d3bd45/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:05.234186 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a5445-1bf4-4f73-8bb5-b4b7c9d2c94a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:05.239009 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271fc0-9612-4706-a028-de8b3962d8e2 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:05.239298 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271fc0-9612-4706-a028-de8b3962d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:05.239574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271fc0-9612-4706-a028-de8b3962d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:05.266091 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-13271fc0-9612-4706-a028-de8b3962d8e2 None None] MFA Rules not processed for user `1e424e0354d94086bdb8a22535d3bd45`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:05.267313 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-13271fc0-9612-4706-a028-de8b3962d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:05.289563 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004d93-1887-4f79-ab4d-4b86207c0833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:05.290450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004d93-1887-4f79-ab4d-4b86207c0833 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:05.290733 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004d93-1887-4f79-ab4d-4b86207c0833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:05.291006 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004d93-1887-4f79-ab4d-4b86207c0833 admin admin] PATH_INFO: `/v3/projects/e66c3f989d954a56a3a074e396bf0d6b/users/d704bf73d5094d7da8087e8f8f4e8f03/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:05.293247 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1004d93-1887-4f79-ab4d-4b86207c0833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66c3f989d954a56a3a074e396bf0d6b, user_id=d704bf73d5094d7da8087e8f8f4e8f03, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:05.295950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1004d93-1887-4f79-ab4d-4b86207c0833 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:05.306426 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1246/2515] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:05 2022] PUT /identity/v3/projects/e66c3f989d954a56a3a074e396bf0d6b/users/d704bf73d5094d7da8087e8f8f4e8f03/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:05.318233 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b4a1d-16f6-4834-8f04-112fa4413054 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:05.318522 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b4a1d-16f6-4834-8f04-112fa4413054 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:05.318805 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b4a1d-16f6-4834-8f04-112fa4413054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:05.333865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1270/2516] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:05.344509 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8a9b4a1d-16f6-4834-8f04-112fa4413054 None None] MFA Rules not processed for user `d704bf73d5094d7da8087e8f8f4e8f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:05.345715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13271fc0-9612-4706-a028-de8b3962d8e2 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:05.348147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8a9b4a1d-16f6-4834-8f04-112fa4413054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:05.348269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-13271fc0-9612-4706-a028-de8b3962d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:05.411695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1247/2517] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:05.418461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13271fc0-9612-4706-a028-de8b3962d8e2 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:05.422961 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b4a1d-16f6-4834-8f04-112fa4413054 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:05.424329 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8a9b4a1d-16f6-4834-8f04-112fa4413054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:05.465327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e592f4-ccd3-450c-95f3-b14adf8422d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:05.465972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e592f4-ccd3-450c-95f3-b14adf8422d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:05.466245 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e592f4-ccd3-450c-95f3-b14adf8422d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:05.466515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e592f4-ccd3-450c-95f3-b14adf8422d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:05.478594 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b4a1d-16f6-4834-8f04-112fa4413054 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:05.482596 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ca795-8845-436d-a41b-28fd83d910cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:05.483237 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ca795-8845-436d-a41b-28fd83d910cd service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:05.483517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ca795-8845-436d-a41b-28fd83d910cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:05.483790 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ca795-8845-436d-a41b-28fd83d910cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:05.493486 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ca795-8845-436d-a41b-28fd83d910cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:05.494954 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ca795-8845-436d-a41b-28fd83d910cd service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:05.504540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1248/2518] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:05.525456 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e592f4-ccd3-450c-95f3-b14adf8422d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:05.526914 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e592f4-ccd3-450c-95f3-b14adf8422d0 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:05.536812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1271/2519] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:05.548934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ca795-8845-436d-a41b-28fd83d910cd service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:05.558012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ca795-8845-436d-a41b-28fd83d910cd service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:05.561804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c69df-6d41-4ea7-b636-fbf982fb1b42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:05.562467 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c69df-6d41-4ea7-b636-fbf982fb1b42 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:05.562751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c69df-6d41-4ea7-b636-fbf982fb1b42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:05.565830 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c69df-6d41-4ea7-b636-fbf982fb1b42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:05.623372 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c69df-6d41-4ea7-b636-fbf982fb1b42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:05.625031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c69df-6d41-4ea7-b636-fbf982fb1b42 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:05.634210 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1249/2520] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:06.402837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e592f4-ccd3-450c-95f3-b14adf8422d0 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:06.463528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e592f4-ccd3-450c-95f3-b14adf8422d0 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:06.468014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc09e-6c2a-4333-b9b6-680d7c92c99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:06.468898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc09e-6c2a-4333-b9b6-680d7c92c99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:06.469211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc09e-6c2a-4333-b9b6-680d7c92c99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:06.469483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc09e-6c2a-4333-b9b6-680d7c92c99a admin admin] PATH_INFO: `/v3/users/e7d7f75e2d2b429ca63ee2351cf735d0` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:06.470691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbc09e-6c2a-4333-b9b6-680d7c92c99a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d7f75e2d2b429ca63ee2351cf735d0)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:06.472587 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbc09e-6c2a-4333-b9b6-680d7c92c99a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:06.610372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c4bbc09e-6c2a-4333-b9b6-680d7c92c99a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d7f75e2d2b429ca63ee2351cf735d0'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:06.611013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c4bbc09e-6c2a-4333-b9b6-680d7c92c99a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d7f75e2d2b429ca63ee2351cf735d0'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:06.611602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c4bbc09e-6c2a-4333-b9b6-680d7c92c99a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d7f75e2d2b429ca63ee2351cf735d0'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:06.623068 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c4bbc09e-6c2a-4333-b9b6-680d7c92c99a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d7f75e2d2b429ca63ee2351cf735d0'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:06.630490 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c4bbc09e-6c2a-4333-b9b6-680d7c92c99a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d7f75e2d2b429ca63ee2351cf735d0'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:06.689333 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1272/2521] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:06 2022] DELETE /identity/v3/users/e7d7f75e2d2b429ca63ee2351cf735d0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:06.693907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce79401-7ab8-4ab9-854b-421e6622fd6b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:06.694378 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce79401-7ab8-4ab9-854b-421e6622fd6b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:06.694498 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce79401-7ab8-4ab9-854b-421e6622fd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:06.711135 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7ce79401-7ab8-4ab9-854b-421e6622fd6b None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:06.712314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7ce79401-7ab8-4ab9-854b-421e6622fd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:06.767233 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1250/2522] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:06.777106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc09e-6c2a-4333-b9b6-680d7c92c99a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:06.778537 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c4bbc09e-6c2a-4333-b9b6-680d7c92c99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:06.855595 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc09e-6c2a-4333-b9b6-680d7c92c99a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:06.859276 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077592f-48f4-416e-88a8-aaef0f6f5e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:06.859916 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077592f-48f4-416e-88a8-aaef0f6f5e59 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:06.860199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077592f-48f4-416e-88a8-aaef0f6f5e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:06.861008 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077592f-48f4-416e-88a8-aaef0f6f5e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:06.872827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077592f-48f4-416e-88a8-aaef0f6f5e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:06.874287 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077592f-48f4-416e-88a8-aaef0f6f5e59 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:06.884622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1273/2523] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:07.265520 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce79401-7ab8-4ab9-854b-421e6622fd6b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:07.267597 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7ce79401-7ab8-4ab9-854b-421e6622fd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:07.279794 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce79401-7ab8-4ab9-854b-421e6622fd6b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:07.287671 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:07.288937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:07.289353 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:07.289630 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] PATH_INFO: `/v3/projects/c89a057a0d804b5c893e220fda1d50af` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:07.290884 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89a057a0d804b5c893e220fda1d50af)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:07.293399 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:07.422742 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89a057a0d804b5c893e220fda1d50af', 'request_id': 'req-6205897d-f4aa-438d-92a9-a0897d5e5942'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:07.428845 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89a057a0d804b5c893e220fda1d50af', 'request_id': 'req-6205897d-f4aa-438d-92a9-a0897d5e5942'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:07.434106 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89a057a0d804b5c893e220fda1d50af', 'request_id': 'req-6205897d-f4aa-438d-92a9-a0897d5e5942'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:07.505455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] The token cache is being invalidate because project c89a057a0d804b5c893e220fda1d50af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:07.505776 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:07.506414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:07.507976 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1251/2524] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:07 2022] DELETE /identity/v3/projects/c89a057a0d804b5c893e220fda1d50af => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:07.511938 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077592f-48f4-416e-88a8-aaef0f6f5e59 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:07.521934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077592f-48f4-416e-88a8-aaef0f6f5e59 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:07.576744 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30487b3b-f029-483d-bfca-d2204f47045c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:07.577550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30487b3b-f029-483d-bfca-d2204f47045c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:07.577828 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30487b3b-f029-483d-bfca-d2204f47045c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:07.578099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30487b3b-f029-483d-bfca-d2204f47045c admin admin] PATH_INFO: `/v3/users/1e424e0354d94086bdb8a22535d3bd45` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:07.579790 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30487b3b-f029-483d-bfca-d2204f47045c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e424e0354d94086bdb8a22535d3bd45)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:07.581723 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30487b3b-f029-483d-bfca-d2204f47045c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:07.867474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-30487b3b-f029-483d-bfca-d2204f47045c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e424e0354d94086bdb8a22535d3bd45'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:07.868182 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-30487b3b-f029-483d-bfca-d2204f47045c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e424e0354d94086bdb8a22535d3bd45'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:07.868842 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-30487b3b-f029-483d-bfca-d2204f47045c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e424e0354d94086bdb8a22535d3bd45'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:07.880731 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-30487b3b-f029-483d-bfca-d2204f47045c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e424e0354d94086bdb8a22535d3bd45'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:07.887399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-30487b3b-f029-483d-bfca-d2204f47045c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e424e0354d94086bdb8a22535d3bd45'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:07.945607 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1274/2525] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:07 2022] DELETE /identity/v3/users/1e424e0354d94086bdb8a22535d3bd45 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:08.358759 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:08.360301 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:08.375749 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205897d-f4aa-438d-92a9-a0897d5e5942 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:08.432073 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3c653-1084-4b0f-a1df-31781bd9b626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:08.432856 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3c653-1084-4b0f-a1df-31781bd9b626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:08.433236 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3c653-1084-4b0f-a1df-31781bd9b626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:08.433515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3c653-1084-4b0f-a1df-31781bd9b626 admin admin] PATH_INFO: `/v3/projects/d51092f5893d46f0b3dabe142404af0e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:08.434699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3c653-1084-4b0f-a1df-31781bd9b626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51092f5893d46f0b3dabe142404af0e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:08.436650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3c653-1084-4b0f-a1df-31781bd9b626 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:08.535492 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-20c3c653-1084-4b0f-a1df-31781bd9b626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51092f5893d46f0b3dabe142404af0e', 'request_id': 'req-20c3c653-1084-4b0f-a1df-31781bd9b626'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:08.541565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-20c3c653-1084-4b0f-a1df-31781bd9b626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51092f5893d46f0b3dabe142404af0e', 'request_id': 'req-20c3c653-1084-4b0f-a1df-31781bd9b626'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:08.547572 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-20c3c653-1084-4b0f-a1df-31781bd9b626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51092f5893d46f0b3dabe142404af0e', 'request_id': 'req-20c3c653-1084-4b0f-a1df-31781bd9b626'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:08.601931 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-20c3c653-1084-4b0f-a1df-31781bd9b626 admin admin] The token cache is being invalidate because project d51092f5893d46f0b3dabe142404af0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:08.604502 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-20c3c653-1084-4b0f-a1df-31781bd9b626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:08.604502 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-20c3c653-1084-4b0f-a1df-31781bd9b626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:08.604692 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1252/2526] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:08 2022] DELETE /identity/v3/projects/d51092f5893d46f0b3dabe142404af0e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:08.609437 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83213f28-a034-4e23-b44c-4d59c6a09ef5 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:08.609923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83213f28-a034-4e23-b44c-4d59c6a09ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:08.610038 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83213f28-a034-4e23-b44c-4d59c6a09ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:08.628420 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-83213f28-a034-4e23-b44c-4d59c6a09ef5 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:08.629774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-83213f28-a034-4e23-b44c-4d59c6a09ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:08.689995 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1275/2527] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:08.697584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7554f3-3698-44bc-994a-5c87f646b5cc None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:08.697866 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7554f3-3698-44bc-994a-5c87f646b5cc None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:08.698137 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7554f3-3698-44bc-994a-5c87f646b5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:08.717465 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2c7554f3-3698-44bc-994a-5c87f646b5cc None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:08.718673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2c7554f3-3698-44bc-994a-5c87f646b5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:08.726772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1253/2528] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:08.731044 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83213f28-a034-4e23-b44c-4d59c6a09ef5 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:08.741357 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83213f28-a034-4e23-b44c-4d59c6a09ef5 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:08.745942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f237d-f23d-4a91-a597-096b95dc182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:08.746593 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f237d-f23d-4a91-a597-096b95dc182e admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:08.746877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f237d-f23d-4a91-a597-096b95dc182e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:08.747152 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f237d-f23d-4a91-a597-096b95dc182e admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:08.747882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f237d-f23d-4a91-a597-096b95dc182e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:20:08.748189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f237d-f23d-4a91-a597-096b95dc182e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:08.749830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f237d-f23d-4a91-a597-096b95dc182e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:08.761934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1276/2529] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:20:08.766000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7554f3-3698-44bc-994a-5c87f646b5cc None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:08.775258 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7554f3-3698-44bc-994a-5c87f646b5cc None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:08.779970 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a7818-bedf-405f-9503-7bf1235a344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:08.780603 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a7818-bedf-405f-9503-7bf1235a344f admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:08.780885 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a7818-bedf-405f-9503-7bf1235a344f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:08.781198 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a7818-bedf-405f-9503-7bf1235a344f admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:08.781888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a7818-bedf-405f-9503-7bf1235a344f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:08.783804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a7818-bedf-405f-9503-7bf1235a344f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:08.862298 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1254/2530] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:08 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:08.872867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f237d-f23d-4a91-a597-096b95dc182e admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:08.883684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f237d-f23d-4a91-a597-096b95dc182e admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:08.939002 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d5813-813e-4eb9-9981-ed2df83e7856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:08.939684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d5813-813e-4eb9-9981-ed2df83e7856 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:08.939965 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d5813-813e-4eb9-9981-ed2df83e7856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:08.940290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d5813-813e-4eb9-9981-ed2df83e7856 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:08.940908 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d5813-813e-4eb9-9981-ed2df83e7856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:08.942834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d5813-813e-4eb9-9981-ed2df83e7856 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:09.004361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1277/2531] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:08 2022] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:09.007879 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a7818-bedf-405f-9503-7bf1235a344f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:09.018143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a7818-bedf-405f-9503-7bf1235a344f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:09.022799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b2dbc-a64c-49b7-b4f1-de07ccfe9e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:09.023451 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2dbc-a64c-49b7-b4f1-de07ccfe9e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:09.023739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2dbc-a64c-49b7-b4f1-de07ccfe9e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:09.024017 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2dbc-a64c-49b7-b4f1-de07ccfe9e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:09.024737 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b2dbc-a64c-49b7-b4f1-de07ccfe9e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:09.026402 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b2dbc-a64c-49b7-b4f1-de07ccfe9e54 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:09.036821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1255/2532] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:09.041530 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d5813-813e-4eb9-9981-ed2df83e7856 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:09.052089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d5813-813e-4eb9-9981-ed2df83e7856 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:09.056788 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013bb31-f9f4-47a6-ad8a-80303160867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:09.061700 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013bb31-f9f4-47a6-ad8a-80303160867c admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:09.061700 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013bb31-f9f4-47a6-ad8a-80303160867c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:09.061700 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013bb31-f9f4-47a6-ad8a-80303160867c admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:09.061700 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013bb31-f9f4-47a6-ad8a-80303160867c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:09.061700 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013bb31-f9f4-47a6-ad8a-80303160867c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:09.070669 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1278/2533] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:09.074715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b2dbc-a64c-49b7-b4f1-de07ccfe9e54 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:09.084527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b2dbc-a64c-49b7-b4f1-de07ccfe9e54 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:09.089202 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34aa2c-f66b-4273-a7da-433dd43840de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:09.090097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34aa2c-f66b-4273-a7da-433dd43840de admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:09.090363 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34aa2c-f66b-4273-a7da-433dd43840de admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:09.090639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34aa2c-f66b-4273-a7da-433dd43840de admin admin] PATH_INFO: `/v3/projects/81ae9fb9430d4f828a87302835cc4333/users/8c09bd7ce89c49c19e7867bc0d97899a/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:09.105938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34aa2c-f66b-4273-a7da-433dd43840de admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ae9fb9430d4f828a87302835cc4333, user_id=8c09bd7ce89c49c19e7867bc0d97899a, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:09.109039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34aa2c-f66b-4273-a7da-433dd43840de admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:09.156962 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1256/2534] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:09 2022] PUT /identity/v3/projects/81ae9fb9430d4f828a87302835cc4333/users/8c09bd7ce89c49c19e7867bc0d97899a/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:09.168003 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1c844-f2f8-4222-a7a6-63b753091d12 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:09.168289 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1c844-f2f8-4222-a7a6-63b753091d12 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:09.168592 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1c844-f2f8-4222-a7a6-63b753091d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:09.195191 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7ce1c844-f2f8-4222-a7a6-63b753091d12 None None] MFA Rules not processed for user `8c09bd7ce89c49c19e7867bc0d97899a`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:09.196389 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7ce1c844-f2f8-4222-a7a6-63b753091d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:09.259309 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1279/2535] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:09.263723 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34aa2c-f66b-4273-a7da-433dd43840de admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:09.326787 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34aa2c-f66b-4273-a7da-433dd43840de admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:09.331570 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc45c9-42a6-4e8f-9ceb-671fdcc9a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:09.332242 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc45c9-42a6-4e8f-9ceb-671fdcc9a632 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:09.332507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc45c9-42a6-4e8f-9ceb-671fdcc9a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:09.332785 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc45c9-42a6-4e8f-9ceb-671fdcc9a632 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:09.333517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc45c9-42a6-4e8f-9ceb-671fdcc9a632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:09.335455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc45c9-42a6-4e8f-9ceb-671fdcc9a632 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:09.410327 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1257/2536] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:09 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:09.413890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1c844-f2f8-4222-a7a6-63b753091d12 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:09.425321 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1c844-f2f8-4222-a7a6-63b753091d12 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:09.480484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e941823-83a7-4cdb-ac4e-834befb581dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:09.481349 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e941823-83a7-4cdb-ac4e-834befb581dd admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:09.481639 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e941823-83a7-4cdb-ac4e-834befb581dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:09.482000 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e941823-83a7-4cdb-ac4e-834befb581dd admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:09.482726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e941823-83a7-4cdb-ac4e-834befb581dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:09.484773 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e941823-83a7-4cdb-ac4e-834befb581dd admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:09.608525 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1280/2537] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:09 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:09.612465 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc45c9-42a6-4e8f-9ceb-671fdcc9a632 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:09.622774 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc45c9-42a6-4e8f-9ceb-671fdcc9a632 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:09.627345 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feff390-2dce-4f1c-9410-614f5b9f2929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:09.627994 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feff390-2dce-4f1c-9410-614f5b9f2929 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:09.628272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feff390-2dce-4f1c-9410-614f5b9f2929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:09.628541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feff390-2dce-4f1c-9410-614f5b9f2929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:09.629286 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feff390-2dce-4f1c-9410-614f5b9f2929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:09.630952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feff390-2dce-4f1c-9410-614f5b9f2929 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:09.642035 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1258/2538] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:09.646052 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e941823-83a7-4cdb-ac4e-834befb581dd admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:09.656309 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e941823-83a7-4cdb-ac4e-834befb581dd admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:09.661657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158a572-20fb-457c-beda-5a835a30b59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:09.662533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158a572-20fb-457c-beda-5a835a30b59c admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:09.662811 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158a572-20fb-457c-beda-5a835a30b59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:09.663081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158a572-20fb-457c-beda-5a835a30b59c admin admin] PATH_INFO: `/v3/projects/b03f7fb7c229451083f1b70cf98de44b/users/bfc7f75018164d959cdd890d4c49eb4c/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:09.678034 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158a572-20fb-457c-beda-5a835a30b59c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03f7fb7c229451083f1b70cf98de44b, user_id=bfc7f75018164d959cdd890d4c49eb4c, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:09.680689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158a572-20fb-457c-beda-5a835a30b59c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:09.746085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1281/2539] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:09 2022] PUT /identity/v3/projects/b03f7fb7c229451083f1b70cf98de44b/users/bfc7f75018164d959cdd890d4c49eb4c/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:09.750105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feff390-2dce-4f1c-9410-614f5b9f2929 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:09.760778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feff390-2dce-4f1c-9410-614f5b9f2929 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:09.817808 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cdd44-101f-466b-b743-0bdd9ad02573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:09.818478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cdd44-101f-466b-b743-0bdd9ad02573 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:09.818807 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cdd44-101f-466b-b743-0bdd9ad02573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:09.819081 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cdd44-101f-466b-b743-0bdd9ad02573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:09.819801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cdd44-101f-466b-b743-0bdd9ad02573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:09.821583 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cdd44-101f-466b-b743-0bdd9ad02573 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:09.831216 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1259/2540] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:09.835907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158a572-20fb-457c-beda-5a835a30b59c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:09.849628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158a572-20fb-457c-beda-5a835a30b59c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:09.854359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bbaa3-fa5a-47f9-8b05-c7882199951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:09.855239 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bbaa3-fa5a-47f9-8b05-c7882199951d admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:09.855520 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bbaa3-fa5a-47f9-8b05-c7882199951d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:09.855803 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bbaa3-fa5a-47f9-8b05-c7882199951d admin admin] PATH_INFO: `/v3/projects/b03f7fb7c229451083f1b70cf98de44b/users/bfc7f75018164d959cdd890d4c49eb4c/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:09.857794 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bbaa3-fa5a-47f9-8b05-c7882199951d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03f7fb7c229451083f1b70cf98de44b, user_id=bfc7f75018164d959cdd890d4c49eb4c, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:09.861015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bbaa3-fa5a-47f9-8b05-c7882199951d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:09.871109 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1282/2541] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:09 2022] PUT /identity/v3/projects/b03f7fb7c229451083f1b70cf98de44b/users/bfc7f75018164d959cdd890d4c49eb4c/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:09.882432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3caa0a-7a81-4759-8727-badc03152a4b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:09.884614 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3caa0a-7a81-4759-8727-badc03152a4b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:09.884614 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3caa0a-7a81-4759-8727-badc03152a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:09.909011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3c3caa0a-7a81-4759-8727-badc03152a4b None None] MFA Rules not processed for user `bfc7f75018164d959cdd890d4c49eb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:09.910288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3c3caa0a-7a81-4759-8727-badc03152a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:09.976188 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1260/2542] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:09.987856 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bbaa3-fa5a-47f9-8b05-c7882199951d admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:09.989679 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fe6bbaa3-fa5a-47f9-8b05-c7882199951d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:10.045657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bbaa3-fa5a-47f9-8b05-c7882199951d admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:10.049992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b187091-fc29-4095-9f5a-e527de07cf47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:10.050619 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b187091-fc29-4095-9f5a-e527de07cf47 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:10.050899 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b187091-fc29-4095-9f5a-e527de07cf47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:10.051170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b187091-fc29-4095-9f5a-e527de07cf47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:10.060028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b187091-fc29-4095-9f5a-e527de07cf47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:10.061483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b187091-fc29-4095-9f5a-e527de07cf47 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:10.071014 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1283/2543] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:10.835354 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3caa0a-7a81-4759-8727-badc03152a4b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:10.895412 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3caa0a-7a81-4759-8727-badc03152a4b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:10.899946 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e3a24-2fea-445f-8503-4a0c9b5edeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:10.900847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3a24-2fea-445f-8503-4a0c9b5edeac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:10.901154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3a24-2fea-445f-8503-4a0c9b5edeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:10.901432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3a24-2fea-445f-8503-4a0c9b5edeac admin admin] PATH_INFO: `/v3/users/8c09bd7ce89c49c19e7867bc0d97899a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:10.902605 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e3a24-2fea-445f-8503-4a0c9b5edeac admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c09bd7ce89c49c19e7867bc0d97899a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:10.904642 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e3a24-2fea-445f-8503-4a0c9b5edeac admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:11.099586 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b187091-fc29-4095-9f5a-e527de07cf47 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:11.100983 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1b187091-fc29-4095-9f5a-e527de07cf47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:11.117339 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b187091-fc29-4095-9f5a-e527de07cf47 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:11.121743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ab0e3a24-2fea-445f-8503-4a0c9b5edeac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c09bd7ce89c49c19e7867bc0d97899a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:11.122430 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b7b86-7c8f-4e56-93c7-a42406545f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:11.122751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ab0e3a24-2fea-445f-8503-4a0c9b5edeac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c09bd7ce89c49c19e7867bc0d97899a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:11.123361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ab0e3a24-2fea-445f-8503-4a0c9b5edeac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c09bd7ce89c49c19e7867bc0d97899a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:11.123762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b7b86-7c8f-4e56-93c7-a42406545f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:11.124258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b7b86-7c8f-4e56-93c7-a42406545f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:11.124762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b7b86-7c8f-4e56-93c7-a42406545f06 admin admin] PATH_INFO: `/v3/users/a4966646242a4bd19af080c497d69737` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:11.127307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b7b86-7c8f-4e56-93c7-a42406545f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4966646242a4bd19af080c497d69737)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:11.129473 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b7b86-7c8f-4e56-93c7-a42406545f06 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:11.191283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ab0e3a24-2fea-445f-8503-4a0c9b5edeac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c09bd7ce89c49c19e7867bc0d97899a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:11.203363 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ab0e3a24-2fea-445f-8503-4a0c9b5edeac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c09bd7ce89c49c19e7867bc0d97899a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:11.215397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1261/2544] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:10 2022] DELETE /identity/v3/users/8c09bd7ce89c49c19e7867bc0d97899a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:11.219608 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738d523-5d34-45be-a84c-462fb609cf3e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:11.224171 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738d523-5d34-45be-a84c-462fb609cf3e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:11.224171 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738d523-5d34-45be-a84c-462fb609cf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:11.236871 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6738d523-5d34-45be-a84c-462fb609cf3e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:11.238115 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6738d523-5d34-45be-a84c-462fb609cf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:11.294693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1262/2545] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:11.308440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738d523-5d34-45be-a84c-462fb609cf3e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:11.315187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-bc6b7b86-7c8f-4e56-93c7-a42406545f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4966646242a4bd19af080c497d69737'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:11.315187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-bc6b7b86-7c8f-4e56-93c7-a42406545f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4966646242a4bd19af080c497d69737'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:11.315403 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6738d523-5d34-45be-a84c-462fb609cf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:11.315510 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-bc6b7b86-7c8f-4e56-93c7-a42406545f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4966646242a4bd19af080c497d69737'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:11.323559 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-bc6b7b86-7c8f-4e56-93c7-a42406545f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4966646242a4bd19af080c497d69737'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:11.330590 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-bc6b7b86-7c8f-4e56-93c7-a42406545f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4966646242a4bd19af080c497d69737'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:11.369542 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738d523-5d34-45be-a84c-462fb609cf3e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:11.373135 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382a684-bee4-4c8a-9f49-26f50a678efb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:11.373886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a684-bee4-4c8a-9f49-26f50a678efb service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:11.374209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a684-bee4-4c8a-9f49-26f50a678efb service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:11.374523 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a684-bee4-4c8a-9f49-26f50a678efb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:11.376505 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2382a684-bee4-4c8a-9f49-26f50a678efb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:11.388018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382a684-bee4-4c8a-9f49-26f50a678efb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:11.389519 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382a684-bee4-4c8a-9f49-26f50a678efb service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:11.391762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1284/2546] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:11 2022] DELETE /identity/v3/users/a4966646242a4bd19af080c497d69737 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:11.396208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f27107-521a-4ea1-a2df-f5d59f7204f9 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:11.396498 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f27107-521a-4ea1-a2df-f5d59f7204f9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:11.396801 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f27107-521a-4ea1-a2df-f5d59f7204f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:11.399287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1263/2547] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:11.421274 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a4f27107-521a-4ea1-a2df-f5d59f7204f9 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:11.422481 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a4f27107-521a-4ea1-a2df-f5d59f7204f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:11.481427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1285/2548] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:11.491943 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382a684-bee4-4c8a-9f49-26f50a678efb service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:11.493494 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2382a684-bee4-4c8a-9f49-26f50a678efb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:11.504227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382a684-bee4-4c8a-9f49-26f50a678efb service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:11.551701 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95591e61-dd71-4420-9a0a-f6f5b54c27fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:11.552329 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95591e61-dd71-4420-9a0a-f6f5b54c27fb service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:11.552607 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95591e61-dd71-4420-9a0a-f6f5b54c27fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:11.552880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95591e61-dd71-4420-9a0a-f6f5b54c27fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:11.562225 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95591e61-dd71-4420-9a0a-f6f5b54c27fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:11.563778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95591e61-dd71-4420-9a0a-f6f5b54c27fb service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:11.573549 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1264/2549] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:11.833077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f27107-521a-4ea1-a2df-f5d59f7204f9 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:11.834775 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a4f27107-521a-4ea1-a2df-f5d59f7204f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:11.847893 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f27107-521a-4ea1-a2df-f5d59f7204f9 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:11.859710 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:11.860691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:11.860977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:11.861283 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] PATH_INFO: `/v3/projects/81ae9fb9430d4f828a87302835cc4333` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:11.863033 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ae9fb9430d4f828a87302835cc4333)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:11.865085 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:11.979858 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ae9fb9430d4f828a87302835cc4333', 'request_id': 'req-93caeca3-c05b-418e-830f-62b211ef9b6b'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.033063 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95591e61-dd71-4420-9a0a-f6f5b54c27fb service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:12.034658 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-95591e61-dd71-4420-9a0a-f6f5b54c27fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:12.048176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95591e61-dd71-4420-9a0a-f6f5b54c27fb service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:12.050565 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ae9fb9430d4f828a87302835cc4333', 'request_id': 'req-93caeca3-c05b-418e-830f-62b211ef9b6b'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.058945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ae9fb9430d4f828a87302835cc4333', 'request_id': 'req-93caeca3-c05b-418e-830f-62b211ef9b6b'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.070653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] The token cache is being invalidate because project 81ae9fb9430d4f828a87302835cc4333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:12.070944 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.071620 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.073188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1286/2550] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:11 2022] DELETE /identity/v3/projects/81ae9fb9430d4f828a87302835cc4333 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:12.076959 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:12.078541 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:12.107239 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:12.108282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:12.108564 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:12.108839 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] PATH_INFO: `/v3/projects/88607eed43604d1485151cb4a72c49cf` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:12.110065 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] RBAC: Authorizing `identity:delete_project(project_id=88607eed43604d1485151cb4a72c49cf)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:12.112616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:12.142827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caeca3-c05b-418e-830f-62b211ef9b6b admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:12.147515 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83763-f582-47c2-88ee-4060c2b74a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:12.148467 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83763-f582-47c2-88ee-4060c2b74a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:12.148750 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83763-f582-47c2-88ee-4060c2b74a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:12.149035 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83763-f582-47c2-88ee-4060c2b74a8f admin admin] PATH_INFO: `/v3/users/bfc7f75018164d959cdd890d4c49eb4c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:12.150252 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a83763-f582-47c2-88ee-4060c2b74a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc7f75018164d959cdd890d4c49eb4c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:12.152161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a83763-f582-47c2-88ee-4060c2b74a8f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:12.207370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88607eed43604d1485151cb4a72c49cf', 'request_id': 'req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.213440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88607eed43604d1485151cb4a72c49cf', 'request_id': 'req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.218648 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88607eed43604d1485151cb4a72c49cf', 'request_id': 'req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.276338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] The token cache is being invalidate because project 88607eed43604d1485151cb4a72c49cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:12.276559 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.277233 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.278823 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1265/2551] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:12 2022] DELETE /identity/v3/projects/88607eed43604d1485151cb4a72c49cf => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:12.283141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:12.284458 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:12.313144 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-75a83763-f582-47c2-88ee-4060c2b74a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc7f75018164d959cdd890d4c49eb4c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.313850 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-75a83763-f582-47c2-88ee-4060c2b74a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc7f75018164d959cdd890d4c49eb4c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.314483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-75a83763-f582-47c2-88ee-4060c2b74a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc7f75018164d959cdd890d4c49eb4c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.325977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-75a83763-f582-47c2-88ee-4060c2b74a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc7f75018164d959cdd890d4c49eb4c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.332875 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-75a83763-f582-47c2-88ee-4060c2b74a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc7f75018164d959cdd890d4c49eb4c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.347293 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1d4bc-fb78-4cbd-887f-912ca8c3811b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:12.352057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facba1d-ee22-4f4d-a67f-5fb86991a6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:12.352925 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facba1d-ee22-4f4d-a67f-5fb86991a6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:12.353246 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facba1d-ee22-4f4d-a67f-5fb86991a6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:12.353527 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facba1d-ee22-4f4d-a67f-5fb86991a6ea admin admin] PATH_INFO: `/v3/users/d704bf73d5094d7da8087e8f8f4e8f03` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:12.360921 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facba1d-ee22-4f4d-a67f-5fb86991a6ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d704bf73d5094d7da8087e8f8f4e8f03)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:12.360921 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facba1d-ee22-4f4d-a67f-5fb86991a6ea admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:12.417153 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1287/2552] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:12 2022] DELETE /identity/v3/users/bfc7f75018164d959cdd890d4c49eb4c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:12.543524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7facba1d-ee22-4f4d-a67f-5fb86991a6ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd704bf73d5094d7da8087e8f8f4e8f03'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.544292 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7facba1d-ee22-4f4d-a67f-5fb86991a6ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd704bf73d5094d7da8087e8f8f4e8f03'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.545177 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7facba1d-ee22-4f4d-a67f-5fb86991a6ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd704bf73d5094d7da8087e8f8f4e8f03'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.609092 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7facba1d-ee22-4f4d-a67f-5fb86991a6ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd704bf73d5094d7da8087e8f8f4e8f03'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.621500 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7facba1d-ee22-4f4d-a67f-5fb86991a6ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd704bf73d5094d7da8087e8f8f4e8f03'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:12.633950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1266/2553] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:12 2022] DELETE /identity/v3/users/d704bf73d5094d7da8087e8f8f4e8f03 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:12.874436 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83763-f582-47c2-88ee-4060c2b74a8f admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:12.876472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-75a83763-f582-47c2-88ee-4060c2b74a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:12.964259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83763-f582-47c2-88ee-4060c2b74a8f admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:13.028466 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8cc11-e7c2-4936-8e11-98770e93876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:13.029450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8cc11-e7c2-4936-8e11-98770e93876e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.029824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8cc11-e7c2-4936-8e11-98770e93876e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.030170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8cc11-e7c2-4936-8e11-98770e93876e admin admin] PATH_INFO: `/v3/projects/b03f7fb7c229451083f1b70cf98de44b` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.031512 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8cc11-e7c2-4936-8e11-98770e93876e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b03f7fb7c229451083f1b70cf98de44b)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:13.034060 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8cc11-e7c2-4936-8e11-98770e93876e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:13.159799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facba1d-ee22-4f4d-a67f-5fb86991a6ea admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:13.161469 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7facba1d-ee22-4f4d-a67f-5fb86991a6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:13.177366 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facba1d-ee22-4f4d-a67f-5fb86991a6ea admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:13.182275 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:13.183140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.183423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.183699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6 admin admin] PATH_INFO: `/v3/projects/e66c3f989d954a56a3a074e396bf0d6b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.185184 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66c3f989d954a56a3a074e396bf0d6b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:13.187158 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:13.203773 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c9f8cc11-e7c2-4936-8e11-98770e93876e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b03f7fb7c229451083f1b70cf98de44b', 'request_id': 'req-c9f8cc11-e7c2-4936-8e11-98770e93876e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:13.259624 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c9f8cc11-e7c2-4936-8e11-98770e93876e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b03f7fb7c229451083f1b70cf98de44b', 'request_id': 'req-c9f8cc11-e7c2-4936-8e11-98770e93876e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:13.266284 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c9f8cc11-e7c2-4936-8e11-98770e93876e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b03f7fb7c229451083f1b70cf98de44b', 'request_id': 'req-c9f8cc11-e7c2-4936-8e11-98770e93876e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:13.276825 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c9f8cc11-e7c2-4936-8e11-98770e93876e admin admin] The token cache is being invalidate because project b03f7fb7c229451083f1b70cf98de44b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:13.277130 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c9f8cc11-e7c2-4936-8e11-98770e93876e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:13.277747 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c9f8cc11-e7c2-4936-8e11-98770e93876e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:13.279271 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1288/2554] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:12 2022] DELETE /identity/v3/projects/b03f7fb7c229451083f1b70cf98de44b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:13.284421 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4426d-2ad0-4ffe-ae20-c303889077b7 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.284704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4426d-2ad0-4ffe-ae20-c303889077b7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.285124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4426d-2ad0-4ffe-ae20-c303889077b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.301154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66c3f989d954a56a3a074e396bf0d6b', 'request_id': 'req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:13.303620 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d8e4426d-2ad0-4ffe-ae20-c303889077b7 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:13.304879 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d8e4426d-2ad0-4ffe-ae20-c303889077b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:13.307889 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66c3f989d954a56a3a074e396bf0d6b', 'request_id': 'req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:13.315033 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66c3f989d954a56a3a074e396bf0d6b', 'request_id': 'req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:13.363170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1289/2555] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:13.368077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6 admin admin] The token cache is being invalidate because project e66c3f989d954a56a3a074e396bf0d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:13.368370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:13.369372 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fd97f0b2-48c2-4972-8ac6-6f2a328fbfa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:13.370741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c3674-0b51-41ed-8357-156d1d0e03d4 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.370928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1267/2556] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:13 2022] DELETE /identity/v3/projects/e66c3f989d954a56a3a074e396bf0d6b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:13.374215 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c3674-0b51-41ed-8357-156d1d0e03d4 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.374522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c3674-0b51-41ed-8357-156d1d0e03d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.375481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075731d6-2eb2-4c1f-b598-fcd0bd935840 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.375820 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075731d6-2eb2-4c1f-b598-fcd0bd935840 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.376050 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075731d6-2eb2-4c1f-b598-fcd0bd935840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.392778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-469c3674-0b51-41ed-8357-156d1d0e03d4 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:13.394041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-469c3674-0b51-41ed-8357-156d1d0e03d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:13.394246 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-075731d6-2eb2-4c1f-b598-fcd0bd935840 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:13.395286 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-075731d6-2eb2-4c1f-b598-fcd0bd935840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:13.403394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1290/2557] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:13.405461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1268/2558] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:13.409040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c3674-0b51-41ed-8357-156d1d0e03d4 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:13.413384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95788b9-5edb-4f10-8b66-c99c03157b03 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.413783 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95788b9-5edb-4f10-8b66-c99c03157b03 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.414058 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95788b9-5edb-4f10-8b66-c99c03157b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.418459 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c3674-0b51-41ed-8357-156d1d0e03d4 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:13.423095 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f85cec-8df5-4686-82b1-60592750b72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:13.423741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f85cec-8df5-4686-82b1-60592750b72a admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.424024 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f85cec-8df5-4686-82b1-60592750b72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.424302 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f85cec-8df5-4686-82b1-60592750b72a admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.425189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f85cec-8df5-4686-82b1-60592750b72a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:20:13.425499 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f85cec-8df5-4686-82b1-60592750b72a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:13.427094 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f85cec-8df5-4686-82b1-60592750b72a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:13.432818 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d95788b9-5edb-4f10-8b66-c99c03157b03 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:13.434122 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d95788b9-5edb-4f10-8b66-c99c03157b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:13.439011 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1291/2559] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:20:13.442461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1269/2560] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:13.443231 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f85cec-8df5-4686-82b1-60592750b72a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:13.446286 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95788b9-5edb-4f10-8b66-c99c03157b03 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:13.452976 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f85cec-8df5-4686-82b1-60592750b72a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:13.455886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95788b9-5edb-4f10-8b66-c99c03157b03 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:13.458434 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da71e04-c78d-4dbf-bb6d-face4473b76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:13.459253 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da71e04-c78d-4dbf-bb6d-face4473b76d admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.463912 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da71e04-c78d-4dbf-bb6d-face4473b76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.463912 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da71e04-c78d-4dbf-bb6d-face4473b76d admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.463912 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da71e04-c78d-4dbf-bb6d-face4473b76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:13.464379 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990178f5-37b2-4514-b09c-c8e786865591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:13.464379 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990178f5-37b2-4514-b09c-c8e786865591 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.464379 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990178f5-37b2-4514-b09c-c8e786865591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.464379 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990178f5-37b2-4514-b09c-c8e786865591 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.464758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da71e04-c78d-4dbf-bb6d-face4473b76d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:13.464864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990178f5-37b2-4514-b09c-c8e786865591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:20:13.464864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990178f5-37b2-4514-b09c-c8e786865591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:13.464864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990178f5-37b2-4514-b09c-c8e786865591 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:13.476849 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1270/2561] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 11:20:13.480945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990178f5-37b2-4514-b09c-c8e786865591 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:13.490376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990178f5-37b2-4514-b09c-c8e786865591 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:13.494982 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c41e48-5ab7-481a-be28-f2ee55d68a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:13.495584 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c41e48-5ab7-481a-be28-f2ee55d68a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.495862 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c41e48-5ab7-481a-be28-f2ee55d68a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.496135 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c41e48-5ab7-481a-be28-f2ee55d68a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.496797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c41e48-5ab7-481a-be28-f2ee55d68a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:13.498786 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c41e48-5ab7-481a-be28-f2ee55d68a35 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:13.546957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1292/2562] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:13 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:13.550974 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da71e04-c78d-4dbf-bb6d-face4473b76d admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:13.575375 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1271/2563] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:13 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:13.581682 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c41e48-5ab7-481a-be28-f2ee55d68a35 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:13.611290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da71e04-c78d-4dbf-bb6d-face4473b76d admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:13.641141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c41e48-5ab7-481a-be28-f2ee55d68a35 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:13.646568 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894acecd-dada-422b-9b14-4fa1c52a7359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:13.647277 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894acecd-dada-422b-9b14-4fa1c52a7359 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.647525 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894acecd-dada-422b-9b14-4fa1c52a7359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.647806 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894acecd-dada-422b-9b14-4fa1c52a7359 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.648480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894acecd-dada-422b-9b14-4fa1c52a7359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:13.650487 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894acecd-dada-422b-9b14-4fa1c52a7359 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:13.667372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a11019-629c-42ef-91f5-d504e9fdb7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:13.667972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a11019-629c-42ef-91f5-d504e9fdb7ff admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.668256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a11019-629c-42ef-91f5-d504e9fdb7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.668538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a11019-629c-42ef-91f5-d504e9fdb7ff admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.669279 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a11019-629c-42ef-91f5-d504e9fdb7ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:13.671328 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a11019-629c-42ef-91f5-d504e9fdb7ff admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:13.745804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1272/2564] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:13 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:13.749727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894acecd-dada-422b-9b14-4fa1c52a7359 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:13.759655 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894acecd-dada-422b-9b14-4fa1c52a7359 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:13.764333 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd56ac2-ea94-46e3-a238-f0ba1342e674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:13.764960 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd56ac2-ea94-46e3-a238-f0ba1342e674 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.765273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd56ac2-ea94-46e3-a238-f0ba1342e674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.765550 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd56ac2-ea94-46e3-a238-f0ba1342e674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.766262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd56ac2-ea94-46e3-a238-f0ba1342e674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:13.768481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd56ac2-ea94-46e3-a238-f0ba1342e674 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:13.777877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1293/2565] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:13 2022] POST /identity/v3/users => generated 282 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:13.781168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1273/2566] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:13.781341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a11019-629c-42ef-91f5-d504e9fdb7ff admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:13.782373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd56ac2-ea94-46e3-a238-f0ba1342e674 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:13.790819 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a11019-629c-42ef-91f5-d504e9fdb7ff admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:13.795037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd56ac2-ea94-46e3-a238-f0ba1342e674 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:13.796118 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b27ee-bf75-4163-a64f-737cebbc925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:13.796719 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328d925-d781-476b-a409-587107926f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:13.796851 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b27ee-bf75-4163-a64f-737cebbc925f admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.797211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b27ee-bf75-4163-a64f-737cebbc925f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.797375 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328d925-d781-476b-a409-587107926f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.797566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b27ee-bf75-4163-a64f-737cebbc925f admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.797660 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328d925-d781-476b-a409-587107926f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.797907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328d925-d781-476b-a409-587107926f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.798212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b27ee-bf75-4163-a64f-737cebbc925f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:13.798767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328d925-d781-476b-a409-587107926f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:13.799905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b27ee-bf75-4163-a64f-737cebbc925f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:13.800382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328d925-d781-476b-a409-587107926f84 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:13.810208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1294/2567] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:13.810586 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1274/2568] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:13.814574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b27ee-bf75-4163-a64f-737cebbc925f admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:13.817113 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328d925-d781-476b-a409-587107926f84 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:13.824175 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b27ee-bf75-4163-a64f-737cebbc925f admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:13.826766 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328d925-d781-476b-a409-587107926f84 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:13.828881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9e50b-6633-468a-853f-d5e38714a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:13.830139 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9e50b-6633-468a-853f-d5e38714a301 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.830419 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9e50b-6633-468a-853f-d5e38714a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.830692 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9e50b-6633-468a-853f-d5e38714a301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.831400 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9e50b-6633-468a-853f-d5e38714a301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:13.832094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933b50e-0b55-4484-bcc0-32d3a3d32255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:13.832950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933b50e-0b55-4484-bcc0-32d3a3d32255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.833105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9e50b-6633-468a-853f-d5e38714a301 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:13.833367 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933b50e-0b55-4484-bcc0-32d3a3d32255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.833650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933b50e-0b55-4484-bcc0-32d3a3d32255 admin admin] PATH_INFO: `/v3/projects/21b60e00a9ac478793dc6330fbe49b53/users/901b623cb4104d90b1047ce67f9955ae/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.843116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1295/2569] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:13.847222 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9e50b-6633-468a-853f-d5e38714a301 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:13.848199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933b50e-0b55-4484-bcc0-32d3a3d32255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b60e00a9ac478793dc6330fbe49b53, user_id=901b623cb4104d90b1047ce67f9955ae, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:13.850911 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933b50e-0b55-4484-bcc0-32d3a3d32255 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:13.858195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9e50b-6633-468a-853f-d5e38714a301 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:13.861486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54393c89-1119-4e99-a75a-6f1a40628309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:13.862340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54393c89-1119-4e99-a75a-6f1a40628309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.862621 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54393c89-1119-4e99-a75a-6f1a40628309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.862893 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54393c89-1119-4e99-a75a-6f1a40628309 admin admin] PATH_INFO: `/v3/projects/07ec5c0b2e824720b1e97823eadf87e6/users/b597be6f98df436ea3650fd204b8b0f7/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.877392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54393c89-1119-4e99-a75a-6f1a40628309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ec5c0b2e824720b1e97823eadf87e6, user_id=b597be6f98df436ea3650fd204b8b0f7, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:13.880032 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54393c89-1119-4e99-a75a-6f1a40628309 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:13.940142 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1275/2570] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:13 2022] PUT /identity/v3/projects/21b60e00a9ac478793dc6330fbe49b53/users/901b623cb4104d90b1047ce67f9955ae/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:13.950260 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff29bc-d5ae-4cb8-b528-ae7906131b88 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.950541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff29bc-d5ae-4cb8-b528-ae7906131b88 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.950816 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff29bc-d5ae-4cb8-b528-ae7906131b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:13.968360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1296/2571] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:13 2022] PUT /identity/v3/projects/07ec5c0b2e824720b1e97823eadf87e6/users/b597be6f98df436ea3650fd204b8b0f7/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:13.976422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f5ff29bc-d5ae-4cb8-b528-ae7906131b88 None None] MFA Rules not processed for user `901b623cb4104d90b1047ce67f9955ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:13.977661 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f5ff29bc-d5ae-4cb8-b528-ae7906131b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:13.979783 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117afbd1-5e3e-45d0-92b3-1552bfb8c21e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:13.980078 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117afbd1-5e3e-45d0-92b3-1552bfb8c21e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:13.980390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117afbd1-5e3e-45d0-92b3-1552bfb8c21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.007103 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-117afbd1-5e3e-45d0-92b3-1552bfb8c21e None None] MFA Rules not processed for user `b597be6f98df436ea3650fd204b8b0f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:14.008275 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-117afbd1-5e3e-45d0-92b3-1552bfb8c21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:14.039742 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1276/2572] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:14.044556 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff29bc-d5ae-4cb8-b528-ae7906131b88 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:14.075211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1297/2573] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:14.080087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117afbd1-5e3e-45d0-92b3-1552bfb8c21e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:14.112014 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff29bc-d5ae-4cb8-b528-ae7906131b88 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:14.117722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21e086-42a4-4692-9439-944fd1d3c84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:14.118393 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21e086-42a4-4692-9439-944fd1d3c84b admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.118680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21e086-42a4-4692-9439-944fd1d3c84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.118976 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21e086-42a4-4692-9439-944fd1d3c84b admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.119669 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21e086-42a4-4692-9439-944fd1d3c84b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:14.124760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21e086-42a4-4692-9439-944fd1d3c84b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:14.145261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117afbd1-5e3e-45d0-92b3-1552bfb8c21e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:14.150989 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163d578-1d14-431d-8350-c971455585fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:14.153998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163d578-1d14-431d-8350-c971455585fe admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.153998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163d578-1d14-431d-8350-c971455585fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.153998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163d578-1d14-431d-8350-c971455585fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.153998 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163d578-1d14-431d-8350-c971455585fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:14.154990 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163d578-1d14-431d-8350-c971455585fe admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:14.212973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1277/2574] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:14 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:14.216789 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21e086-42a4-4692-9439-944fd1d3c84b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:14.257458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1298/2575] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:14 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:14.263841 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163d578-1d14-431d-8350-c971455585fe admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:14.280677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21e086-42a4-4692-9439-944fd1d3c84b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:14.323817 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163d578-1d14-431d-8350-c971455585fe admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:14.328509 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739cb29-bad4-474d-8008-e196e4c58dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:14.329741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739cb29-bad4-474d-8008-e196e4c58dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.330023 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739cb29-bad4-474d-8008-e196e4c58dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.330301 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739cb29-bad4-474d-8008-e196e4c58dfd admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.330986 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739cb29-bad4-474d-8008-e196e4c58dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:14.332919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739cb29-bad4-474d-8008-e196e4c58dfd admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:14.335475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60761c6a-f51a-4439-ab49-dabba2a10a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:14.336264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60761c6a-f51a-4439-ab49-dabba2a10a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.336646 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60761c6a-f51a-4439-ab49-dabba2a10a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.337023 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60761c6a-f51a-4439-ab49-dabba2a10a17 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.338005 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60761c6a-f51a-4439-ab49-dabba2a10a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:14.340213 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60761c6a-f51a-4439-ab49-dabba2a10a17 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:14.420327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1299/2576] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:14 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:14.424301 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739cb29-bad4-474d-8008-e196e4c58dfd admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:14.434097 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1278/2577] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:14 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:14.434278 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739cb29-bad4-474d-8008-e196e4c58dfd admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:14.435123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60761c6a-f51a-4439-ab49-dabba2a10a17 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:14.439093 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c501ee-bb32-425c-99ae-4c22e42496f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:14.439751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c501ee-bb32-425c-99ae-4c22e42496f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.440093 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c501ee-bb32-425c-99ae-4c22e42496f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.440432 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c501ee-bb32-425c-99ae-4c22e42496f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.441265 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c501ee-bb32-425c-99ae-4c22e42496f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:14.442819 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c501ee-bb32-425c-99ae-4c22e42496f3 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:14.445639 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60761c6a-f51a-4439-ab49-dabba2a10a17 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:14.450703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec044ed-baa8-45d2-906d-8ca87e1aad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:14.451360 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec044ed-baa8-45d2-906d-8ca87e1aad20 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.451649 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec044ed-baa8-45d2-906d-8ca87e1aad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.451929 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec044ed-baa8-45d2-906d-8ca87e1aad20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.452652 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec044ed-baa8-45d2-906d-8ca87e1aad20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:14.455042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec044ed-baa8-45d2-906d-8ca87e1aad20 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:14.457470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1300/2578] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:14.458380 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c501ee-bb32-425c-99ae-4c22e42496f3 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:14.466110 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1279/2579] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:14.469938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec044ed-baa8-45d2-906d-8ca87e1aad20 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:14.471646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c501ee-bb32-425c-99ae-4c22e42496f3 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:14.476296 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf597-c8e4-4081-ba22-6bbb3a4e03f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:14.477208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf597-c8e4-4081-ba22-6bbb3a4e03f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.477486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf597-c8e4-4081-ba22-6bbb3a4e03f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.477757 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf597-c8e4-4081-ba22-6bbb3a4e03f8 admin admin] PATH_INFO: `/v3/projects/6058aeda2d854a52839886f04e4adaab/users/bdfcffdd0cfe4b7a9450b5376dd0e44d/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.479614 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec044ed-baa8-45d2-906d-8ca87e1aad20 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:14.484304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de997095-0b2d-4825-b419-2ca34b6e6e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:14.485203 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de997095-0b2d-4825-b419-2ca34b6e6e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.485483 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de997095-0b2d-4825-b419-2ca34b6e6e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.485760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de997095-0b2d-4825-b419-2ca34b6e6e9d admin admin] PATH_INFO: `/v3/projects/7553191272e8442b90eada6753e55e39/users/b5148d7a21b84a2ebb4d08dd61e021ea/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.493930 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcf597-c8e4-4081-ba22-6bbb3a4e03f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6058aeda2d854a52839886f04e4adaab, user_id=bdfcffdd0cfe4b7a9450b5376dd0e44d, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:14.498610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcf597-c8e4-4081-ba22-6bbb3a4e03f8 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:14.500207 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de997095-0b2d-4825-b419-2ca34b6e6e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7553191272e8442b90eada6753e55e39, user_id=b5148d7a21b84a2ebb4d08dd61e021ea, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:14.503420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de997095-0b2d-4825-b419-2ca34b6e6e9d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:14.569347 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1301/2580] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:14 2022] PUT /identity/v3/projects/6058aeda2d854a52839886f04e4adaab/users/bdfcffdd0cfe4b7a9450b5376dd0e44d/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:14.573319 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf597-c8e4-4081-ba22-6bbb3a4e03f8 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:14.591470 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1280/2581] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:14 2022] PUT /identity/v3/projects/7553191272e8442b90eada6753e55e39/users/b5148d7a21b84a2ebb4d08dd61e021ea/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:14.599082 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de997095-0b2d-4825-b419-2ca34b6e6e9d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:14.634158 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf597-c8e4-4081-ba22-6bbb3a4e03f8 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:14.660823 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de997095-0b2d-4825-b419-2ca34b6e6e9d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:14.665647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c5589-7836-4389-b52c-89b494ecc3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:14.666312 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c5589-7836-4389-b52c-89b494ecc3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.666594 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c5589-7836-4389-b52c-89b494ecc3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.667125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c5589-7836-4389-b52c-89b494ecc3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.667844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c5589-7836-4389-b52c-89b494ecc3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:14.669526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c5589-7836-4389-b52c-89b494ecc3f0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:14.679481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1281/2582] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:14.683712 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c5589-7836-4389-b52c-89b494ecc3f0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:14.694039 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe680e-9a3e-4ce9-a469-498e58fa5038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:14.694039 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe680e-9a3e-4ce9-a469-498e58fa5038 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.694039 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe680e-9a3e-4ce9-a469-498e58fa5038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.694039 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe680e-9a3e-4ce9-a469-498e58fa5038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.694446 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c5589-7836-4389-b52c-89b494ecc3f0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:14.694554 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe680e-9a3e-4ce9-a469-498e58fa5038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:14.695597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe680e-9a3e-4ce9-a469-498e58fa5038 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:14.698845 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14ba5c-72dd-42e6-86be-13276d77bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:14.699697 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14ba5c-72dd-42e6-86be-13276d77bdbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.699971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14ba5c-72dd-42e6-86be-13276d77bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.700241 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14ba5c-72dd-42e6-86be-13276d77bdbf admin admin] PATH_INFO: `/v3/projects/7553191272e8442b90eada6753e55e39/users/b5148d7a21b84a2ebb4d08dd61e021ea/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.702207 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14ba5c-72dd-42e6-86be-13276d77bdbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7553191272e8442b90eada6753e55e39, user_id=b5148d7a21b84a2ebb4d08dd61e021ea, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:14.705645 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14ba5c-72dd-42e6-86be-13276d77bdbf admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:14.706028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1302/2583] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:14.710251 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe680e-9a3e-4ce9-a469-498e58fa5038 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:14.715773 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1282/2584] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:14 2022] PUT /identity/v3/projects/7553191272e8442b90eada6753e55e39/users/b5148d7a21b84a2ebb4d08dd61e021ea/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:14.722482 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe680e-9a3e-4ce9-a469-498e58fa5038 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:14.727081 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89f20-939e-419a-b0ed-3d373dcd9b99 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.727403 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89f20-939e-419a-b0ed-3d373dcd9b99 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.727686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89f20-939e-419a-b0ed-3d373dcd9b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.753865 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3de89f20-939e-419a-b0ed-3d373dcd9b99 None None] MFA Rules not processed for user `b5148d7a21b84a2ebb4d08dd61e021ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:14.755077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3de89f20-939e-419a-b0ed-3d373dcd9b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:14.775230 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585c104-da91-44b2-9b56-a7f8484c5ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:14.776126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585c104-da91-44b2-9b56-a7f8484c5ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.776414 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585c104-da91-44b2-9b56-a7f8484c5ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.776691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585c104-da91-44b2-9b56-a7f8484c5ad8 admin admin] PATH_INFO: `/v3/projects/6058aeda2d854a52839886f04e4adaab/users/bdfcffdd0cfe4b7a9450b5376dd0e44d/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.778717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585c104-da91-44b2-9b56-a7f8484c5ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6058aeda2d854a52839886f04e4adaab, user_id=bdfcffdd0cfe4b7a9450b5376dd0e44d, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:14.781360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585c104-da91-44b2-9b56-a7f8484c5ad8 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:14.791561 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1303/2585] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:14 2022] PUT /identity/v3/projects/6058aeda2d854a52839886f04e4adaab/users/bdfcffdd0cfe4b7a9450b5376dd0e44d/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:14.802444 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e782592-8c4d-4520-a47c-20cbbc8001a0 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.802737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e782592-8c4d-4520-a47c-20cbbc8001a0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.803022 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e782592-8c4d-4520-a47c-20cbbc8001a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.825788 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1283/2586] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:14.829970 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-3e782592-8c4d-4520-a47c-20cbbc8001a0 None None] MFA Rules not processed for user `bdfcffdd0cfe4b7a9450b5376dd0e44d`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:14.831508 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3e782592-8c4d-4520-a47c-20cbbc8001a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:14.836507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de89f20-939e-419a-b0ed-3d373dcd9b99 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:14.837838 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3de89f20-939e-419a-b0ed-3d373dcd9b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:14.895574 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de89f20-939e-419a-b0ed-3d373dcd9b99 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:14.898974 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1304/2587] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:14.911294 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e782592-8c4d-4520-a47c-20cbbc8001a0 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:14.912727 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3e782592-8c4d-4520-a47c-20cbbc8001a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:14.954117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf834f4-c86b-402a-8dd9-9b663ce986e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:14.954773 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf834f4-c86b-402a-8dd9-9b663ce986e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.955062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf834f4-c86b-402a-8dd9-9b663ce986e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.955332 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf834f4-c86b-402a-8dd9-9b663ce986e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.976195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e782592-8c4d-4520-a47c-20cbbc8001a0 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:14.981211 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98713c3-dacf-4af7-9f56-14ac6197d83f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:14.986204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98713c3-dacf-4af7-9f56-14ac6197d83f service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:14.986204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98713c3-dacf-4af7-9f56-14ac6197d83f service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:14.986204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98713c3-dacf-4af7-9f56-14ac6197d83f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:14.993300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98713c3-dacf-4af7-9f56-14ac6197d83f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:14.995256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98713c3-dacf-4af7-9f56-14ac6197d83f service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:15.006403 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1305/2588] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:15.029945 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf834f4-c86b-402a-8dd9-9b663ce986e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:15.031434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf834f4-c86b-402a-8dd9-9b663ce986e0 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:15.041523 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1284/2589] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:15.171535 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98713c3-dacf-4af7-9f56-14ac6197d83f service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:15.180570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98713c3-dacf-4af7-9f56-14ac6197d83f service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:15.185191 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f0280-4db6-4837-88f4-b09203981a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:15.185346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f0280-4db6-4837-88f4-b09203981a8b service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:15.185679 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f0280-4db6-4837-88f4-b09203981a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:15.185964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f0280-4db6-4837-88f4-b09203981a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:15.257728 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f0280-4db6-4837-88f4-b09203981a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:15.259379 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f0280-4db6-4837-88f4-b09203981a8b service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:15.270113 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1306/2590] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:15 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:15.582850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf834f4-c86b-402a-8dd9-9b663ce986e0 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:15.647316 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf834f4-c86b-402a-8dd9-9b663ce986e0 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:15.658270 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020bc61-3d99-4c52-a0d8-d7798ea66101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:15.659289 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020bc61-3d99-4c52-a0d8-d7798ea66101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:15.659566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020bc61-3d99-4c52-a0d8-d7798ea66101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:15.659844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020bc61-3d99-4c52-a0d8-d7798ea66101 admin admin] PATH_INFO: `/v3/users/901b623cb4104d90b1047ce67f9955ae` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:15.661109 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020bc61-3d99-4c52-a0d8-d7798ea66101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=901b623cb4104d90b1047ce67f9955ae)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:15.663057 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020bc61-3d99-4c52-a0d8-d7798ea66101 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:15.865384 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f020bc61-3d99-4c52-a0d8-d7798ea66101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901b623cb4104d90b1047ce67f9955ae'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:15.866053 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f020bc61-3d99-4c52-a0d8-d7798ea66101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901b623cb4104d90b1047ce67f9955ae'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:15.867390 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f020bc61-3d99-4c52-a0d8-d7798ea66101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901b623cb4104d90b1047ce67f9955ae'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:15.942315 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f020bc61-3d99-4c52-a0d8-d7798ea66101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901b623cb4104d90b1047ce67f9955ae'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:15.956878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f020bc61-3d99-4c52-a0d8-d7798ea66101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901b623cb4104d90b1047ce67f9955ae'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:15.971056 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1285/2591] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:15 2022] DELETE /identity/v3/users/901b623cb4104d90b1047ce67f9955ae => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:15.975302 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d9ebd-32f3-4fe4-826e-51a5d602529e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:15.975576 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d9ebd-32f3-4fe4-826e-51a5d602529e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:15.975850 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d9ebd-32f3-4fe4-826e-51a5d602529e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:15.997110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-592d9ebd-32f3-4fe4-826e-51a5d602529e None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:15.998570 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-592d9ebd-32f3-4fe4-826e-51a5d602529e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:16.078660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1307/2592] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:16.090478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020bc61-3d99-4c52-a0d8-d7798ea66101 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:16.092115 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f020bc61-3d99-4c52-a0d8-d7798ea66101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:16.158205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020bc61-3d99-4c52-a0d8-d7798ea66101 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:16.161960 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed31d65-8c79-4537-afa9-b38f84a4eeed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:16.162609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed31d65-8c79-4537-afa9-b38f84a4eeed service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:16.162909 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed31d65-8c79-4537-afa9-b38f84a4eeed service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:16.163186 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed31d65-8c79-4537-afa9-b38f84a4eeed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:16.173172 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed31d65-8c79-4537-afa9-b38f84a4eeed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:16.174697 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed31d65-8c79-4537-afa9-b38f84a4eeed service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:16.184792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1286/2593] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:16.556232 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d9ebd-32f3-4fe4-826e-51a5d602529e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:16.558964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-592d9ebd-32f3-4fe4-826e-51a5d602529e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:16.574149 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d9ebd-32f3-4fe4-826e-51a5d602529e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:16.581709 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:16.582720 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:16.583209 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:16.583686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] PATH_INFO: `/v3/projects/21b60e00a9ac478793dc6330fbe49b53` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:16.584978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b60e00a9ac478793dc6330fbe49b53)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:16.591502 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:16.718784 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b60e00a9ac478793dc6330fbe49b53', 'request_id': 'req-a2ade122-924e-4cbb-9874-5cb48fedf7f8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:16.791870 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b60e00a9ac478793dc6330fbe49b53', 'request_id': 'req-a2ade122-924e-4cbb-9874-5cb48fedf7f8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:16.800244 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b60e00a9ac478793dc6330fbe49b53', 'request_id': 'req-a2ade122-924e-4cbb-9874-5cb48fedf7f8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:16.811115 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] The token cache is being invalidate because project 21b60e00a9ac478793dc6330fbe49b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:16.811477 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:16.812325 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:16.817369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1308/2594] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:16 2022] DELETE /identity/v3/projects/21b60e00a9ac478793dc6330fbe49b53 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:16.819042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed31d65-8c79-4537-afa9-b38f84a4eeed service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:16.836206 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed31d65-8c79-4537-afa9-b38f84a4eeed service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:16.900386 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abab64f-50a8-403d-8c45-6eb01beb9aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:16.902043 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abab64f-50a8-403d-8c45-6eb01beb9aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:16.902363 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abab64f-50a8-403d-8c45-6eb01beb9aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:16.902964 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abab64f-50a8-403d-8c45-6eb01beb9aef admin admin] PATH_INFO: `/v3/users/b5148d7a21b84a2ebb4d08dd61e021ea` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:16.903916 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abab64f-50a8-403d-8c45-6eb01beb9aef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5148d7a21b84a2ebb4d08dd61e021ea)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:16.906040 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abab64f-50a8-403d-8c45-6eb01beb9aef admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:17.096980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6abab64f-50a8-403d-8c45-6eb01beb9aef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5148d7a21b84a2ebb4d08dd61e021ea'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:17.097693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6abab64f-50a8-403d-8c45-6eb01beb9aef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5148d7a21b84a2ebb4d08dd61e021ea'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:17.098306 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6abab64f-50a8-403d-8c45-6eb01beb9aef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5148d7a21b84a2ebb4d08dd61e021ea'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:17.179648 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6abab64f-50a8-403d-8c45-6eb01beb9aef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5148d7a21b84a2ebb4d08dd61e021ea'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:17.192637 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6abab64f-50a8-403d-8c45-6eb01beb9aef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5148d7a21b84a2ebb4d08dd61e021ea'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:17.204710 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1287/2595] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:16 2022] DELETE /identity/v3/users/b5148d7a21b84a2ebb4d08dd61e021ea => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:17.650796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:17.652262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:17.667271 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ade122-924e-4cbb-9874-5cb48fedf7f8 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:17.725832 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:17.726697 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:17.726982 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:17.727258 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f admin admin] PATH_INFO: `/v3/projects/7553191272e8442b90eada6753e55e39` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:17.728429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7553191272e8442b90eada6753e55e39)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:17.730343 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:17.842987 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7553191272e8442b90eada6753e55e39', 'request_id': 'req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:17.917524 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7553191272e8442b90eada6753e55e39', 'request_id': 'req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:17.924724 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7553191272e8442b90eada6753e55e39', 'request_id': 'req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:17.934976 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f admin admin] The token cache is being invalidate because project 7553191272e8442b90eada6753e55e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:17.935261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:17.935928 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d51c3bb6-ff10-4a46-8b1a-f5e8ccaa541f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:17.937538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1309/2596] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:17 2022] DELETE /identity/v3/projects/7553191272e8442b90eada6753e55e39 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:17.943264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b6f68-148f-464b-8add-50bb320a254b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:17.943722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b6f68-148f-464b-8add-50bb320a254b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:17.943834 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b6f68-148f-464b-8add-50bb320a254b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:17.964223 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c86b6f68-148f-464b-8add-50bb320a254b None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:17.965815 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c86b6f68-148f-464b-8add-50bb320a254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:18.032490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1288/2597] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:18.040309 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57210e6-a620-48a3-9f10-98078a636708 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:18.040824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57210e6-a620-48a3-9f10-98078a636708 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:18.048675 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57210e6-a620-48a3-9f10-98078a636708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:18.060189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e57210e6-a620-48a3-9f10-98078a636708 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:18.061566 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e57210e6-a620-48a3-9f10-98078a636708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:18.070161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1310/2598] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:18.074381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b6f68-148f-464b-8add-50bb320a254b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:18.083810 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b6f68-148f-464b-8add-50bb320a254b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:18.088517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2a65b-9e5b-4573-b813-6d121e4ed120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:18.089208 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2a65b-9e5b-4573-b813-6d121e4ed120 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:18.089491 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2a65b-9e5b-4573-b813-6d121e4ed120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:18.089766 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2a65b-9e5b-4573-b813-6d121e4ed120 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:18.090524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2a65b-9e5b-4573-b813-6d121e4ed120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:20:18.090833 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2a65b-9e5b-4573-b813-6d121e4ed120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:18.092475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2a65b-9e5b-4573-b813-6d121e4ed120 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:18.105105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1289/2599] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:20:18.109240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57210e6-a620-48a3-9f10-98078a636708 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:18.118906 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57210e6-a620-48a3-9f10-98078a636708 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:18.123778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69151c2b-47a7-43a8-a55d-f7f763addd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:18.124437 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151c2b-47a7-43a8-a55d-f7f763addd89 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:18.124718 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151c2b-47a7-43a8-a55d-f7f763addd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:18.124989 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151c2b-47a7-43a8-a55d-f7f763addd89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:18.125742 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69151c2b-47a7-43a8-a55d-f7f763addd89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:18.127690 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69151c2b-47a7-43a8-a55d-f7f763addd89 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:18.214293 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1311/2600] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:18 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:18.215544 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2a65b-9e5b-4573-b813-6d121e4ed120 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:18.226538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2a65b-9e5b-4573-b813-6d121e4ed120 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:18.283572 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eef308-4851-4dd4-ac4d-17d04165806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:18.284283 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eef308-4851-4dd4-ac4d-17d04165806a admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:18.284565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eef308-4851-4dd4-ac4d-17d04165806a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:18.284838 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eef308-4851-4dd4-ac4d-17d04165806a admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:18.285757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eef308-4851-4dd4-ac4d-17d04165806a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:18.287762 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eef308-4851-4dd4-ac4d-17d04165806a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:18.349841 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1290/2601] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:18 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:18.351223 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69151c2b-47a7-43a8-a55d-f7f763addd89 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:18.362964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69151c2b-47a7-43a8-a55d-f7f763addd89 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:18.368205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f8bb6-9320-47e5-8273-1e4f15b66f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:18.368892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f8bb6-9320-47e5-8273-1e4f15b66f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:18.369243 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f8bb6-9320-47e5-8273-1e4f15b66f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:18.369525 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f8bb6-9320-47e5-8273-1e4f15b66f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:18.370294 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f8bb6-9320-47e5-8273-1e4f15b66f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:18.372140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f8bb6-9320-47e5-8273-1e4f15b66f8a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:18.387314 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1312/2602] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:18.388613 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eef308-4851-4dd4-ac4d-17d04165806a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:18.399112 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eef308-4851-4dd4-ac4d-17d04165806a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:18.403833 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6d30a-6d28-4a61-ba18-2d7d713ed73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:18.404659 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6d30a-6d28-4a61-ba18-2d7d713ed73e admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:18.404949 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6d30a-6d28-4a61-ba18-2d7d713ed73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:18.405263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6d30a-6d28-4a61-ba18-2d7d713ed73e admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:18.405998 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6d30a-6d28-4a61-ba18-2d7d713ed73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:18.408155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6d30a-6d28-4a61-ba18-2d7d713ed73e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:18.422208 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1291/2603] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:18.423981 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f8bb6-9320-47e5-8273-1e4f15b66f8a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:18.434483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f8bb6-9320-47e5-8273-1e4f15b66f8a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:18.439368 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a394a-796e-4d1b-9886-c421026c0155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:18.440259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a394a-796e-4d1b-9886-c421026c0155 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:18.440538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a394a-796e-4d1b-9886-c421026c0155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:18.440812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a394a-796e-4d1b-9886-c421026c0155 admin admin] PATH_INFO: `/v3/projects/7108e651ddff4a29bdcc0fd9173f8e29/users/9de9194476a3453c89927c9bd88cf9b8/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:18.456428 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a394a-796e-4d1b-9886-c421026c0155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7108e651ddff4a29bdcc0fd9173f8e29, user_id=9de9194476a3453c89927c9bd88cf9b8, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:18.459136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a394a-796e-4d1b-9886-c421026c0155 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:18.535765 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1313/2604] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:18 2022] PUT /identity/v3/projects/7108e651ddff4a29bdcc0fd9173f8e29/users/9de9194476a3453c89927c9bd88cf9b8/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:18.547529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe592a-5f82-4c09-baae-06386d30b3ae None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:18.547822 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe592a-5f82-4c09-baae-06386d30b3ae None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:18.548101 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe592a-5f82-4c09-baae-06386d30b3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:18.573735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-97fe592a-5f82-4c09-baae-06386d30b3ae None None] MFA Rules not processed for user `9de9194476a3453c89927c9bd88cf9b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:18.574917 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-97fe592a-5f82-4c09-baae-06386d30b3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:18.642667 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1292/2605] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:18.647280 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a394a-796e-4d1b-9886-c421026c0155 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:18.713502 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a394a-796e-4d1b-9886-c421026c0155 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:18.718217 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d67b0-ff57-4d3f-a5ce-e72386913617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:18.718877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d67b0-ff57-4d3f-a5ce-e72386913617 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:18.719156 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d67b0-ff57-4d3f-a5ce-e72386913617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:18.719451 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d67b0-ff57-4d3f-a5ce-e72386913617 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:18.720717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d67b0-ff57-4d3f-a5ce-e72386913617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:18.722755 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d67b0-ff57-4d3f-a5ce-e72386913617 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:18.827810 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1314/2606] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:18 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:18.834033 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe592a-5f82-4c09-baae-06386d30b3ae None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:18.842857 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe592a-5f82-4c09-baae-06386d30b3ae None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:18.873876 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d67b0-ff57-4d3f-a5ce-e72386913617 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:18.875597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2b6d67b0-ff57-4d3f-a5ce-e72386913617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:18.900582 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a8e41-e6f1-4799-b187-afa090aba85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:18.901287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a8e41-e6f1-4799-b187-afa090aba85d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:18.901573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a8e41-e6f1-4799-b187-afa090aba85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:18.901849 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a8e41-e6f1-4799-b187-afa090aba85d admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:18.902543 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a8e41-e6f1-4799-b187-afa090aba85d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:18.904923 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a8e41-e6f1-4799-b187-afa090aba85d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:18.940560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d67b0-ff57-4d3f-a5ce-e72386913617 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:18.945277 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69845ec-a83a-4a6b-9325-474644f3ddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:18.946143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69845ec-a83a-4a6b-9325-474644f3ddcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:18.946424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69845ec-a83a-4a6b-9325-474644f3ddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:18.946698 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69845ec-a83a-4a6b-9325-474644f3ddcc admin admin] PATH_INFO: `/v3/users/b597be6f98df436ea3650fd204b8b0f7` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:18.947890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69845ec-a83a-4a6b-9325-474644f3ddcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b597be6f98df436ea3650fd204b8b0f7)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:18.949922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69845ec-a83a-4a6b-9325-474644f3ddcc admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:19.003099 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1293/2607] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:18 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:19.006922 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a8e41-e6f1-4799-b187-afa090aba85d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:19.016698 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a8e41-e6f1-4799-b187-afa090aba85d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:19.021474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e59fa-3f85-4be2-8c89-74c022b92f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:19.022444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e59fa-3f85-4be2-8c89-74c022b92f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:19.022739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e59fa-3f85-4be2-8c89-74c022b92f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:19.023018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e59fa-3f85-4be2-8c89-74c022b92f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:19.023731 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e59fa-3f85-4be2-8c89-74c022b92f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:19.025427 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e59fa-3f85-4be2-8c89-74c022b92f17 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:19.035389 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1294/2608] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:19.039410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e59fa-3f85-4be2-8c89-74c022b92f17 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:19.049600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e59fa-3f85-4be2-8c89-74c022b92f17 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:19.058918 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5357d-aa84-4ef2-9bae-3f2ca2be6d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:19.058918 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5357d-aa84-4ef2-9bae-3f2ca2be6d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:19.058918 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5357d-aa84-4ef2-9bae-3f2ca2be6d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:19.058918 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5357d-aa84-4ef2-9bae-3f2ca2be6d6e admin admin] PATH_INFO: `/v3/projects/a650e5a780cc4fd8804183b3be511099/users/8d605b5770b9425caacd79994229a9d5/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:19.074813 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5357d-aa84-4ef2-9bae-3f2ca2be6d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a650e5a780cc4fd8804183b3be511099, user_id=8d605b5770b9425caacd79994229a9d5, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:19.077660 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5357d-aa84-4ef2-9bae-3f2ca2be6d6e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:19.119255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f69845ec-a83a-4a6b-9325-474644f3ddcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b597be6f98df436ea3650fd204b8b0f7'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:19.119829 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f69845ec-a83a-4a6b-9325-474644f3ddcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b597be6f98df436ea3650fd204b8b0f7'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:19.120445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f69845ec-a83a-4a6b-9325-474644f3ddcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b597be6f98df436ea3650fd204b8b0f7'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:19.131859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f69845ec-a83a-4a6b-9325-474644f3ddcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b597be6f98df436ea3650fd204b8b0f7'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:19.138522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f69845ec-a83a-4a6b-9325-474644f3ddcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b597be6f98df436ea3650fd204b8b0f7'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:19.163110 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1295/2609] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:19 2022] PUT /identity/v3/projects/a650e5a780cc4fd8804183b3be511099/users/8d605b5770b9425caacd79994229a9d5/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:19.167396 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5357d-aa84-4ef2-9bae-3f2ca2be6d6e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:19.169162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a3a5357d-aa84-4ef2-9bae-3f2ca2be6d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:19.231895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1315/2610] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:18 2022] DELETE /identity/v3/users/b597be6f98df436ea3650fd204b8b0f7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:19.236507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c6b63-cc2f-4701-b0d3-15d0d30ff507 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:19.236796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c6b63-cc2f-4701-b0d3-15d0d30ff507 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:19.237140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c6b63-cc2f-4701-b0d3-15d0d30ff507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:19.256048 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-8d6c6b63-cc2f-4701-b0d3-15d0d30ff507 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:19.257485 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8d6c6b63-cc2f-4701-b0d3-15d0d30ff507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:19.320549 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1316/2611] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:19.331110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c6b63-cc2f-4701-b0d3-15d0d30ff507 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:19.332491 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8d6c6b63-cc2f-4701-b0d3-15d0d30ff507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:19.364225 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5357d-aa84-4ef2-9bae-3f2ca2be6d6e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:19.369577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684b090-4b1f-4780-8cd8-2a73eb103270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:19.370169 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684b090-4b1f-4780-8cd8-2a73eb103270 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:19.370452 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684b090-4b1f-4780-8cd8-2a73eb103270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:19.370721 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684b090-4b1f-4780-8cd8-2a73eb103270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:19.371468 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684b090-4b1f-4780-8cd8-2a73eb103270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:19.373120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684b090-4b1f-4780-8cd8-2a73eb103270 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:19.383302 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1296/2612] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:19.387507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684b090-4b1f-4780-8cd8-2a73eb103270 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:19.394461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c6b63-cc2f-4701-b0d3-15d0d30ff507 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:19.397425 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684b090-4b1f-4780-8cd8-2a73eb103270 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:19.398303 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eec006-94b3-4c10-b23b-877adb934855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:19.398948 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eec006-94b3-4c10-b23b-877adb934855 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:19.399241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eec006-94b3-4c10-b23b-877adb934855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:19.399518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eec006-94b3-4c10-b23b-877adb934855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:19.402422 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77859d61-5269-456a-a87a-aef5b8fd983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:19.403311 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77859d61-5269-456a-a87a-aef5b8fd983b admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:19.403592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77859d61-5269-456a-a87a-aef5b8fd983b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:19.403868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77859d61-5269-456a-a87a-aef5b8fd983b admin admin] PATH_INFO: `/v3/projects/a650e5a780cc4fd8804183b3be511099/users/8d605b5770b9425caacd79994229a9d5/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:19.405849 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77859d61-5269-456a-a87a-aef5b8fd983b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a650e5a780cc4fd8804183b3be511099, user_id=8d605b5770b9425caacd79994229a9d5, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:19.408810 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77859d61-5269-456a-a87a-aef5b8fd983b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:19.408929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eec006-94b3-4c10-b23b-877adb934855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:19.410404 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eec006-94b3-4c10-b23b-877adb934855 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:19.419822 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1297/2613] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:19 2022] PUT /identity/v3/projects/a650e5a780cc4fd8804183b3be511099/users/8d605b5770b9425caacd79994229a9d5/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:19.423334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1317/2614] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:19.434703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd011-1cd6-43cb-81ca-7500f0a6a2a0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:19.435152 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd011-1cd6-43cb-81ca-7500f0a6a2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:19.435430 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd011-1cd6-43cb-81ca-7500f0a6a2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:19.462699 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-df0fd011-1cd6-43cb-81ca-7500f0a6a2a0 None None] MFA Rules not processed for user `8d605b5770b9425caacd79994229a9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:19.469711 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-df0fd011-1cd6-43cb-81ca-7500f0a6a2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:19.534969 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1298/2615] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:19.546772 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eec006-94b3-4c10-b23b-877adb934855 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:19.548693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-80eec006-94b3-4c10-b23b-877adb934855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:19.607309 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eec006-94b3-4c10-b23b-877adb934855 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:19.672474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632eb94c-fef1-4b5d-bc2f-8cd7b779dae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:19.673865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb94c-fef1-4b5d-bc2f-8cd7b779dae3 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:19.674494 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb94c-fef1-4b5d-bc2f-8cd7b779dae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:19.675086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb94c-fef1-4b5d-bc2f-8cd7b779dae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:19.688227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632eb94c-fef1-4b5d-bc2f-8cd7b779dae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:19.689287 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632eb94c-fef1-4b5d-bc2f-8cd7b779dae3 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:19.701245 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1318/2616] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:19.824735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fd011-1cd6-43cb-81ca-7500f0a6a2a0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:19.834267 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fd011-1cd6-43cb-81ca-7500f0a6a2a0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:19.837870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8bb85-9058-44d7-8d7b-156ede62ff56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:19.838860 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8bb85-9058-44d7-8d7b-156ede62ff56 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:19.839145 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8bb85-9058-44d7-8d7b-156ede62ff56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:19.839416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8bb85-9058-44d7-8d7b-156ede62ff56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:19.841211 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3ae8bb85-9058-44d7-8d7b-156ede62ff56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:19.878737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632eb94c-fef1-4b5d-bc2f-8cd7b779dae3 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:19.880157 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-632eb94c-fef1-4b5d-bc2f-8cd7b779dae3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:19.907606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8bb85-9058-44d7-8d7b-156ede62ff56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:19.909619 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8bb85-9058-44d7-8d7b-156ede62ff56 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:19.919598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1299/2617] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:19.954252 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632eb94c-fef1-4b5d-bc2f-8cd7b779dae3 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:19.958758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:19.959611 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:19.959885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:19.960153 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] PATH_INFO: `/v3/projects/07ec5c0b2e824720b1e97823eadf87e6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:19.961400 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ec5c0b2e824720b1e97823eadf87e6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:19.963273 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:20.065795 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ec5c0b2e824720b1e97823eadf87e6', 'request_id': 'req-f976e1b7-87ff-4520-9426-53247ad558ba'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.123383 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ec5c0b2e824720b1e97823eadf87e6', 'request_id': 'req-f976e1b7-87ff-4520-9426-53247ad558ba'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.131143 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ec5c0b2e824720b1e97823eadf87e6', 'request_id': 'req-f976e1b7-87ff-4520-9426-53247ad558ba'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.151673 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] The token cache is being invalidate because project 07ec5c0b2e824720b1e97823eadf87e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:20.155538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.155538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.156025 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1319/2618] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:19 2022] DELETE /identity/v3/projects/07ec5c0b2e824720b1e97823eadf87e6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:20.161977 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8bb85-9058-44d7-8d7b-156ede62ff56 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:20.177889 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8bb85-9058-44d7-8d7b-156ede62ff56 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:20.262373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19270131-e235-4eea-a718-0ac4ca9680ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:20.262373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19270131-e235-4eea-a718-0ac4ca9680ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:20.262373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19270131-e235-4eea-a718-0ac4ca9680ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:20.262373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19270131-e235-4eea-a718-0ac4ca9680ad admin admin] PATH_INFO: `/v3/users/bdfcffdd0cfe4b7a9450b5376dd0e44d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:20.265312 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19270131-e235-4eea-a718-0ac4ca9680ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdfcffdd0cfe4b7a9450b5376dd0e44d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:20.268490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19270131-e235-4eea-a718-0ac4ca9680ad admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:20.382559 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:20.383880 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:20.396935 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976e1b7-87ff-4520-9426-53247ad558ba admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:20.401474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a6a33-884a-4a25-8837-b42cabb9c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:20.402329 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a6a33-884a-4a25-8837-b42cabb9c2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:20.402605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a6a33-884a-4a25-8837-b42cabb9c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:20.402874 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a6a33-884a-4a25-8837-b42cabb9c2cc admin admin] PATH_INFO: `/v3/users/9de9194476a3453c89927c9bd88cf9b8` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:20.404039 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a6a33-884a-4a25-8837-b42cabb9c2cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de9194476a3453c89927c9bd88cf9b8)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:20.406136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a6a33-884a-4a25-8837-b42cabb9c2cc admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:20.457030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-19270131-e235-4eea-a718-0ac4ca9680ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdfcffdd0cfe4b7a9450b5376dd0e44d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.457712 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-19270131-e235-4eea-a718-0ac4ca9680ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdfcffdd0cfe4b7a9450b5376dd0e44d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.458394 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-19270131-e235-4eea-a718-0ac4ca9680ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdfcffdd0cfe4b7a9450b5376dd0e44d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.545525 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-19270131-e235-4eea-a718-0ac4ca9680ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdfcffdd0cfe4b7a9450b5376dd0e44d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.557666 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-19270131-e235-4eea-a718-0ac4ca9680ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdfcffdd0cfe4b7a9450b5376dd0e44d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.571477 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1300/2619] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:20 2022] DELETE /identity/v3/users/bdfcffdd0cfe4b7a9450b5376dd0e44d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:20.640596 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-fa8a6a33-884a-4a25-8837-b42cabb9c2cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de9194476a3453c89927c9bd88cf9b8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.641303 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-fa8a6a33-884a-4a25-8837-b42cabb9c2cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de9194476a3453c89927c9bd88cf9b8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.644111 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-fa8a6a33-884a-4a25-8837-b42cabb9c2cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de9194476a3453c89927c9bd88cf9b8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.654624 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-fa8a6a33-884a-4a25-8837-b42cabb9c2cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de9194476a3453c89927c9bd88cf9b8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.661769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-fa8a6a33-884a-4a25-8837-b42cabb9c2cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de9194476a3453c89927c9bd88cf9b8'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:20.745648 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1320/2620] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:20 2022] DELETE /identity/v3/users/9de9194476a3453c89927c9bd88cf9b8 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:20.750183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701e2fb-89b5-40a7-bed5-cbf109ec6c93 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:20.750471 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701e2fb-89b5-40a7-bed5-cbf109ec6c93 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:20.751332 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701e2fb-89b5-40a7-bed5-cbf109ec6c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:20.773199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c701e2fb-89b5-40a7-bed5-cbf109ec6c93 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:20.773199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c701e2fb-89b5-40a7-bed5-cbf109ec6c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:20.832431 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1301/2621] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:20.842065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a6a33-884a-4a25-8837-b42cabb9c2cc admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:20.843544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fa8a6a33-884a-4a25-8837-b42cabb9c2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:20.901896 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a6a33-884a-4a25-8837-b42cabb9c2cc admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:20.905489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05aa29-552b-4c22-8f43-da93dbf4200f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:20.906166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05aa29-552b-4c22-8f43-da93dbf4200f service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:20.906450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05aa29-552b-4c22-8f43-da93dbf4200f service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:20.906734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05aa29-552b-4c22-8f43-da93dbf4200f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:20.916101 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05aa29-552b-4c22-8f43-da93dbf4200f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:20.917829 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05aa29-552b-4c22-8f43-da93dbf4200f service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:20.928118 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1321/2622] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:20.970128 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701e2fb-89b5-40a7-bed5-cbf109ec6c93 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:20.971793 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c701e2fb-89b5-40a7-bed5-cbf109ec6c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:20.999022 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701e2fb-89b5-40a7-bed5-cbf109ec6c93 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:21.005303 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:21.006280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:21.006627 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:21.006985 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] PATH_INFO: `/v3/projects/6058aeda2d854a52839886f04e4adaab` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:21.008260 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6058aeda2d854a52839886f04e4adaab)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:21.010329 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:21.142680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6058aeda2d854a52839886f04e4adaab', 'request_id': 'req-b97676d0-15ef-404f-98b6-96390141fee5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.149081 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6058aeda2d854a52839886f04e4adaab', 'request_id': 'req-b97676d0-15ef-404f-98b6-96390141fee5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.156310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6058aeda2d854a52839886f04e4adaab', 'request_id': 'req-b97676d0-15ef-404f-98b6-96390141fee5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.236561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] The token cache is being invalidate because project 6058aeda2d854a52839886f04e4adaab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:21.237608 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.238252 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.239916 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1302/2623] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:20 2022] DELETE /identity/v3/projects/6058aeda2d854a52839886f04e4adaab => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:21.244760 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d4515-a414-4480-ba28-43adf535dffd None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:21.246618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d4515-a414-4480-ba28-43adf535dffd None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:21.246618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d4515-a414-4480-ba28-43adf535dffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:21.263802 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-882d4515-a414-4480-ba28-43adf535dffd None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:21.265039 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-882d4515-a414-4480-ba28-43adf535dffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:21.323560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1322/2624] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:21.328661 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:21.328661 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:21.331185 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6aca3-08bf-48f0-b73e-d5e86ebc14db None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:21.331472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6aca3-08bf-48f0-b73e-d5e86ebc14db None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:21.331749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6aca3-08bf-48f0-b73e-d5e86ebc14db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:21.342440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97676d0-15ef-404f-98b6-96390141fee5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:21.349133 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:21.350037 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-43c6aca3-08bf-48f0-b73e-d5e86ebc14db None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:21.350476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:21.350831 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:21.351257 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-43c6aca3-08bf-48f0-b73e-d5e86ebc14db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:21.351663 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] PATH_INFO: `/v3/projects/7108e651ddff4a29bdcc0fd9173f8e29` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:21.353221 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7108e651ddff4a29bdcc0fd9173f8e29)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:21.355409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:21.361371 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1323/2625] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:21.365377 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6aca3-08bf-48f0-b73e-d5e86ebc14db None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:21.374376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6aca3-08bf-48f0-b73e-d5e86ebc14db None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:21.379051 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5d463-8885-4b89-8ef8-39eee9ba226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:21.379701 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5d463-8885-4b89-8ef8-39eee9ba226b admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:21.379985 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5d463-8885-4b89-8ef8-39eee9ba226b admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:21.380262 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5d463-8885-4b89-8ef8-39eee9ba226b admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:21.380984 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5d463-8885-4b89-8ef8-39eee9ba226b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:20:21.381318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5d463-8885-4b89-8ef8-39eee9ba226b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:21.382932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5d463-8885-4b89-8ef8-39eee9ba226b admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:21.394389 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1324/2626] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:20:21.398820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5d463-8885-4b89-8ef8-39eee9ba226b admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:21.410562 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5d463-8885-4b89-8ef8-39eee9ba226b admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:21.413834 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece863f-4f31-43dd-af69-9acf538f1f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:21.414463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece863f-4f31-43dd-af69-9acf538f1f33 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:21.414740 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece863f-4f31-43dd-af69-9acf538f1f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:21.415010 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece863f-4f31-43dd-af69-9acf538f1f33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:21.415736 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece863f-4f31-43dd-af69-9acf538f1f33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:21.417949 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece863f-4f31-43dd-af69-9acf538f1f33 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:21.471154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7108e651ddff4a29bdcc0fd9173f8e29', 'request_id': 'req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.477196 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7108e651ddff4a29bdcc0fd9173f8e29', 'request_id': 'req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.482415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7108e651ddff4a29bdcc0fd9173f8e29', 'request_id': 'req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.524494 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1325/2627] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:21 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:21.528415 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece863f-4f31-43dd-af69-9acf538f1f33 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:21.554344 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] The token cache is being invalidate because project 7108e651ddff4a29bdcc0fd9173f8e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:21.554486 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.555069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.556641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1303/2628] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:21 2022] DELETE /identity/v3/projects/7108e651ddff4a29bdcc0fd9173f8e29 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:21.560461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:21.561869 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:21.594605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece863f-4f31-43dd-af69-9acf538f1f33 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:21.600257 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc0ca6-89cd-4b8d-a8b2-189648e11e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:21.601300 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc0ca6-89cd-4b8d-a8b2-189648e11e0f admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:21.601602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc0ca6-89cd-4b8d-a8b2-189648e11e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:21.602073 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc0ca6-89cd-4b8d-a8b2-189648e11e0f admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:21.602978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc0ca6-89cd-4b8d-a8b2-189648e11e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:21.605820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc0ca6-89cd-4b8d-a8b2-189648e11e0f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:21.627344 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1520b1d-f1eb-4143-9114-6aa4d27c11f4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:21.631999 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51456e3f-40ef-41e7-ad69-ad1317764106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:21.632862 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51456e3f-40ef-41e7-ad69-ad1317764106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:21.634478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51456e3f-40ef-41e7-ad69-ad1317764106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:21.634478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51456e3f-40ef-41e7-ad69-ad1317764106 admin admin] PATH_INFO: `/v3/users/8d605b5770b9425caacd79994229a9d5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:21.634777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51456e3f-40ef-41e7-ad69-ad1317764106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d605b5770b9425caacd79994229a9d5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:21.636767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51456e3f-40ef-41e7-ad69-ad1317764106 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:21.758371 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1326/2629] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:21 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:21.759198 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc0ca6-89cd-4b8d-a8b2-189648e11e0f admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:21.760736 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b9dc0ca6-89cd-4b8d-a8b2-189648e11e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:21.815066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc0ca6-89cd-4b8d-a8b2-189648e11e0f admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:21.818737 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a973a4-71fe-4ea0-9d94-34adb3518c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:21.819372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a973a4-71fe-4ea0-9d94-34adb3518c57 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:21.819660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a973a4-71fe-4ea0-9d94-34adb3518c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:21.819929 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a973a4-71fe-4ea0-9d94-34adb3518c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:21.821684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-56a973a4-71fe-4ea0-9d94-34adb3518c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:21.833451 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a973a4-71fe-4ea0-9d94-34adb3518c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:21.834870 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a973a4-71fe-4ea0-9d94-34adb3518c57 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:21.844892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1327/2630] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:21.845707 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a973a4-71fe-4ea0-9d94-34adb3518c57 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:21.846997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-56a973a4-71fe-4ea0-9d94-34adb3518c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:21.858746 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a973a4-71fe-4ea0-9d94-34adb3518c57 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:21.864826 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe1071-f778-484b-b269-dec534c82f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:21.865586 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe1071-f778-484b-b269-dec534c82f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:21.865867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe1071-f778-484b-b269-dec534c82f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:21.866145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe1071-f778-484b-b269-dec534c82f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:21.866892 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe1071-f778-484b-b269-dec534c82f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:21.868460 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe1071-f778-484b-b269-dec534c82f86 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:21.873379 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-51456e3f-40ef-41e7-ad69-ad1317764106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d605b5770b9425caacd79994229a9d5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.874205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-51456e3f-40ef-41e7-ad69-ad1317764106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d605b5770b9425caacd79994229a9d5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.875020 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-51456e3f-40ef-41e7-ad69-ad1317764106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d605b5770b9425caacd79994229a9d5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.879081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1328/2631] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:21.882653 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe1071-f778-484b-b269-dec534c82f86 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:21.884361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9dbe1071-f778-484b-b269-dec534c82f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:21.897986 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe1071-f778-484b-b269-dec534c82f86 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:21.903476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3fae9-8cfd-4ebd-a279-3758833817f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:21.904148 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3fae9-8cfd-4ebd-a279-3758833817f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:21.904431 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3fae9-8cfd-4ebd-a279-3758833817f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:21.904706 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3fae9-8cfd-4ebd-a279-3758833817f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:21.905462 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3fae9-8cfd-4ebd-a279-3758833817f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:21.907581 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3fae9-8cfd-4ebd-a279-3758833817f0 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:21.918033 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1329/2632] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:21.921970 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3fae9-8cfd-4ebd-a279-3758833817f0 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:21.933757 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3fae9-8cfd-4ebd-a279-3758833817f0 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:21.937182 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7a3c6-33fd-431a-bc3f-9ede37d5eefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:21.938056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7a3c6-33fd-431a-bc3f-9ede37d5eefc admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:21.938385 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7a3c6-33fd-431a-bc3f-9ede37d5eefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:21.938662 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7a3c6-33fd-431a-bc3f-9ede37d5eefc admin admin] PATH_INFO: `/v3/projects/fd714b9666e94d0d974f9a118d553438/users/fda92facaded4938b318df861a23ee8c/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:21.954590 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7a3c6-33fd-431a-bc3f-9ede37d5eefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd714b9666e94d0d974f9a118d553438, user_id=fda92facaded4938b318df861a23ee8c, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:21.957286 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7a3c6-33fd-431a-bc3f-9ede37d5eefc admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:21.957791 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-51456e3f-40ef-41e7-ad69-ad1317764106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d605b5770b9425caacd79994229a9d5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.972569 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-51456e3f-40ef-41e7-ad69-ad1317764106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d605b5770b9425caacd79994229a9d5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:21.984529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1304/2633] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:21 2022] DELETE /identity/v3/users/8d605b5770b9425caacd79994229a9d5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:22.037948 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1330/2634] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:21 2022] PUT /identity/v3/projects/fd714b9666e94d0d974f9a118d553438/users/fda92facaded4938b318df861a23ee8c/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:22.049749 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18927bf4-8d8b-4273-b950-c8bf5129d30d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:22.050404 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18927bf4-8d8b-4273-b950-c8bf5129d30d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:22.051224 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18927bf4-8d8b-4273-b950-c8bf5129d30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:22.080112 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-18927bf4-8d8b-4273-b950-c8bf5129d30d None None] MFA Rules not processed for user `fda92facaded4938b318df861a23ee8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:22.081377 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-18927bf4-8d8b-4273-b950-c8bf5129d30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:22.143627 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1305/2635] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:22.147826 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7a3c6-33fd-431a-bc3f-9ede37d5eefc admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:22.214723 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7a3c6-33fd-431a-bc3f-9ede37d5eefc admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:22.220670 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000aaff-07c5-4b26-a6ec-d249c2504ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:22.221404 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000aaff-07c5-4b26-a6ec-d249c2504ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:22.221687 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000aaff-07c5-4b26-a6ec-d249c2504ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:22.221961 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000aaff-07c5-4b26-a6ec-d249c2504ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:22.222657 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000aaff-07c5-4b26-a6ec-d249c2504ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:22.224568 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000aaff-07c5-4b26-a6ec-d249c2504ea2 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:22.342056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1331/2636] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:22 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:22.346980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18927bf4-8d8b-4273-b950-c8bf5129d30d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:22.357724 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18927bf4-8d8b-4273-b950-c8bf5129d30d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:22.399424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000aaff-07c5-4b26-a6ec-d249c2504ea2 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:22.401277 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9000aaff-07c5-4b26-a6ec-d249c2504ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:22.430824 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d31d6e-5c7e-48ed-8e75-8c0b91165969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:22.431455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d31d6e-5c7e-48ed-8e75-8c0b91165969 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:22.431807 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d31d6e-5c7e-48ed-8e75-8c0b91165969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:22.432147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d31d6e-5c7e-48ed-8e75-8c0b91165969 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:22.433025 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d31d6e-5c7e-48ed-8e75-8c0b91165969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:22.435204 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d31d6e-5c7e-48ed-8e75-8c0b91165969 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:22.477608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000aaff-07c5-4b26-a6ec-d249c2504ea2 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:22.482424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:22.483290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:22.483568 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:22.483839 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e admin admin] PATH_INFO: `/v3/projects/a650e5a780cc4fd8804183b3be511099` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:22.485220 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a650e5a780cc4fd8804183b3be511099)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:22.487116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:22.549585 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1306/2637] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:22 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:22.553292 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d31d6e-5c7e-48ed-8e75-8c0b91165969 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:22.563611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d31d6e-5c7e-48ed-8e75-8c0b91165969 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:22.569959 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468acf4-be19-4f3f-82c7-703c638fb80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:22.570679 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468acf4-be19-4f3f-82c7-703c638fb80a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:22.570966 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468acf4-be19-4f3f-82c7-703c638fb80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:22.571374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468acf4-be19-4f3f-82c7-703c638fb80a admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:22.571986 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468acf4-be19-4f3f-82c7-703c638fb80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:22.573695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468acf4-be19-4f3f-82c7-703c638fb80a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:22.581166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a650e5a780cc4fd8804183b3be511099', 'request_id': 'req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:22.584117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1307/2638] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:22.588224 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468acf4-be19-4f3f-82c7-703c638fb80a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:22.598449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468acf4-be19-4f3f-82c7-703c638fb80a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:22.658072 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0208bc3-f066-47ce-8984-7fe7580f78f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:22.659024 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0208bc3-f066-47ce-8984-7fe7580f78f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:22.659340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0208bc3-f066-47ce-8984-7fe7580f78f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:22.659565 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0208bc3-f066-47ce-8984-7fe7580f78f1 admin admin] PATH_INFO: `/v3/projects/9dd0b0f556f043fbb931f6cc4cb6ce9d/users/425b41191aa541fe91d4f25a6f35a4dd/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:22.674230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0208bc3-f066-47ce-8984-7fe7580f78f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd0b0f556f043fbb931f6cc4cb6ce9d, user_id=425b41191aa541fe91d4f25a6f35a4dd, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:22.676882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a650e5a780cc4fd8804183b3be511099', 'request_id': 'req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:22.681690 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0208bc3-f066-47ce-8984-7fe7580f78f1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:22.684220 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a650e5a780cc4fd8804183b3be511099', 'request_id': 'req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:22.695397 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e admin admin] The token cache is being invalidate because project a650e5a780cc4fd8804183b3be511099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:22.695686 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:22.696354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-d37ba1b7-0116-4c08-9467-2af59ed7ea4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:22.697954 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1332/2639] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:22 2022] DELETE /identity/v3/projects/a650e5a780cc4fd8804183b3be511099 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:22.702518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bd8bf-6d33-49ed-b0a6-65175234cec9 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:22.702801 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bd8bf-6d33-49ed-b0a6-65175234cec9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:22.705011 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bd8bf-6d33-49ed-b0a6-65175234cec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:22.721903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-812bd8bf-6d33-49ed-b0a6-65175234cec9 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:22.723064 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-812bd8bf-6d33-49ed-b0a6-65175234cec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:22.737629 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1333/2640] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:22.744492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a86a0-bd98-4f3b-87f7-8ac7ba416eca None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:22.744780 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a86a0-bd98-4f3b-87f7-8ac7ba416eca None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:22.745113 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a86a0-bd98-4f3b-87f7-8ac7ba416eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:22.763672 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0c2a86a0-bd98-4f3b-87f7-8ac7ba416eca None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:22.764893 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0c2a86a0-bd98-4f3b-87f7-8ac7ba416eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:22.771080 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1308/2641] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:22 2022] PUT /identity/v3/projects/9dd0b0f556f043fbb931f6cc4cb6ce9d/users/425b41191aa541fe91d4f25a6f35a4dd/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:22.776039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0208bc3-f066-47ce-8984-7fe7580f78f1 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:22.777799 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f0208bc3-f066-47ce-8984-7fe7580f78f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:22.825397 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1334/2642] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:22.830181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a86a0-bd98-4f3b-87f7-8ac7ba416eca None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:22.839715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a86a0-bd98-4f3b-87f7-8ac7ba416eca None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:22.842327 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0208bc3-f066-47ce-8984-7fe7580f78f1 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:22.844353 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5913ed7-7f6d-402c-b6dd-331a13a9046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:22.848007 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5913ed7-7f6d-402c-b6dd-331a13a9046f admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:22.848007 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5913ed7-7f6d-402c-b6dd-331a13a9046f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:22.848007 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5913ed7-7f6d-402c-b6dd-331a13a9046f admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:22.848007 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5913ed7-7f6d-402c-b6dd-331a13a9046f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:20:22.848007 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5913ed7-7f6d-402c-b6dd-331a13a9046f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:22.848407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a13cad-5182-4873-82f6-5d6f0e5c71ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:22.848407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a13cad-5182-4873-82f6-5d6f0e5c71ce admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:22.848407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a13cad-5182-4873-82f6-5d6f0e5c71ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:22.848407 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a13cad-5182-4873-82f6-5d6f0e5c71ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:22.849000 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5913ed7-7f6d-402c-b6dd-331a13a9046f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:22.849134 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a13cad-5182-4873-82f6-5d6f0e5c71ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:22.850721 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a13cad-5182-4873-82f6-5d6f0e5c71ce admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:22.861484 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1309/2643] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:22.863638 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1335/2644] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 11:20:22.865906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a13cad-5182-4873-82f6-5d6f0e5c71ce admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:22.867696 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5913ed7-7f6d-402c-b6dd-331a13a9046f admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:22.879819 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5913ed7-7f6d-402c-b6dd-331a13a9046f admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:22.880906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a13cad-5182-4873-82f6-5d6f0e5c71ce admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:22.885191 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadfeec-c26a-439d-aef7-3e963a481687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:22.886221 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadfeec-c26a-439d-aef7-3e963a481687 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:22.886779 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadfeec-c26a-439d-aef7-3e963a481687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:22.887163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadfeec-c26a-439d-aef7-3e963a481687 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:22.887675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501a173-e1dc-49dd-97b8-436965299326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:22.888081 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadfeec-c26a-439d-aef7-3e963a481687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:22.889094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501a173-e1dc-49dd-97b8-436965299326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:22.889094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501a173-e1dc-49dd-97b8-436965299326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:22.889094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501a173-e1dc-49dd-97b8-436965299326 admin admin] PATH_INFO: `/v3/projects/9dd0b0f556f043fbb931f6cc4cb6ce9d/users/425b41191aa541fe91d4f25a6f35a4dd/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:22.890611 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadfeec-c26a-439d-aef7-3e963a481687 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:22.892038 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501a173-e1dc-49dd-97b8-436965299326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd0b0f556f043fbb931f6cc4cb6ce9d, user_id=425b41191aa541fe91d4f25a6f35a4dd, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:22.895906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501a173-e1dc-49dd-97b8-436965299326 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:22.909704 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1310/2645] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:22 2022] PUT /identity/v3/projects/9dd0b0f556f043fbb931f6cc4cb6ce9d/users/425b41191aa541fe91d4f25a6f35a4dd/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:22.920230 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab1a3b-a0f5-461e-957a-9117230aee5b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:22.920480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab1a3b-a0f5-461e-957a-9117230aee5b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:22.920743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab1a3b-a0f5-461e-957a-9117230aee5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:22.949774 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-14ab1a3b-a0f5-461e-957a-9117230aee5b None None] MFA Rules not processed for user `425b41191aa541fe91d4f25a6f35a4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:22.951344 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-14ab1a3b-a0f5-461e-957a-9117230aee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:22.983176 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1336/2646] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:22 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:22.990547 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadfeec-c26a-439d-aef7-3e963a481687 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:23.032650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1311/2647] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:23.043623 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab1a3b-a0f5-461e-957a-9117230aee5b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:23.045410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-14ab1a3b-a0f5-461e-957a-9117230aee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:23.066572 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadfeec-c26a-439d-aef7-3e963a481687 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:23.072628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1bfa0-23d0-4c77-86f5-dc474e16f0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:23.073421 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1bfa0-23d0-4c77-86f5-dc474e16f0bf admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:23.073709 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1bfa0-23d0-4c77-86f5-dc474e16f0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:23.073990 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1bfa0-23d0-4c77-86f5-dc474e16f0bf admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:23.074697 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1bfa0-23d0-4c77-86f5-dc474e16f0bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:23.077202 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1bfa0-23d0-4c77-86f5-dc474e16f0bf admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:23.117951 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab1a3b-a0f5-461e-957a-9117230aee5b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:23.158333 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1337/2648] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:22 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:23.162650 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1bfa0-23d0-4c77-86f5-dc474e16f0bf admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:23.166226 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3428c-964d-44de-b524-2f8e7f96607c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:23.167226 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3428c-964d-44de-b524-2f8e7f96607c service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:23.167571 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3428c-964d-44de-b524-2f8e7f96607c service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:23.167913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3428c-964d-44de-b524-2f8e7f96607c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:23.174115 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1bfa0-23d0-4c77-86f5-dc474e16f0bf admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:23.179744 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3f767-2f5d-4a57-bace-57f5a59726e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:23.180579 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3f767-2f5d-4a57-bace-57f5a59726e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:23.180994 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3f767-2f5d-4a57-bace-57f5a59726e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:23.181420 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3f767-2f5d-4a57-bace-57f5a59726e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:23.182286 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3f767-2f5d-4a57-bace-57f5a59726e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:23.183988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3f767-2f5d-4a57-bace-57f5a59726e0 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:23.194819 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1338/2649] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:23.198684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3f767-2f5d-4a57-bace-57f5a59726e0 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:23.209965 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3f767-2f5d-4a57-bace-57f5a59726e0 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:23.214942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a823e-d6c7-4783-a97a-c4d11835285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:23.215702 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a823e-d6c7-4783-a97a-c4d11835285f admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:23.216053 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a823e-d6c7-4783-a97a-c4d11835285f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:23.216399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a823e-d6c7-4783-a97a-c4d11835285f admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:23.217220 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a823e-d6c7-4783-a97a-c4d11835285f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:23.219116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a823e-d6c7-4783-a97a-c4d11835285f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:23.230448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3428c-964d-44de-b524-2f8e7f96607c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:23.233760 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1339/2650] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:23.233891 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3428c-964d-44de-b524-2f8e7f96607c service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:23.235255 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a823e-d6c7-4783-a97a-c4d11835285f admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:23.243054 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1312/2651] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:23.245077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a823e-d6c7-4783-a97a-c4d11835285f admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:23.250346 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24ec8c-8eda-4d00-a49d-7c993fea7588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:23.251340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ec8c-8eda-4d00-a49d-7c993fea7588 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:23.251685 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ec8c-8eda-4d00-a49d-7c993fea7588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:23.252032 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ec8c-8eda-4d00-a49d-7c993fea7588 admin admin] PATH_INFO: `/v3/projects/e0c7911afdc44fc1b5ca7ebde8807f1c/users/10294300f2e1491aa9269a3791583227/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:23.271639 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24ec8c-8eda-4d00-a49d-7c993fea7588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c7911afdc44fc1b5ca7ebde8807f1c, user_id=10294300f2e1491aa9269a3791583227, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:23.274830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24ec8c-8eda-4d00-a49d-7c993fea7588 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:23.324201 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1340/2652] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:23 2022] PUT /identity/v3/projects/e0c7911afdc44fc1b5ca7ebde8807f1c/users/10294300f2e1491aa9269a3791583227/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:23.335711 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc182c1-bb4a-4cb3-b23c-3f3749adf2b0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:23.336132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc182c1-bb4a-4cb3-b23c-3f3749adf2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:23.336538 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc182c1-bb4a-4cb3-b23c-3f3749adf2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:23.348103 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24ec8c-8eda-4d00-a49d-7c993fea7588 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:23.369506 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7cc182c1-bb4a-4cb3-b23c-3f3749adf2b0 None None] MFA Rules not processed for user `10294300f2e1491aa9269a3791583227`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:23.375472 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7cc182c1-bb4a-4cb3-b23c-3f3749adf2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:23.411265 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24ec8c-8eda-4d00-a49d-7c993fea7588 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:23.415971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11232b10-25bb-4c50-bebe-4fe7a375eb30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:23.416397 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11232b10-25bb-4c50-bebe-4fe7a375eb30 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:23.416922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11232b10-25bb-4c50-bebe-4fe7a375eb30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:23.417238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11232b10-25bb-4c50-bebe-4fe7a375eb30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:23.419164 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-11232b10-25bb-4c50-bebe-4fe7a375eb30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:23.445010 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1313/2653] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:23.458890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc182c1-bb4a-4cb3-b23c-3f3749adf2b0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:23.461775 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7cc182c1-bb4a-4cb3-b23c-3f3749adf2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:23.501421 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11232b10-25bb-4c50-bebe-4fe7a375eb30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:23.502924 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11232b10-25bb-4c50-bebe-4fe7a375eb30 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:23.517987 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1341/2654] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:23.534744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc182c1-bb4a-4cb3-b23c-3f3749adf2b0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:23.540042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b290be-487b-432e-aff2-4d23c9659979 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42cd381cf5c745de9dac8f77a8cea554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:23.540691 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b290be-487b-432e-aff2-4d23c9659979 service glance] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:23.541136 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b290be-487b-432e-aff2-4d23c9659979 service glance] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:23.541420 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b290be-487b-432e-aff2-4d23c9659979 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:23.554939 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b290be-487b-432e-aff2-4d23c9659979 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:23.557785 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b290be-487b-432e-aff2-4d23c9659979 service glance] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:23.572030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1314/2655] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:25.943580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11232b10-25bb-4c50-bebe-4fe7a375eb30 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:25.945591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-11232b10-25bb-4c50-bebe-4fe7a375eb30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:26.017330 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11232b10-25bb-4c50-bebe-4fe7a375eb30 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:26.022104 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcfafa-a5b9-4946-a9c8-b230702efabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:26.023270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcfafa-a5b9-4946-a9c8-b230702efabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:26.023270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcfafa-a5b9-4946-a9c8-b230702efabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:26.023538 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcfafa-a5b9-4946-a9c8-b230702efabc admin admin] PATH_INFO: `/v3/users/145dbd68096f410d81b61b4c9f70ca3e` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:26.024751 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debcfafa-a5b9-4946-a9c8-b230702efabc admin admin] RBAC: Authorizing `identity:delete_user(user_id=145dbd68096f410d81b61b4c9f70ca3e)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:26.026701 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debcfafa-a5b9-4946-a9c8-b230702efabc admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:26.188517 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-debcfafa-a5b9-4946-a9c8-b230702efabc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145dbd68096f410d81b61b4c9f70ca3e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.189150 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-debcfafa-a5b9-4946-a9c8-b230702efabc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145dbd68096f410d81b61b4c9f70ca3e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.189797 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-debcfafa-a5b9-4946-a9c8-b230702efabc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145dbd68096f410d81b61b4c9f70ca3e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.202296 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-debcfafa-a5b9-4946-a9c8-b230702efabc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145dbd68096f410d81b61b4c9f70ca3e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.209547 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-debcfafa-a5b9-4946-a9c8-b230702efabc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145dbd68096f410d81b61b4c9f70ca3e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.277675 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1342/2656] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:25 2022] DELETE /identity/v3/users/145dbd68096f410d81b61b4c9f70ca3e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:26.519757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b290be-487b-432e-aff2-4d23c9659979 service glance] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:26.532248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b290be-487b-432e-aff2-4d23c9659979 service glance] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:26.596727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374aa38e-2ee3-4a77-ab00-cd867a4056dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:26.597974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aa38e-2ee3-4a77-ab00-cd867a4056dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:26.601284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aa38e-2ee3-4a77-ab00-cd867a4056dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:26.601284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aa38e-2ee3-4a77-ab00-cd867a4056dc admin admin] PATH_INFO: `/v3/projects/aeca9938df6a4f308208d5b9370aff6d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:26.601284 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374aa38e-2ee3-4a77-ab00-cd867a4056dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeca9938df6a4f308208d5b9370aff6d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:26.603193 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374aa38e-2ee3-4a77-ab00-cd867a4056dc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:26.620938 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcfafa-a5b9-4946-a9c8-b230702efabc admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:26.622426 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-debcfafa-a5b9-4946-a9c8-b230702efabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:26.636866 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcfafa-a5b9-4946-a9c8-b230702efabc admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:26.643728 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8729d-f6fa-4f58-b359-5fe7d6f7ce41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:26.644619 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8729d-f6fa-4f58-b359-5fe7d6f7ce41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:26.645266 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8729d-f6fa-4f58-b359-5fe7d6f7ce41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:26.645980 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8729d-f6fa-4f58-b359-5fe7d6f7ce41 admin admin] PATH_INFO: `/v3/users/fda92facaded4938b318df861a23ee8c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:26.647216 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8729d-f6fa-4f58-b359-5fe7d6f7ce41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda92facaded4938b318df861a23ee8c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:26.651332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8729d-f6fa-4f58-b359-5fe7d6f7ce41 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:26.729329 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-374aa38e-2ee3-4a77-ab00-cd867a4056dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeca9938df6a4f308208d5b9370aff6d', 'request_id': 'req-374aa38e-2ee3-4a77-ab00-cd867a4056dc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.736193 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-374aa38e-2ee3-4a77-ab00-cd867a4056dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeca9938df6a4f308208d5b9370aff6d', 'request_id': 'req-374aa38e-2ee3-4a77-ab00-cd867a4056dc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.742961 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-374aa38e-2ee3-4a77-ab00-cd867a4056dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeca9938df6a4f308208d5b9370aff6d', 'request_id': 'req-374aa38e-2ee3-4a77-ab00-cd867a4056dc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.828208 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-374aa38e-2ee3-4a77-ab00-cd867a4056dc admin admin] The token cache is being invalidate because project aeca9938df6a4f308208d5b9370aff6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:26.828503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-374aa38e-2ee3-4a77-ab00-cd867a4056dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.829214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-374aa38e-2ee3-4a77-ab00-cd867a4056dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.830917 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1315/2657] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:26 2022] DELETE /identity/v3/projects/aeca9938df6a4f308208d5b9370aff6d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:26.836199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cad1e-a31f-40c0-a39e-673b76fd1e44 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:26.836615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cad1e-a31f-40c0-a39e-673b76fd1e44 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:26.836950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cad1e-a31f-40c0-a39e-673b76fd1e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:26.846302 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c6f8729d-f6fa-4f58-b359-5fe7d6f7ce41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda92facaded4938b318df861a23ee8c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.847012 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c6f8729d-f6fa-4f58-b359-5fe7d6f7ce41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda92facaded4938b318df861a23ee8c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.847618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c6f8729d-f6fa-4f58-b359-5fe7d6f7ce41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda92facaded4938b318df861a23ee8c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.855624 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f22cad1e-a31f-40c0-a39e-673b76fd1e44 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:26.856934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f22cad1e-a31f-40c0-a39e-673b76fd1e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:26.864750 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c6f8729d-f6fa-4f58-b359-5fe7d6f7ce41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda92facaded4938b318df861a23ee8c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.871483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-c6f8729d-f6fa-4f58-b359-5fe7d6f7ce41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda92facaded4938b318df861a23ee8c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:26.924236 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1316/2658] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:26.932563 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d154ca-c3c8-4f9d-bcd6-ef290d3672b1 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:26.932855 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d154ca-c3c8-4f9d-bcd6-ef290d3672b1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:26.933165 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d154ca-c3c8-4f9d-bcd6-ef290d3672b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:26.951496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1343/2659] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:26 2022] DELETE /identity/v3/users/fda92facaded4938b318df861a23ee8c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:26.955935 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be572e3b-d078-4ef7-b44f-d1a2be9060d1 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:26.956489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be572e3b-d078-4ef7-b44f-d1a2be9060d1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:26.956775 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be572e3b-d078-4ef7-b44f-d1a2be9060d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:26.957211 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-37d154ca-c3c8-4f9d-bcd6-ef290d3672b1 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:26.958761 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-37d154ca-c3c8-4f9d-bcd6-ef290d3672b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:26.974748 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-be572e3b-d078-4ef7-b44f-d1a2be9060d1 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:26.975956 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-be572e3b-d078-4ef7-b44f-d1a2be9060d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:27.019602 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1317/2660] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:27.023803 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d154ca-c3c8-4f9d-bcd6-ef290d3672b1 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:27.033869 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d154ca-c3c8-4f9d-bcd6-ef290d3672b1 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:27.038484 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253090cb-a8a6-4d06-bbf2-84d964429744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:27.039144 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253090cb-a8a6-4d06-bbf2-84d964429744 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:27.039429 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253090cb-a8a6-4d06-bbf2-84d964429744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:27.039673 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1344/2661] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:27.041109 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253090cb-a8a6-4d06-bbf2-84d964429744 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:27.042172 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253090cb-a8a6-4d06-bbf2-84d964429744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:20:27.042490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253090cb-a8a6-4d06-bbf2-84d964429744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:27.044251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253090cb-a8a6-4d06-bbf2-84d964429744 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:27.049955 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be572e3b-d078-4ef7-b44f-d1a2be9060d1 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:27.051313 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-be572e3b-d078-4ef7-b44f-d1a2be9060d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:27.056685 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1318/2662] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 11:20:27.061136 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253090cb-a8a6-4d06-bbf2-84d964429744 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:27.071718 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253090cb-a8a6-4d06-bbf2-84d964429744 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:27.076264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0eea18-fd6f-49bd-a6ee-f268d3a8164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:27.076908 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eea18-fd6f-49bd-a6ee-f268d3a8164c admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:27.077225 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eea18-fd6f-49bd-a6ee-f268d3a8164c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:27.077503 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eea18-fd6f-49bd-a6ee-f268d3a8164c admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:27.078194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0eea18-fd6f-49bd-a6ee-f268d3a8164c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:27.080151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0eea18-fd6f-49bd-a6ee-f268d3a8164c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:27.108359 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be572e3b-d078-4ef7-b44f-d1a2be9060d1 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:27.112706 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ef70-e04b-46b6-a906-5322471bde1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:27.113392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ef70-e04b-46b6-a906-5322471bde1a service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:27.113679 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ef70-e04b-46b6-a906-5322471bde1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:27.113957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ef70-e04b-46b6-a906-5322471bde1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:27.123851 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3ef70-e04b-46b6-a906-5322471bde1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:27.125366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3ef70-e04b-46b6-a906-5322471bde1a service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:27.135066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1345/2663] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:27.168179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1319/2664] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:27 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:27.169429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ef70-e04b-46b6-a906-5322471bde1a service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:27.180612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ef70-e04b-46b6-a906-5322471bde1a service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:27.237938 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d9a24-7332-418c-b08e-1d5e1e168c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:27.238648 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d9a24-7332-418c-b08e-1d5e1e168c28 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:27.238946 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d9a24-7332-418c-b08e-1d5e1e168c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:27.239324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d9a24-7332-418c-b08e-1d5e1e168c28 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:27.240072 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d9a24-7332-418c-b08e-1d5e1e168c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:27.242132 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d9a24-7332-418c-b08e-1d5e1e168c28 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:27.331888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1346/2665] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:27 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:27.334300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0eea18-fd6f-49bd-a6ee-f268d3a8164c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:27.347012 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0eea18-fd6f-49bd-a6ee-f268d3a8164c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:27.352292 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381119b-54b3-4c71-8e80-32f59b8e7602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:27.359779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381119b-54b3-4c71-8e80-32f59b8e7602 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:27.359779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381119b-54b3-4c71-8e80-32f59b8e7602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:27.359779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381119b-54b3-4c71-8e80-32f59b8e7602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:27.359779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381119b-54b3-4c71-8e80-32f59b8e7602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:27.359779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381119b-54b3-4c71-8e80-32f59b8e7602 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:27.366882 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1320/2666] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:27.370786 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d9a24-7332-418c-b08e-1d5e1e168c28 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:27.381214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d9a24-7332-418c-b08e-1d5e1e168c28 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:27.386617 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b685cb1-c2a6-4a35-ae7c-5abcfb93423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:27.387238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b685cb1-c2a6-4a35-ae7c-5abcfb93423b admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:27.388448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b685cb1-c2a6-4a35-ae7c-5abcfb93423b admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:27.388448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b685cb1-c2a6-4a35-ae7c-5abcfb93423b admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:27.388769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b685cb1-c2a6-4a35-ae7c-5abcfb93423b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:27.390318 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b685cb1-c2a6-4a35-ae7c-5abcfb93423b admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:27.401242 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1347/2667] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:27.404943 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381119b-54b3-4c71-8e80-32f59b8e7602 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:27.415692 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381119b-54b3-4c71-8e80-32f59b8e7602 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:27.420958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb7505-de26-43b3-8272-257c97a0ab0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:27.423487 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb7505-de26-43b3-8272-257c97a0ab0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:27.423856 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb7505-de26-43b3-8272-257c97a0ab0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:27.424217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb7505-de26-43b3-8272-257c97a0ab0a admin admin] PATH_INFO: `/v3/projects/7f832258bcdb4665893bfc8c45b05276/users/6ccd8953be4f438aa47bb2233e2192a6/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:27.445966 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb7505-de26-43b3-8272-257c97a0ab0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f832258bcdb4665893bfc8c45b05276, user_id=6ccd8953be4f438aa47bb2233e2192a6, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:27.448760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb7505-de26-43b3-8272-257c97a0ab0a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:27.529007 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1321/2668] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:27 2022] PUT /identity/v3/projects/7f832258bcdb4665893bfc8c45b05276/users/6ccd8953be4f438aa47bb2233e2192a6/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:27.539842 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5e3f-8d95-44b6-ae66-0a762ad37c0c None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:27.540161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5e3f-8d95-44b6-ae66-0a762ad37c0c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:27.540470 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5e3f-8d95-44b6-ae66-0a762ad37c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:27.557581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb7505-de26-43b3-8272-257c97a0ab0a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:27.559345 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-dbcb7505-de26-43b3-8272-257c97a0ab0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:27.573575 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-ab9a5e3f-8d95-44b6-ae66-0a762ad37c0c None None] MFA Rules not processed for user `6ccd8953be4f438aa47bb2233e2192a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:27.574976 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ab9a5e3f-8d95-44b6-ae66-0a762ad37c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:27.633868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb7505-de26-43b3-8272-257c97a0ab0a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:27.640928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:27.640928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:27.640928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:27.640928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] PATH_INFO: `/v3/projects/fd714b9666e94d0d974f9a118d553438` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:27.642175 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd714b9666e94d0d974f9a118d553438)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:27.644470 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:27.662703 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1348/2669] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:27.674905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a5e3f-8d95-44b6-ae66-0a762ad37c0c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:27.676445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ab9a5e3f-8d95-44b6-ae66-0a762ad37c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:27.748288 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a5e3f-8d95-44b6-ae66-0a762ad37c0c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:27.754532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab2130-bf11-424a-bced-68fb9833691a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:27.755224 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab2130-bf11-424a-bced-68fb9833691a service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:27.755514 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab2130-bf11-424a-bced-68fb9833691a service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:27.755789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab2130-bf11-424a-bced-68fb9833691a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:27.763067 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd714b9666e94d0d974f9a118d553438', 'request_id': 'req-80b5c808-835f-495f-b2c3-1d4506a35a9f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:27.764204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab2130-bf11-424a-bced-68fb9833691a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:27.765840 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab2130-bf11-424a-bced-68fb9833691a service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:27.769625 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd714b9666e94d0d974f9a118d553438', 'request_id': 'req-80b5c808-835f-495f-b2c3-1d4506a35a9f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:27.775214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd714b9666e94d0d974f9a118d553438', 'request_id': 'req-80b5c808-835f-495f-b2c3-1d4506a35a9f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:27.775603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1349/2670] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:27.854249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] The token cache is being invalidate because project fd714b9666e94d0d974f9a118d553438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:27.854545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:27.855185 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:27.856733 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1322/2671] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:27 2022] DELETE /identity/v3/projects/fd714b9666e94d0d974f9a118d553438 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:27.861238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab2130-bf11-424a-bced-68fb9833691a service nova] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:27.871923 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab2130-bf11-424a-bced-68fb9833691a service nova] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:27.932154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea08a9d-9239-4b31-a3fa-863ee5215e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:27.933041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea08a9d-9239-4b31-a3fa-863ee5215e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:27.933356 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea08a9d-9239-4b31-a3fa-863ee5215e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:27.933633 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea08a9d-9239-4b31-a3fa-863ee5215e2b admin admin] PATH_INFO: `/v3/users/425b41191aa541fe91d4f25a6f35a4dd` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:27.934894 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea08a9d-9239-4b31-a3fa-863ee5215e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=425b41191aa541fe91d4f25a6f35a4dd)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:27.936811 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea08a9d-9239-4b31-a3fa-863ee5215e2b admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:27.957519 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:27.959115 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:27.972870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5c808-835f-495f-b2c3-1d4506a35a9f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:27.977924 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896888d-06c0-4e0b-bffd-46da1731c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:27.980573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896888d-06c0-4e0b-bffd-46da1731c178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:27.980573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896888d-06c0-4e0b-bffd-46da1731c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:27.980573 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896888d-06c0-4e0b-bffd-46da1731c178 admin admin] PATH_INFO: `/v3/users/6ccd8953be4f438aa47bb2233e2192a6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:27.980844 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896888d-06c0-4e0b-bffd-46da1731c178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ccd8953be4f438aa47bb2233e2192a6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:27.982566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896888d-06c0-4e0b-bffd-46da1731c178 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:28.096718 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3ea08a9d-9239-4b31-a3fa-863ee5215e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425b41191aa541fe91d4f25a6f35a4dd'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.097344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3ea08a9d-9239-4b31-a3fa-863ee5215e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425b41191aa541fe91d4f25a6f35a4dd'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.097972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3ea08a9d-9239-4b31-a3fa-863ee5215e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425b41191aa541fe91d4f25a6f35a4dd'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.110765 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3ea08a9d-9239-4b31-a3fa-863ee5215e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425b41191aa541fe91d4f25a6f35a4dd'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.118005 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3ea08a9d-9239-4b31-a3fa-863ee5215e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425b41191aa541fe91d4f25a6f35a4dd'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.165364 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d896888d-06c0-4e0b-bffd-46da1731c178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ccd8953be4f438aa47bb2233e2192a6'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.166032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d896888d-06c0-4e0b-bffd-46da1731c178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ccd8953be4f438aa47bb2233e2192a6'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.166913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d896888d-06c0-4e0b-bffd-46da1731c178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ccd8953be4f438aa47bb2233e2192a6'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.175167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1350/2672] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:27 2022] DELETE /identity/v3/users/425b41191aa541fe91d4f25a6f35a4dd => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:28.231878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d896888d-06c0-4e0b-bffd-46da1731c178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ccd8953be4f438aa47bb2233e2192a6'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.245443 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d896888d-06c0-4e0b-bffd-46da1731c178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ccd8953be4f438aa47bb2233e2192a6'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.261192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1323/2673] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:27 2022] DELETE /identity/v3/users/6ccd8953be4f438aa47bb2233e2192a6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:28.266715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a9de0-6937-42c6-961f-8b4b8872c30d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:28.267535 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a9de0-6937-42c6-961f-8b4b8872c30d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:28.267535 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a9de0-6937-42c6-961f-8b4b8872c30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:28.288769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-8b0a9de0-6937-42c6-961f-8b4b8872c30d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:28.290475 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8b0a9de0-6937-42c6-961f-8b4b8872c30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:28.358309 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1351/2674] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:28.368528 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896888d-06c0-4e0b-bffd-46da1731c178 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:28.373126 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d896888d-06c0-4e0b-bffd-46da1731c178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:28.429041 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896888d-06c0-4e0b-bffd-46da1731c178 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:28.432967 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0528e4-140d-4250-9d06-29e7c2ee9440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:28.433727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0528e4-140d-4250-9d06-29e7c2ee9440 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:28.434007 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0528e4-140d-4250-9d06-29e7c2ee9440 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:28.434279 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0528e4-140d-4250-9d06-29e7c2ee9440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:28.443819 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0528e4-140d-4250-9d06-29e7c2ee9440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:28.445320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0528e4-140d-4250-9d06-29e7c2ee9440 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:28.455650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1324/2675] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:28.638379 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a9de0-6937-42c6-961f-8b4b8872c30d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:28.640615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8b0a9de0-6937-42c6-961f-8b4b8872c30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:28.654202 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a9de0-6937-42c6-961f-8b4b8872c30d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:28.665374 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78d19a-f409-45c8-884a-22e168c69d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:28.672602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78d19a-f409-45c8-884a-22e168c69d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:28.672602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78d19a-f409-45c8-884a-22e168c69d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:28.672602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78d19a-f409-45c8-884a-22e168c69d98 admin admin] PATH_INFO: `/v3/projects/9dd0b0f556f043fbb931f6cc4cb6ce9d` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:28.672602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78d19a-f409-45c8-884a-22e168c69d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd0b0f556f043fbb931f6cc4cb6ce9d)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:28.672602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78d19a-f409-45c8-884a-22e168c69d98 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:28.808590 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-2a78d19a-f409-45c8-884a-22e168c69d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd0b0f556f043fbb931f6cc4cb6ce9d', 'request_id': 'req-2a78d19a-f409-45c8-884a-22e168c69d98'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.883031 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-2a78d19a-f409-45c8-884a-22e168c69d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd0b0f556f043fbb931f6cc4cb6ce9d', 'request_id': 'req-2a78d19a-f409-45c8-884a-22e168c69d98'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.889754 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-2a78d19a-f409-45c8-884a-22e168c69d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd0b0f556f043fbb931f6cc4cb6ce9d', 'request_id': 'req-2a78d19a-f409-45c8-884a-22e168c69d98'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.896136 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0528e4-140d-4250-9d06-29e7c2ee9440 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:28.898395 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9b0528e4-140d-4250-9d06-29e7c2ee9440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:28.902136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-2a78d19a-f409-45c8-884a-22e168c69d98 admin admin] The token cache is being invalidate because project 9dd0b0f556f043fbb931f6cc4cb6ce9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:28.902527 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-2a78d19a-f409-45c8-884a-22e168c69d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.903259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-2a78d19a-f409-45c8-884a-22e168c69d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:28.905116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1352/2676] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:28 2022] DELETE /identity/v3/projects/9dd0b0f556f043fbb931f6cc4cb6ce9d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:28.911163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36da19-37c1-4c74-b51f-a67ee1069d6d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:28.911163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36da19-37c1-4c74-b51f-a67ee1069d6d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:28.911163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36da19-37c1-4c74-b51f-a67ee1069d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:28.924725 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0528e4-140d-4250-9d06-29e7c2ee9440 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:28.932360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-3e36da19-37c1-4c74-b51f-a67ee1069d6d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:28.933613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3e36da19-37c1-4c74-b51f-a67ee1069d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:28.985571 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0d16f-6b46-485a-be6e-b4aa4d044489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:28.986442 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0d16f-6b46-485a-be6e-b4aa4d044489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:28.986722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0d16f-6b46-485a-be6e-b4aa4d044489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:28.986996 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0d16f-6b46-485a-be6e-b4aa4d044489 admin admin] PATH_INFO: `/v3/projects/7f832258bcdb4665893bfc8c45b05276` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:28.988169 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0d16f-6b46-485a-be6e-b4aa4d044489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f832258bcdb4665893bfc8c45b05276)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:28.990144 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0d16f-6b46-485a-be6e-b4aa4d044489 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.001437 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1353/2677] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:29.009301 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae27b5-c962-4f0f-9b34-3f09745ea72a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.009607 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae27b5-c962-4f0f-9b34-3f09745ea72a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.009895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae27b5-c962-4f0f-9b34-3f09745ea72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.027926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d5ae27b5-c962-4f0f-9b34-3f09745ea72a None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:29.029161 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d5ae27b5-c962-4f0f-9b34-3f09745ea72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:29.037452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1354/2678] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:29.041877 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae27b5-c962-4f0f-9b34-3f09745ea72a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.052899 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae27b5-c962-4f0f-9b34-3f09745ea72a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.057615 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c6355-439f-4775-9d76-32e45ccbd7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.058272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c6355-439f-4775-9d76-32e45ccbd7ce admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.058561 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c6355-439f-4775-9d76-32e45ccbd7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.058835 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c6355-439f-4775-9d76-32e45ccbd7ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.059591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c6355-439f-4775-9d76-32e45ccbd7ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:20:29.059901 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c6355-439f-4775-9d76-32e45ccbd7ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.061522 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c6355-439f-4775-9d76-32e45ccbd7ce admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.074039 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1355/2679] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 11:20:29.078992 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c6355-439f-4775-9d76-32e45ccbd7ce admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.085480 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a3b0d16f-6b46-485a-be6e-b4aa4d044489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f832258bcdb4665893bfc8c45b05276', 'request_id': 'req-a3b0d16f-6b46-485a-be6e-b4aa4d044489'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:29.088898 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c6355-439f-4775-9d76-32e45ccbd7ce admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.091779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a3b0d16f-6b46-485a-be6e-b4aa4d044489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f832258bcdb4665893bfc8c45b05276', 'request_id': 'req-a3b0d16f-6b46-485a-be6e-b4aa4d044489'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:29.097045 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a3b0d16f-6b46-485a-be6e-b4aa4d044489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f832258bcdb4665893bfc8c45b05276', 'request_id': 'req-a3b0d16f-6b46-485a-be6e-b4aa4d044489'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:29.144617 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4a71a-9e4e-4cad-8ad1-1ef6c06f7f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.145381 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a71a-9e4e-4cad-8ad1-1ef6c06f7f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.145665 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a71a-9e4e-4cad-8ad1-1ef6c06f7f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.145934 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a71a-9e4e-4cad-8ad1-1ef6c06f7f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.146646 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4a71a-9e4e-4cad-8ad1-1ef6c06f7f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.148661 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4a71a-9e4e-4cad-8ad1-1ef6c06f7f5a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.150593 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a3b0d16f-6b46-485a-be6e-b4aa4d044489 admin admin] The token cache is being invalidate because project 7f832258bcdb4665893bfc8c45b05276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:29.150880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a3b0d16f-6b46-485a-be6e-b4aa4d044489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:29.151530 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a3b0d16f-6b46-485a-be6e-b4aa4d044489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:29.153708 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1325/2680] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:28 2022] DELETE /identity/v3/projects/7f832258bcdb4665893bfc8c45b05276 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:29.157874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5fe6e-cef7-4cc9-b879-a4531a4e1e29 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.158163 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5fe6e-cef7-4cc9-b879-a4531a4e1e29 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.158441 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5fe6e-cef7-4cc9-b879-a4531a4e1e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.177848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7ef5fe6e-cef7-4cc9-b879-a4531a4e1e29 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:29.179117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7ef5fe6e-cef7-4cc9-b879-a4531a4e1e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:29.187414 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1326/2681] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:29.197147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18645a-9c95-4ab6-a7b5-ba382dfefec6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.197432 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18645a-9c95-4ab6-a7b5-ba382dfefec6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.197710 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18645a-9c95-4ab6-a7b5-ba382dfefec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.216666 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1356/2682] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:29 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:29.218898 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-dc18645a-9c95-4ab6-a7b5-ba382dfefec6 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:29.218898 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-dc18645a-9c95-4ab6-a7b5-ba382dfefec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:29.219828 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4a71a-9e4e-4cad-8ad1-1ef6c06f7f5a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.221550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-26f4a71a-9e4e-4cad-8ad1-1ef6c06f7f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:29.276278 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1327/2683] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:29.287590 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4a71a-9e4e-4cad-8ad1-1ef6c06f7f5a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.288102 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18645a-9c95-4ab6-a7b5-ba382dfefec6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.294260 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c777f-7875-4f7a-8837-ae6cddd95d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.295256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c777f-7875-4f7a-8837-ae6cddd95d2a admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.295799 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c777f-7875-4f7a-8837-ae6cddd95d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.296343 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c777f-7875-4f7a-8837-ae6cddd95d2a admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.297945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c777f-7875-4f7a-8837-ae6cddd95d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.300136 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c777f-7875-4f7a-8837-ae6cddd95d2a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.302892 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18645a-9c95-4ab6-a7b5-ba382dfefec6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.307737 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe91b2d-111a-49ef-9a7d-f9e611879153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.308466 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe91b2d-111a-49ef-9a7d-f9e611879153 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.308715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe91b2d-111a-49ef-9a7d-f9e611879153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.308973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe91b2d-111a-49ef-9a7d-f9e611879153 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.309737 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe91b2d-111a-49ef-9a7d-f9e611879153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:20:29.313988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe91b2d-111a-49ef-9a7d-f9e611879153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.313988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe91b2d-111a-49ef-9a7d-f9e611879153 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.324098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1328/2684] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:20:29.335811 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe91b2d-111a-49ef-9a7d-f9e611879153 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.346324 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe91b2d-111a-49ef-9a7d-f9e611879153 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.351212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57413a5-7109-4749-ad29-1d4d8cb9f5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.351841 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57413a5-7109-4749-ad29-1d4d8cb9f5aa admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.352117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57413a5-7109-4749-ad29-1d4d8cb9f5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.352383 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57413a5-7109-4749-ad29-1d4d8cb9f5aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.353084 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57413a5-7109-4749-ad29-1d4d8cb9f5aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.355439 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57413a5-7109-4749-ad29-1d4d8cb9f5aa admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.374637 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1357/2685] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:29 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:29.378668 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c777f-7875-4f7a-8837-ae6cddd95d2a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.388376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c777f-7875-4f7a-8837-ae6cddd95d2a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.393107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024be3f3-5d4d-47a7-84b5-bb7183b3b566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.393759 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024be3f3-5d4d-47a7-84b5-bb7183b3b566 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.394043 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024be3f3-5d4d-47a7-84b5-bb7183b3b566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.394320 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024be3f3-5d4d-47a7-84b5-bb7183b3b566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.395110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024be3f3-5d4d-47a7-84b5-bb7183b3b566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.396726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024be3f3-5d4d-47a7-84b5-bb7183b3b566 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.407529 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1358/2686] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:29.411429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024be3f3-5d4d-47a7-84b5-bb7183b3b566 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.421340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024be3f3-5d4d-47a7-84b5-bb7183b3b566 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.426796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2aeb7-90a7-4c28-9f9a-372e617da29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.428047 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2aeb7-90a7-4c28-9f9a-372e617da29f admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.428047 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2aeb7-90a7-4c28-9f9a-372e617da29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.428047 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2aeb7-90a7-4c28-9f9a-372e617da29f admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.428397 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1329/2687] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:29 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:29.428787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2aeb7-90a7-4c28-9f9a-372e617da29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.430409 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2aeb7-90a7-4c28-9f9a-372e617da29f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.432499 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57413a5-7109-4749-ad29-1d4d8cb9f5aa admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.445459 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1359/2688] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:29.446760 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2aeb7-90a7-4c28-9f9a-372e617da29f admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.458605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2aeb7-90a7-4c28-9f9a-372e617da29f admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.495735 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57413a5-7109-4749-ad29-1d4d8cb9f5aa admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.501475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48f6be-e0fd-455b-b501-08d0a8571a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.502155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f6be-e0fd-455b-b501-08d0a8571a01 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.502435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f6be-e0fd-455b-b501-08d0a8571a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.502715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f6be-e0fd-455b-b501-08d0a8571a01 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.503428 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48f6be-e0fd-455b-b501-08d0a8571a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.505442 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48f6be-e0fd-455b-b501-08d0a8571a01 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.513993 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ef011-91b9-4494-b248-64f14c960e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.514885 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ef011-91b9-4494-b248-64f14c960e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.515167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ef011-91b9-4494-b248-64f14c960e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.515441 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ef011-91b9-4494-b248-64f14c960e32 admin admin] PATH_INFO: `/v3/projects/27fe21ea97434e4180920d9f9fe15c90/users/7c03af3199a2453a8339e6d60d9e9a82/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.530746 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ef011-91b9-4494-b248-64f14c960e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27fe21ea97434e4180920d9f9fe15c90, user_id=7c03af3199a2453a8339e6d60d9e9a82, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.533469 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ef011-91b9-4494-b248-64f14c960e32 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.566453 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1330/2689] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:29 2022] POST /identity/v3/users => generated 282 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:29.567533 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48f6be-e0fd-455b-b501-08d0a8571a01 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.577828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48f6be-e0fd-455b-b501-08d0a8571a01 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.583619 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6e5ba-a648-474a-8025-ffa69c9cd457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.584297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e5ba-a648-474a-8025-ffa69c9cd457 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.584706 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e5ba-a648-474a-8025-ffa69c9cd457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.584991 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e5ba-a648-474a-8025-ffa69c9cd457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.585935 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6e5ba-a648-474a-8025-ffa69c9cd457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.587586 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6e5ba-a648-474a-8025-ffa69c9cd457 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.591773 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1360/2690] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:29 2022] PUT /identity/v3/projects/27fe21ea97434e4180920d9f9fe15c90/users/7c03af3199a2453a8339e6d60d9e9a82/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:29.597815 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1331/2691] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:29.601920 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ef011-91b9-4494-b248-64f14c960e32 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.602690 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc546a43-e9ff-46e4-8f5e-860f0fbc289f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.602985 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc546a43-e9ff-46e4-8f5e-860f0fbc289f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.603264 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc546a43-e9ff-46e4-8f5e-860f0fbc289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.629892 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-fc546a43-e9ff-46e4-8f5e-860f0fbc289f None None] MFA Rules not processed for user `7c03af3199a2453a8339e6d60d9e9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:29.631117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fc546a43-e9ff-46e4-8f5e-860f0fbc289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:29.673178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ef011-91b9-4494-b248-64f14c960e32 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.679802 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516a0cf-0266-4d23-a487-03c65266b5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.680541 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516a0cf-0266-4d23-a487-03c65266b5cf admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.680871 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516a0cf-0266-4d23-a487-03c65266b5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.681196 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516a0cf-0266-4d23-a487-03c65266b5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.681926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516a0cf-0266-4d23-a487-03c65266b5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.683684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516a0cf-0266-4d23-a487-03c65266b5cf admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.696331 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1361/2692] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:29.701018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516a0cf-0266-4d23-a487-03c65266b5cf admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.705789 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1332/2693] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:29.710233 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc546a43-e9ff-46e4-8f5e-860f0fbc289f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.712149 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516a0cf-0266-4d23-a487-03c65266b5cf admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.717008 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5d571-5a56-478f-bb26-c91d13f6df99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.717955 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d571-5a56-478f-bb26-c91d13f6df99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.718232 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d571-5a56-478f-bb26-c91d13f6df99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.718509 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d571-5a56-478f-bb26-c91d13f6df99 admin admin] PATH_INFO: `/v3/projects/bdf5cbd36ee34c10bff60e1f56acca53/users/0336ea94de6140cdb9ba1c64e09ca398/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.721243 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc546a43-e9ff-46e4-8f5e-860f0fbc289f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.726179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6d904-85c2-42e9-b103-6f659f895ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.726840 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d904-85c2-42e9-b103-6f659f895ddb admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.727125 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d904-85c2-42e9-b103-6f659f895ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.727401 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d904-85c2-42e9-b103-6f659f895ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.728320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6d904-85c2-42e9-b103-6f659f895ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.730926 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6d904-85c2-42e9-b103-6f659f895ddb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.737788 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5d571-5a56-478f-bb26-c91d13f6df99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf5cbd36ee34c10bff60e1f56acca53, user_id=0336ea94de6140cdb9ba1c64e09ca398, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.740722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5d571-5a56-478f-bb26-c91d13f6df99 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.803469 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1362/2694] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:29 2022] PUT /identity/v3/projects/bdf5cbd36ee34c10bff60e1f56acca53/users/0336ea94de6140cdb9ba1c64e09ca398/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:29.814205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e8c01-9e48-413c-a840-26795a61d8c7 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.814492 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e8c01-9e48-413c-a840-26795a61d8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.814783 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e8c01-9e48-413c-a840-26795a61d8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.830314 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1333/2695] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:29 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:29.831192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6d904-85c2-42e9-b103-6f659f895ddb admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.842560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-265e8c01-9e48-413c-a840-26795a61d8c7 None None] MFA Rules not processed for user `0336ea94de6140cdb9ba1c64e09ca398`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:29.843865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-265e8c01-9e48-413c-a840-26795a61d8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:29.893156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6d904-85c2-42e9-b103-6f659f895ddb admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.897902 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfa9d8-a12d-4018-893c-3932038fbbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.898582 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfa9d8-a12d-4018-893c-3932038fbbaa admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.898843 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfa9d8-a12d-4018-893c-3932038fbbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.899117 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfa9d8-a12d-4018-893c-3932038fbbaa admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.899801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfa9d8-a12d-4018-893c-3932038fbbaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.901829 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfa9d8-a12d-4018-893c-3932038fbbaa admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.908733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1363/2696] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:29.913352 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e8c01-9e48-413c-a840-26795a61d8c7 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:29.929891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e8c01-9e48-413c-a840-26795a61d8c7 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:29.929891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f87c7-b277-447d-a90c-5546ca6e439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:29.929891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f87c7-b277-447d-a90c-5546ca6e439e admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:29.930261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f87c7-b277-447d-a90c-5546ca6e439e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:29.930458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f87c7-b277-447d-a90c-5546ca6e439e admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:29.931139 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f87c7-b277-447d-a90c-5546ca6e439e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:29.933086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f87c7-b277-447d-a90c-5546ca6e439e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:29.986321 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1334/2697] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:29 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:29.991738 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfa9d8-a12d-4018-893c-3932038fbbaa admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:30.002323 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfa9d8-a12d-4018-893c-3932038fbbaa admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:30.007603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1364/2698] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:29 2022] POST /identity/v3/projects => generated 361 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:30.008558 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f87c7-b277-447d-a90c-5546ca6e439e admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:30.060288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc68aa0-2b83-484b-8558-ea12817fd266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:30.061078 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc68aa0-2b83-484b-8558-ea12817fd266 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:30.061378 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc68aa0-2b83-484b-8558-ea12817fd266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:30.061657 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc68aa0-2b83-484b-8558-ea12817fd266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:30.062385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc68aa0-2b83-484b-8558-ea12817fd266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:30.064616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc68aa0-2b83-484b-8558-ea12817fd266 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:30.072521 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f87c7-b277-447d-a90c-5546ca6e439e admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:30.075598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1335/2699] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:30.078637 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc68aa0-2b83-484b-8558-ea12817fd266 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:30.078764 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be2c82-d8aa-4d4d-97d4-873da56ea564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:30.079412 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be2c82-d8aa-4d4d-97d4-873da56ea564 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:30.079699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be2c82-d8aa-4d4d-97d4-873da56ea564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:30.079979 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be2c82-d8aa-4d4d-97d4-873da56ea564 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:30.080670 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be2c82-d8aa-4d4d-97d4-873da56ea564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:30.082620 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be2c82-d8aa-4d4d-97d4-873da56ea564 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:30.088409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc68aa0-2b83-484b-8558-ea12817fd266 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:30.093487 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482c7ef-7f72-4b15-ac0d-495a391bcfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:30.094883 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c7ef-7f72-4b15-ac0d-495a391bcfcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:30.095162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c7ef-7f72-4b15-ac0d-495a391bcfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:30.095436 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c7ef-7f72-4b15-ac0d-495a391bcfcf admin admin] PATH_INFO: `/v3/projects/b89f20fc76b54d4693a66994e55ad7cf/users/ec4b89e7ccb74c9cb9278535e2f102be/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:30.111541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482c7ef-7f72-4b15-ac0d-495a391bcfcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89f20fc76b54d4693a66994e55ad7cf, user_id=ec4b89e7ccb74c9cb9278535e2f102be, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:30.114368 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482c7ef-7f72-4b15-ac0d-495a391bcfcf admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:30.151547 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1365/2700] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:30 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:30.155496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be2c82-d8aa-4d4d-97d4-873da56ea564 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:30.165405 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be2c82-d8aa-4d4d-97d4-873da56ea564 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:30.170391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7c8d4-c623-4cb7-92de-8083b94a797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:30.171045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7c8d4-c623-4cb7-92de-8083b94a797d admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:30.171326 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7c8d4-c623-4cb7-92de-8083b94a797d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:30.171603 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7c8d4-c623-4cb7-92de-8083b94a797d admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:30.172966 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7c8d4-c623-4cb7-92de-8083b94a797d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:30.174609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7c8d4-c623-4cb7-92de-8083b94a797d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:30.187954 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1366/2701] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:30.188274 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1336/2702] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:30 2022] PUT /identity/v3/projects/b89f20fc76b54d4693a66994e55ad7cf/users/ec4b89e7ccb74c9cb9278535e2f102be/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:30.191108 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7c8d4-c623-4cb7-92de-8083b94a797d admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:30.191292 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482c7ef-7f72-4b15-ac0d-495a391bcfcf admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:30.201980 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7c8d4-c623-4cb7-92de-8083b94a797d admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:30.252089 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482c7ef-7f72-4b15-ac0d-495a391bcfcf admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:30.256736 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabc767-bdb7-4888-b7b3-36cfe62d8dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:30.257644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabc767-bdb7-4888-b7b3-36cfe62d8dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:30.257927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabc767-bdb7-4888-b7b3-36cfe62d8dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:30.258197 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabc767-bdb7-4888-b7b3-36cfe62d8dd8 admin admin] PATH_INFO: `/v3/projects/1ed71126ea1f40cf97fd0f25bd13c464/users/bc64c05971d9420abe5316eb2a6fd0a4/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:30.258827 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb02244-c420-4f08-a990-8abf3ba85a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:30.259791 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb02244-c420-4f08-a990-8abf3ba85a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:30.260086 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb02244-c420-4f08-a990-8abf3ba85a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:30.260468 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb02244-c420-4f08-a990-8abf3ba85a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:30.261397 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb02244-c420-4f08-a990-8abf3ba85a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:30.262999 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb02244-c420-4f08-a990-8abf3ba85a27 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:30.272383 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabc767-bdb7-4888-b7b3-36cfe62d8dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed71126ea1f40cf97fd0f25bd13c464, user_id=bc64c05971d9420abe5316eb2a6fd0a4, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:30.273321 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1367/2703] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:30.275121 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabc767-bdb7-4888-b7b3-36cfe62d8dd8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:30.277426 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb02244-c420-4f08-a990-8abf3ba85a27 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:30.287540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb02244-c420-4f08-a990-8abf3ba85a27 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:30.292811 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af506f8-3d8f-452d-aa25-1e427d8b09c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:30.293738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af506f8-3d8f-452d-aa25-1e427d8b09c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:30.294023 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af506f8-3d8f-452d-aa25-1e427d8b09c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:30.294298 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af506f8-3d8f-452d-aa25-1e427d8b09c0 admin admin] PATH_INFO: `/v3/projects/b89f20fc76b54d4693a66994e55ad7cf/users/ec4b89e7ccb74c9cb9278535e2f102be/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:30.296335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af506f8-3d8f-452d-aa25-1e427d8b09c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89f20fc76b54d4693a66994e55ad7cf, user_id=ec4b89e7ccb74c9cb9278535e2f102be, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:30.299611 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af506f8-3d8f-452d-aa25-1e427d8b09c0 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:30.309874 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1368/2704] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:30 2022] PUT /identity/v3/projects/b89f20fc76b54d4693a66994e55ad7cf/users/ec4b89e7ccb74c9cb9278535e2f102be/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:30.319762 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e6e4-a2fa-462c-8d24-b0dac85c6f95 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:30.320051 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e6e4-a2fa-462c-8d24-b0dac85c6f95 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:30.320334 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e6e4-a2fa-462c-8d24-b0dac85c6f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:30.346778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0307e6e4-a2fa-462c-8d24-b0dac85c6f95 None None] MFA Rules not processed for user `ec4b89e7ccb74c9cb9278535e2f102be`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:30.348006 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0307e6e4-a2fa-462c-8d24-b0dac85c6f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:30.381831 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1337/2705] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:30 2022] PUT /identity/v3/projects/1ed71126ea1f40cf97fd0f25bd13c464/users/bc64c05971d9420abe5316eb2a6fd0a4/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:30.384481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabc767-bdb7-4888-b7b3-36cfe62d8dd8 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:30.418037 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1369/2706] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:30.428969 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307e6e4-a2fa-462c-8d24-b0dac85c6f95 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:30.430407 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0307e6e4-a2fa-462c-8d24-b0dac85c6f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:30.446557 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabc767-bdb7-4888-b7b3-36cfe62d8dd8 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:30.451766 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba203c-c520-48e6-a41e-8f836f4851e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:30.452437 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba203c-c520-48e6-a41e-8f836f4851e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:30.452717 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba203c-c520-48e6-a41e-8f836f4851e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:30.452990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba203c-c520-48e6-a41e-8f836f4851e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:30.454365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba203c-c520-48e6-a41e-8f836f4851e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:30.456000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba203c-c520-48e6-a41e-8f836f4851e4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:30.465825 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1338/2707] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:30.470560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba203c-c520-48e6-a41e-8f836f4851e4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:30.480574 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba203c-c520-48e6-a41e-8f836f4851e4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:30.484870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0927bd-b0ec-444e-8976-d64d91cc9e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:30.485766 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0927bd-b0ec-444e-8976-d64d91cc9e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:30.486046 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0927bd-b0ec-444e-8976-d64d91cc9e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:30.486316 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0927bd-b0ec-444e-8976-d64d91cc9e53 admin admin] PATH_INFO: `/v3/projects/1ed71126ea1f40cf97fd0f25bd13c464/users/bc64c05971d9420abe5316eb2a6fd0a4/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:30.487902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307e6e4-a2fa-462c-8d24-b0dac85c6f95 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:30.488280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0927bd-b0ec-444e-8976-d64d91cc9e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed71126ea1f40cf97fd0f25bd13c464, user_id=bc64c05971d9420abe5316eb2a6fd0a4, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:30.490978 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0927bd-b0ec-444e-8976-d64d91cc9e53 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:30.501356 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1339/2708] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:30 2022] PUT /identity/v3/projects/1ed71126ea1f40cf97fd0f25bd13c464/users/bc64c05971d9420abe5316eb2a6fd0a4/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:30.511767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b09e5-b963-4afb-b636-dff9564dd179 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:30.511767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b09e5-b963-4afb-b636-dff9564dd179 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:30.512069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b09e5-b963-4afb-b636-dff9564dd179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:30.536454 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dc0f7-7509-4514-ba46-7b7b6994de5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:30.537138 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dc0f7-7509-4514-ba46-7b7b6994de5a service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:30.537421 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dc0f7-7509-4514-ba46-7b7b6994de5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:30.537699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dc0f7-7509-4514-ba46-7b7b6994de5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:30.538868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-029b09e5-b963-4afb-b636-dff9564dd179 None None] MFA Rules not processed for user `bc64c05971d9420abe5316eb2a6fd0a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:30.540128 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-029b09e5-b963-4afb-b636-dff9564dd179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:30.594227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016dc0f7-7509-4514-ba46-7b7b6994de5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:30.596598 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016dc0f7-7509-4514-ba46-7b7b6994de5a service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:30.606094 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1370/2709] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:30.607765 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1340/2710] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:30 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:30.618791 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dc0f7-7509-4514-ba46-7b7b6994de5a service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:30.620291 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-016dc0f7-7509-4514-ba46-7b7b6994de5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:30.631427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dc0f7-7509-4514-ba46-7b7b6994de5a service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:30.688113 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10304734-55c7-43df-bd8a-709453fbe3db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:30.688321 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10304734-55c7-43df-bd8a-709453fbe3db service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:30.688609 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10304734-55c7-43df-bd8a-709453fbe3db service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:30.688890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10304734-55c7-43df-bd8a-709453fbe3db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:30.699420 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10304734-55c7-43df-bd8a-709453fbe3db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:30.700988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10304734-55c7-43df-bd8a-709453fbe3db service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:30.711889 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1371/2711] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:30 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:30.943185 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b09e5-b963-4afb-b636-dff9564dd179 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:30.953131 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b09e5-b963-4afb-b636-dff9564dd179 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:30.957804 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f178cec-7581-4ce0-a938-add7e7c80d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:30.962144 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178cec-7581-4ce0-a938-add7e7c80d8a service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:30.962144 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178cec-7581-4ce0-a938-add7e7c80d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:30.962144 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178cec-7581-4ce0-a938-add7e7c80d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:31.015141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f178cec-7581-4ce0-a938-add7e7c80d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:31.017409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f178cec-7581-4ce0-a938-add7e7c80d8a service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:31.027118 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1341/2712] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:43.901969 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10304734-55c7-43df-bd8a-709453fbe3db service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:43.912009 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10304734-55c7-43df-bd8a-709453fbe3db service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:43.915988 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d5521-93a5-4e6c-9373-4d64e2b1939c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:43.916861 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d5521-93a5-4e6c-9373-4d64e2b1939c service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:43.917174 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d5521-93a5-4e6c-9373-4d64e2b1939c service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:43.917450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d5521-93a5-4e6c-9373-4d64e2b1939c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:43.977422 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d5521-93a5-4e6c-9373-4d64e2b1939c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:43.978851 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d5521-93a5-4e6c-9373-4d64e2b1939c service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:43.988717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1372/2713] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:48.713069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f178cec-7581-4ce0-a938-add7e7c80d8a service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:48.772647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f178cec-7581-4ce0-a938-add7e7c80d8a service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:48.777440 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44284678-eb94-4b64-be1d-8909c273e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:48.778369 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44284678-eb94-4b64-be1d-8909c273e17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:48.778656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44284678-eb94-4b64-be1d-8909c273e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:48.778932 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44284678-eb94-4b64-be1d-8909c273e17e admin admin] PATH_INFO: `/v3/users/0336ea94de6140cdb9ba1c64e09ca398` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:48.780132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44284678-eb94-4b64-be1d-8909c273e17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0336ea94de6140cdb9ba1c64e09ca398)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:48.782221 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44284678-eb94-4b64-be1d-8909c273e17e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:48.918361 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-44284678-eb94-4b64-be1d-8909c273e17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0336ea94de6140cdb9ba1c64e09ca398'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:48.918941 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-44284678-eb94-4b64-be1d-8909c273e17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0336ea94de6140cdb9ba1c64e09ca398'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:48.919533 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-44284678-eb94-4b64-be1d-8909c273e17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0336ea94de6140cdb9ba1c64e09ca398'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:48.990482 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-44284678-eb94-4b64-be1d-8909c273e17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0336ea94de6140cdb9ba1c64e09ca398'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:49.002265 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-44284678-eb94-4b64-be1d-8909c273e17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0336ea94de6140cdb9ba1c64e09ca398'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:49.014616 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1342/2714] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:48 2022] DELETE /identity/v3/users/0336ea94de6140cdb9ba1c64e09ca398 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:49.019058 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44a94-7617-4b69-a2c8-74ef8f05f369 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:49.025124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44a94-7617-4b69-a2c8-74ef8f05f369 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:49.025124 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44a94-7617-4b69-a2c8-74ef8f05f369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:49.040052 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-78c44a94-7617-4b69-a2c8-74ef8f05f369 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:49.041598 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-78c44a94-7617-4b69-a2c8-74ef8f05f369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:49.097333 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1373/2715] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:49.107471 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44284678-eb94-4b64-be1d-8909c273e17e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:49.108886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-44284678-eb94-4b64-be1d-8909c273e17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:49.164424 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44284678-eb94-4b64-be1d-8909c273e17e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:49.168313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211f259-792b-4d4f-a118-f5704bc611d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:49.169034 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211f259-792b-4d4f-a118-f5704bc611d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:49.169300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211f259-792b-4d4f-a118-f5704bc611d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:49.169576 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211f259-792b-4d4f-a118-f5704bc611d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:49.178779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211f259-792b-4d4f-a118-f5704bc611d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:49.180249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211f259-792b-4d4f-a118-f5704bc611d9 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:49.189630 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1343/2716] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:49.549629 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c44a94-7617-4b69-a2c8-74ef8f05f369 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:49.551061 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-78c44a94-7617-4b69-a2c8-74ef8f05f369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:49.564305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c44a94-7617-4b69-a2c8-74ef8f05f369 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:49.569622 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:49.570490 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:49.570783 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:49.571064 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] PATH_INFO: `/v3/projects/bdf5cbd36ee34c10bff60e1f56acca53` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:49.572392 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf5cbd36ee34c10bff60e1f56acca53)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:49.574451 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:49.678052 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf5cbd36ee34c10bff60e1f56acca53', 'request_id': 'req-56aa20ec-46e9-4646-af87-eadee491c796'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:49.750999 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf5cbd36ee34c10bff60e1f56acca53', 'request_id': 'req-56aa20ec-46e9-4646-af87-eadee491c796'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:49.758367 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf5cbd36ee34c10bff60e1f56acca53', 'request_id': 'req-56aa20ec-46e9-4646-af87-eadee491c796'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:49.768553 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] The token cache is being invalidate because project bdf5cbd36ee34c10bff60e1f56acca53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:49.768837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:49.769475 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:49.771017 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1374/2717] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:49 2022] DELETE /identity/v3/projects/bdf5cbd36ee34c10bff60e1f56acca53 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:49.775018 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211f259-792b-4d4f-a118-f5704bc611d9 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:49.784739 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211f259-792b-4d4f-a118-f5704bc611d9 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:49.839461 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43838855-a8c6-4a61-969b-7e8fb31b83d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:49.840331 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43838855-a8c6-4a61-969b-7e8fb31b83d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:49.840609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43838855-a8c6-4a61-969b-7e8fb31b83d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:49.840885 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43838855-a8c6-4a61-969b-7e8fb31b83d3 admin admin] PATH_INFO: `/v3/users/bc64c05971d9420abe5316eb2a6fd0a4` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:49.842111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43838855-a8c6-4a61-969b-7e8fb31b83d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc64c05971d9420abe5316eb2a6fd0a4)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:49.844102 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43838855-a8c6-4a61-969b-7e8fb31b83d3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:50.020627 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-43838855-a8c6-4a61-969b-7e8fb31b83d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc64c05971d9420abe5316eb2a6fd0a4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.021323 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-43838855-a8c6-4a61-969b-7e8fb31b83d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc64c05971d9420abe5316eb2a6fd0a4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.021936 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-43838855-a8c6-4a61-969b-7e8fb31b83d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc64c05971d9420abe5316eb2a6fd0a4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.093723 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-43838855-a8c6-4a61-969b-7e8fb31b83d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc64c05971d9420abe5316eb2a6fd0a4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.106272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-43838855-a8c6-4a61-969b-7e8fb31b83d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc64c05971d9420abe5316eb2a6fd0a4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.118564 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1344/2718] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:49 2022] DELETE /identity/v3/users/bc64c05971d9420abe5316eb2a6fd0a4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:50.495387 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:50.496926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:50.512126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa20ec-46e9-4646-af87-eadee491c796 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:50.559124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43838855-a8c6-4a61-969b-7e8fb31b83d3 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:50.560652 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-43838855-a8c6-4a61-969b-7e8fb31b83d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:50.570722 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795764c-beee-4354-a9d9-efa4a0846c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:50.571704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795764c-beee-4354-a9d9-efa4a0846c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:50.571881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795764c-beee-4354-a9d9-efa4a0846c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:50.572159 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795764c-beee-4354-a9d9-efa4a0846c3c admin admin] PATH_INFO: `/v3/projects/1ed71126ea1f40cf97fd0f25bd13c464` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:50.573527 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795764c-beee-4354-a9d9-efa4a0846c3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed71126ea1f40cf97fd0f25bd13c464)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:50.575456 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795764c-beee-4354-a9d9-efa4a0846c3c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:50.623072 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43838855-a8c6-4a61-969b-7e8fb31b83d3 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:50.627778 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5d2e7-5d51-4dff-ba55-4bad4defdc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:50.628641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5d2e7-5d51-4dff-ba55-4bad4defdc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:50.628920 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5d2e7-5d51-4dff-ba55-4bad4defdc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:50.629222 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5d2e7-5d51-4dff-ba55-4bad4defdc33 admin admin] PATH_INFO: `/v3/users/7c03af3199a2453a8339e6d60d9e9a82` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:50.630963 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5d2e7-5d51-4dff-ba55-4bad4defdc33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c03af3199a2453a8339e6d60d9e9a82)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:50.632904 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5d2e7-5d51-4dff-ba55-4bad4defdc33 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:50.709900 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a795764c-beee-4354-a9d9-efa4a0846c3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed71126ea1f40cf97fd0f25bd13c464', 'request_id': 'req-a795764c-beee-4354-a9d9-efa4a0846c3c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.756699 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a795764c-beee-4354-a9d9-efa4a0846c3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed71126ea1f40cf97fd0f25bd13c464', 'request_id': 'req-a795764c-beee-4354-a9d9-efa4a0846c3c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.763433 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a795764c-beee-4354-a9d9-efa4a0846c3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed71126ea1f40cf97fd0f25bd13c464', 'request_id': 'req-a795764c-beee-4354-a9d9-efa4a0846c3c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.775017 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a795764c-beee-4354-a9d9-efa4a0846c3c admin admin] The token cache is being invalidate because project 1ed71126ea1f40cf97fd0f25bd13c464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:50.775249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a795764c-beee-4354-a9d9-efa4a0846c3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.775919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-a795764c-beee-4354-a9d9-efa4a0846c3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.777539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1375/2719] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:50 2022] DELETE /identity/v3/projects/1ed71126ea1f40cf97fd0f25bd13c464 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:50.785284 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d66860-9c29-426e-b4e5-5a869cb304c5 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:50.785574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d66860-9c29-426e-b4e5-5a869cb304c5 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:50.785859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d66860-9c29-426e-b4e5-5a869cb304c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:50.804235 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6ad5d2e7-5d51-4dff-ba55-4bad4defdc33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c03af3199a2453a8339e6d60d9e9a82'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.804866 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6ad5d2e7-5d51-4dff-ba55-4bad4defdc33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c03af3199a2453a8339e6d60d9e9a82'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.805496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6ad5d2e7-5d51-4dff-ba55-4bad4defdc33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c03af3199a2453a8339e6d60d9e9a82'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.813793 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-19d66860-9c29-426e-b4e5-5a869cb304c5 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:50.816037 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-19d66860-9c29-426e-b4e5-5a869cb304c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:50.859051 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6ad5d2e7-5d51-4dff-ba55-4bad4defdc33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c03af3199a2453a8339e6d60d9e9a82'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.871506 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6ad5d2e7-5d51-4dff-ba55-4bad4defdc33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c03af3199a2453a8339e6d60d9e9a82'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:50.873484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1376/2720] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:50.883321 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d910fa-4a70-4131-af6d-c4cc7618234d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:50.883616 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d910fa-4a70-4131-af6d-c4cc7618234d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:50.883897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d910fa-4a70-4131-af6d-c4cc7618234d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:50.884342 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1345/2721] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:50 2022] DELETE /identity/v3/users/7c03af3199a2453a8339e6d60d9e9a82 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:50.888492 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa8084-d2a8-4769-bbec-aad4c4ac6e1c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:50.888775 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa8084-d2a8-4769-bbec-aad4c4ac6e1c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:50.889067 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa8084-d2a8-4769-bbec-aad4c4ac6e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:50.902145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-77d910fa-4a70-4131-af6d-c4cc7618234d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:50.903356 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-77d910fa-4a70-4131-af6d-c4cc7618234d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:50.905610 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5caa8084-d2a8-4769-bbec-aad4c4ac6e1c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:50.906769 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5caa8084-d2a8-4769-bbec-aad4c4ac6e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:50.961337 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1377/2722] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:50.962664 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1346/2723] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:50.965839 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d910fa-4a70-4131-af6d-c4cc7618234d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:50.971941 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa8084-d2a8-4769-bbec-aad4c4ac6e1c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:50.973329 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5caa8084-d2a8-4769-bbec-aad4c4ac6e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:50.974945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d910fa-4a70-4131-af6d-c4cc7618234d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:50.979610 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72322ee2-0b28-42ae-afcd-b57d53814d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:50.980248 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72322ee2-0b28-42ae-afcd-b57d53814d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:50.980527 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72322ee2-0b28-42ae-afcd-b57d53814d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:50.980796 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72322ee2-0b28-42ae-afcd-b57d53814d3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:50.981540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72322ee2-0b28-42ae-afcd-b57d53814d3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:20:50.981845 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72322ee2-0b28-42ae-afcd-b57d53814d3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:50.983420 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72322ee2-0b28-42ae-afcd-b57d53814d3d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:50.995250 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1378/2724] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:20:50.999263 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72322ee2-0b28-42ae-afcd-b57d53814d3d admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:51.009099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72322ee2-0b28-42ae-afcd-b57d53814d3d admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:51.013707 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb93cce-4634-46fa-a5fc-760caa79ce33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:51.014340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb93cce-4634-46fa-a5fc-760caa79ce33 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:51.014621 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb93cce-4634-46fa-a5fc-760caa79ce33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:51.014895 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb93cce-4634-46fa-a5fc-760caa79ce33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:51.015575 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb93cce-4634-46fa-a5fc-760caa79ce33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:51.017501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb93cce-4634-46fa-a5fc-760caa79ce33 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:51.029593 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa8084-d2a8-4769-bbec-aad4c4ac6e1c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:51.033219 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c47b63-7bcf-46df-9d65-02dd16231a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:51.033865 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c47b63-7bcf-46df-9d65-02dd16231a48 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:51.034143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c47b63-7bcf-46df-9d65-02dd16231a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:51.034416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c47b63-7bcf-46df-9d65-02dd16231a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:51.044301 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c47b63-7bcf-46df-9d65-02dd16231a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:51.045981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c47b63-7bcf-46df-9d65-02dd16231a48 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:51.056878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1347/2725] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:51.104045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1379/2726] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:50 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:51.108650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c47b63-7bcf-46df-9d65-02dd16231a48 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:51.115302 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c47b63-7bcf-46df-9d65-02dd16231a48 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:51.169240 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be533d8-12bd-4ba8-8c31-413136f44335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:51.169899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be533d8-12bd-4ba8-8c31-413136f44335 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:51.170179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be533d8-12bd-4ba8-8c31-413136f44335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:51.170449 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be533d8-12bd-4ba8-8c31-413136f44335 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:51.171141 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be533d8-12bd-4ba8-8c31-413136f44335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:51.173139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be533d8-12bd-4ba8-8c31-413136f44335 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:51.276820 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1348/2727] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:51 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:51.287246 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb93cce-4634-46fa-a5fc-760caa79ce33 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:51.291782 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb93cce-4634-46fa-a5fc-760caa79ce33 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:51.296494 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a749407-09e7-4729-ae2d-93003bef04aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:51.297194 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a749407-09e7-4729-ae2d-93003bef04aa admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:51.297479 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a749407-09e7-4729-ae2d-93003bef04aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:51.297755 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a749407-09e7-4729-ae2d-93003bef04aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:51.298480 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a749407-09e7-4729-ae2d-93003bef04aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:51.300070 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a749407-09e7-4729-ae2d-93003bef04aa admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:51.311208 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1380/2728] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:51.315969 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be533d8-12bd-4ba8-8c31-413136f44335 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:51.328354 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be533d8-12bd-4ba8-8c31-413136f44335 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:51.333175 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221619f-fff4-4c7b-97cc-2488a41153a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:51.333867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221619f-fff4-4c7b-97cc-2488a41153a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:51.334170 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221619f-fff4-4c7b-97cc-2488a41153a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:51.334450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221619f-fff4-4c7b-97cc-2488a41153a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:51.335177 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221619f-fff4-4c7b-97cc-2488a41153a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:51.336807 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221619f-fff4-4c7b-97cc-2488a41153a9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:51.346753 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1349/2729] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:51.350975 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a749407-09e7-4729-ae2d-93003bef04aa admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:51.360770 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a749407-09e7-4729-ae2d-93003bef04aa admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:51.366284 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f1df5-f569-4974-9d11-c50b6f46b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:51.367056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f1df5-f569-4974-9d11-c50b6f46b692 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:51.367370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f1df5-f569-4974-9d11-c50b6f46b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:51.367650 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f1df5-f569-4974-9d11-c50b6f46b692 admin admin] PATH_INFO: `/v3/projects/481479146f3248bb842bd48e207d92c7/users/c32c5484c01b4bce85c20628724e4f54/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:51.382769 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f1df5-f569-4974-9d11-c50b6f46b692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481479146f3248bb842bd48e207d92c7, user_id=c32c5484c01b4bce85c20628724e4f54, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:51.385533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f1df5-f569-4974-9d11-c50b6f46b692 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:51.460809 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221619f-fff4-4c7b-97cc-2488a41153a9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:51.462630 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3221619f-fff4-4c7b-97cc-2488a41153a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:51.475140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1381/2730] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:51 2022] PUT /identity/v3/projects/481479146f3248bb842bd48e207d92c7/users/c32c5484c01b4bce85c20628724e4f54/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:51.478190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221619f-fff4-4c7b-97cc-2488a41153a9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:51.487222 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cf257-b70d-4da0-bfca-50953ab50848 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:51.487509 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cf257-b70d-4da0-bfca-50953ab50848 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:51.487811 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cf257-b70d-4da0-bfca-50953ab50848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:51.515312 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0a8cf257-b70d-4da0-bfca-50953ab50848 None None] MFA Rules not processed for user `c32c5484c01b4bce85c20628724e4f54`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:51.516852 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0a8cf257-b70d-4da0-bfca-50953ab50848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:51.534410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:51.535410 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:51.536202 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:51.536465 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] PATH_INFO: `/v3/projects/27fe21ea97434e4180920d9f9fe15c90` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:51.537734 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27fe21ea97434e4180920d9f9fe15c90)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:51.539607 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:51.579591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1382/2731] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:51.583964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cf257-b70d-4da0-bfca-50953ab50848 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:51.593865 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cf257-b70d-4da0-bfca-50953ab50848 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:51.599033 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabb903-5701-4083-955f-ca03021738a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:51.599661 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabb903-5701-4083-955f-ca03021738a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:51.599939 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabb903-5701-4083-955f-ca03021738a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:51.600212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabb903-5701-4083-955f-ca03021738a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:51.600888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabb903-5701-4083-955f-ca03021738a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:51.602784 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabb903-5701-4083-955f-ca03021738a1 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:51.647850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27fe21ea97434e4180920d9f9fe15c90', 'request_id': 'req-e3dd3682-9fda-4a82-94be-d116e3052608'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:51.654156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27fe21ea97434e4180920d9f9fe15c90', 'request_id': 'req-e3dd3682-9fda-4a82-94be-d116e3052608'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:51.659770 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27fe21ea97434e4180920d9f9fe15c90', 'request_id': 'req-e3dd3682-9fda-4a82-94be-d116e3052608'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:51.695733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1383/2732] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:51 2022] POST /identity/v3/projects => generated 407 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:51.699599 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabb903-5701-4083-955f-ca03021738a1 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:51.745430 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] The token cache is being invalidate because project 27fe21ea97434e4180920d9f9fe15c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:51.745802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:51.746507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:51.748145 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1350/2733] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:51 2022] DELETE /identity/v3/projects/27fe21ea97434e4180920d9f9fe15c90 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:51.752192 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:51.753530 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:51.760540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabb903-5701-4083-955f-ca03021738a1 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:51.765363 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783418-94d8-4165-b371-ad32a14ff52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:51.766032 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783418-94d8-4165-b371-ad32a14ff52a admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:51.766314 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783418-94d8-4165-b371-ad32a14ff52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:51.766706 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783418-94d8-4165-b371-ad32a14ff52a admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:51.767424 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07783418-94d8-4165-b371-ad32a14ff52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:51.769369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07783418-94d8-4165-b371-ad32a14ff52a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:51.820995 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd3682-9fda-4a82-94be-d116e3052608 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:51.833105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131c5c7-3798-4446-8c95-98225acc43fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:51.833105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131c5c7-3798-4446-8c95-98225acc43fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:51.833105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131c5c7-3798-4446-8c95-98225acc43fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:51.833105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131c5c7-3798-4446-8c95-98225acc43fb admin admin] PATH_INFO: `/v3/users/ec4b89e7ccb74c9cb9278535e2f102be` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:51.833513 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131c5c7-3798-4446-8c95-98225acc43fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4b89e7ccb74c9cb9278535e2f102be)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:51.833513 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131c5c7-3798-4446-8c95-98225acc43fb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:51.860071 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1384/2734] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:51 2022] POST /identity/v3/users => generated 310 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:51.864046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783418-94d8-4165-b371-ad32a14ff52a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:51.865941 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-07783418-94d8-4165-b371-ad32a14ff52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:51.878412 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783418-94d8-4165-b371-ad32a14ff52a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:51.883174 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45868763-1461-4cfb-a7b2-de71d0da7ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:51.883806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45868763-1461-4cfb-a7b2-de71d0da7ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:51.884168 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45868763-1461-4cfb-a7b2-de71d0da7ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:51.884447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45868763-1461-4cfb-a7b2-de71d0da7ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:51.885184 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45868763-1461-4cfb-a7b2-de71d0da7ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:51.886807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45868763-1461-4cfb-a7b2-de71d0da7ec2 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:51.897759 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1385/2735] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:51.901739 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45868763-1461-4cfb-a7b2-de71d0da7ec2 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:51.912309 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45868763-1461-4cfb-a7b2-de71d0da7ec2 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:51.917336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afa263-2ff2-464c-a3b0-fce2816dec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:51.918206 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afa263-2ff2-464c-a3b0-fce2816dec45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:51.918482 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afa263-2ff2-464c-a3b0-fce2816dec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:51.918811 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afa263-2ff2-464c-a3b0-fce2816dec45 admin admin] PATH_INFO: `/v3/projects/2c9f8dbf061d4b029ad5103fb096208b/users/c0d1453df3ca44d4bb19daa90321ca9c/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:51.933166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afa263-2ff2-464c-a3b0-fce2816dec45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9f8dbf061d4b029ad5103fb096208b, user_id=c0d1453df3ca44d4bb19daa90321ca9c, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:51.935812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afa263-2ff2-464c-a3b0-fce2816dec45 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:51.952333 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c131c5c7-3798-4446-8c95-98225acc43fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4b89e7ccb74c9cb9278535e2f102be'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:51.952981 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c131c5c7-3798-4446-8c95-98225acc43fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4b89e7ccb74c9cb9278535e2f102be'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:51.953658 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c131c5c7-3798-4446-8c95-98225acc43fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4b89e7ccb74c9cb9278535e2f102be'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:52.001853 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1386/2736] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:51 2022] PUT /identity/v3/projects/2c9f8dbf061d4b029ad5103fb096208b/users/c0d1453df3ca44d4bb19daa90321ca9c/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:52.005665 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afa263-2ff2-464c-a3b0-fce2816dec45 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:52.007268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f3afa263-2ff2-464c-a3b0-fce2816dec45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:52.013456 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c131c5c7-3798-4446-8c95-98225acc43fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4b89e7ccb74c9cb9278535e2f102be'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:52.026482 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c131c5c7-3798-4446-8c95-98225acc43fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4b89e7ccb74c9cb9278535e2f102be'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:52.039891 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1351/2737] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:20:51 2022] DELETE /identity/v3/users/ec4b89e7ccb74c9cb9278535e2f102be => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:52.070754 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afa263-2ff2-464c-a3b0-fce2816dec45 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:52.126296 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558022be-eaaf-420d-b291-01568be05e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:52.127053 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558022be-eaaf-420d-b291-01568be05e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:52.127339 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558022be-eaaf-420d-b291-01568be05e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:52.127728 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558022be-eaaf-420d-b291-01568be05e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:52.128327 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558022be-eaaf-420d-b291-01568be05e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:52.130448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558022be-eaaf-420d-b291-01568be05e4c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:52.140561 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1387/2738] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:20:52.144690 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131c5c7-3798-4446-8c95-98225acc43fb admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:52.155113 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131c5c7-3798-4446-8c95-98225acc43fb admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:52.160119 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b4826-41c2-4556-b783-2df64ca94e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:52.161126 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4826-41c2-4556-b783-2df64ca94e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:52.161416 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4826-41c2-4556-b783-2df64ca94e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:52.161694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4826-41c2-4556-b783-2df64ca94e22 admin admin] PATH_INFO: `/v3/projects/2c9f8dbf061d4b029ad5103fb096208b/users/c0d1453df3ca44d4bb19daa90321ca9c/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:52.163955 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b4826-41c2-4556-b783-2df64ca94e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9f8dbf061d4b029ad5103fb096208b, user_id=c0d1453df3ca44d4bb19daa90321ca9c, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:52.167396 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b4826-41c2-4556-b783-2df64ca94e22 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:52.177792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1352/2739] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:52 2022] PUT /identity/v3/projects/2c9f8dbf061d4b029ad5103fb096208b/users/c0d1453df3ca44d4bb19daa90321ca9c/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:20:52.188811 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f636b-6ce5-46e1-b752-ec74ca9a1761 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:52.189218 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f636b-6ce5-46e1-b752-ec74ca9a1761 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:52.189565 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f636b-6ce5-46e1-b752-ec74ca9a1761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:52.217464 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c04f636b-6ce5-46e1-b752-ec74ca9a1761 None None] MFA Rules not processed for user `c0d1453df3ca44d4bb19daa90321ca9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:52.218696 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c04f636b-6ce5-46e1-b752-ec74ca9a1761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:52.287275 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1388/2740] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:52 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:52.298338 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b4826-41c2-4556-b783-2df64ca94e22 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:52.300066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a99b4826-41c2-4556-b783-2df64ca94e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:52.376064 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b4826-41c2-4556-b783-2df64ca94e22 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:52.380277 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d078d0-57f7-46cc-86a0-32315ef0ce51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:52.380914 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d078d0-57f7-46cc-86a0-32315ef0ce51 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:52.381674 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d078d0-57f7-46cc-86a0-32315ef0ce51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:52.381674 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d078d0-57f7-46cc-86a0-32315ef0ce51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:52.391228 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d078d0-57f7-46cc-86a0-32315ef0ce51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:52.392471 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d078d0-57f7-46cc-86a0-32315ef0ce51 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:52.399375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f636b-6ce5-46e1-b752-ec74ca9a1761 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:52.401122 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c04f636b-6ce5-46e1-b752-ec74ca9a1761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:52.404496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1353/2741] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:52 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:20:52.477289 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f636b-6ce5-46e1-b752-ec74ca9a1761 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:52.481893 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:52.482753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:52.483029 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:52.483302 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] PATH_INFO: `/v3/projects/b89f20fc76b54d4693a66994e55ad7cf` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:52.484481 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89f20fc76b54d4693a66994e55ad7cf)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:52.486394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:52.607398 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89f20fc76b54d4693a66994e55ad7cf', 'request_id': 'req-5a83892b-1360-4c01-bf0b-6649baaacfb2'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:52.659496 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89f20fc76b54d4693a66994e55ad7cf', 'request_id': 'req-5a83892b-1360-4c01-bf0b-6649baaacfb2'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:52.666140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89f20fc76b54d4693a66994e55ad7cf', 'request_id': 'req-5a83892b-1360-4c01-bf0b-6649baaacfb2'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:52.677997 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] The token cache is being invalidate because project b89f20fc76b54d4693a66994e55ad7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:20:52.678284 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:52.678971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:20:52.680536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1389/2742] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:20:52 2022] DELETE /identity/v3/projects/b89f20fc76b54d4693a66994e55ad7cf => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:52.686517 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0029e3-df4d-4025-b67d-bd72ee432c80 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:52.689973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0029e3-df4d-4025-b67d-bd72ee432c80 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:52.689973 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0029e3-df4d-4025-b67d-bd72ee432c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:52.705546 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5c0029e3-df4d-4025-b67d-bd72ee432c80 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:52.707168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5c0029e3-df4d-4025-b67d-bd72ee432c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:52.722716 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:52.724259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:52.771350 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1354/2743] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:52.780274 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502872e-c840-4446-adcc-bc80b9a3e3a7 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:52.780667 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502872e-c840-4446-adcc-bc80b9a3e3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:52.781048 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502872e-c840-4446-adcc-bc80b9a3e3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:52.799595 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e502872e-c840-4446-adcc-bc80b9a3e3a7 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:52.801100 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e502872e-c840-4446-adcc-bc80b9a3e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:52.805837 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83892b-1360-4c01-bf0b-6649baaacfb2 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:52.809792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f55170-6a82-41d7-b25d-e563f3f9bc71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:52.810479 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f55170-6a82-41d7-b25d-e563f3f9bc71 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:52.810882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f55170-6a82-41d7-b25d-e563f3f9bc71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:52.811126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f55170-6a82-41d7-b25d-e563f3f9bc71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:52.811318 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1355/2744] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:20:52.813182 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-87f55170-6a82-41d7-b25d-e563f3f9bc71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:52.814753 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502872e-c840-4446-adcc-bc80b9a3e3a7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:52.825474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502872e-c840-4446-adcc-bc80b9a3e3a7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:52.830996 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23475f-39e3-45c7-aba7-de086e0722af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:52.831727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23475f-39e3-45c7-aba7-de086e0722af admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:52.832132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23475f-39e3-45c7-aba7-de086e0722af admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:52.832622 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23475f-39e3-45c7-aba7-de086e0722af admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:52.833640 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23475f-39e3-45c7-aba7-de086e0722af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:20:52.834665 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23475f-39e3-45c7-aba7-de086e0722af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:52.836559 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23475f-39e3-45c7-aba7-de086e0722af admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:52.852627 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1356/2745] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:20:52.857677 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23475f-39e3-45c7-aba7-de086e0722af admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:52.869979 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23475f-39e3-45c7-aba7-de086e0722af admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:52.875405 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107f028-46ce-4c24-a0bf-6a7371700ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:52.876189 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107f028-46ce-4c24-a0bf-6a7371700ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:52.876551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107f028-46ce-4c24-a0bf-6a7371700ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:52.876832 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107f028-46ce-4c24-a0bf-6a7371700ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:52.877572 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5107f028-46ce-4c24-a0bf-6a7371700ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:52.880241 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5107f028-46ce-4c24-a0bf-6a7371700ccc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:52.900192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f55170-6a82-41d7-b25d-e563f3f9bc71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:52.901804 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f55170-6a82-41d7-b25d-e563f3f9bc71 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:52.912534 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1390/2746] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:52 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:20:52.987737 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1357/2747] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:20:52 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:20:52.992312 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f55170-6a82-41d7-b25d-e563f3f9bc71 service cinder] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:53.004478 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f55170-6a82-41d7-b25d-e563f3f9bc71 service cinder] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:53.065297 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031c44b-9174-4e63-ad54-415b37896ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:53.065975 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031c44b-9174-4e63-ad54-415b37896ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:53.066259 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031c44b-9174-4e63-ad54-415b37896ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:53.066535 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031c44b-9174-4e63-ad54-415b37896ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:53.067270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031c44b-9174-4e63-ad54-415b37896ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:53.069260 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031c44b-9174-4e63-ad54-415b37896ea9 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:53.139465 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1391/2748] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:20:52 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:20:53.143866 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107f028-46ce-4c24-a0bf-6a7371700ccc admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:53.154214 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107f028-46ce-4c24-a0bf-6a7371700ccc admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:53.158893 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8380fee-8ae8-406d-8eb5-2682461a2902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:53.159545 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8380fee-8ae8-406d-8eb5-2682461a2902 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:53.159827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8380fee-8ae8-406d-8eb5-2682461a2902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:53.160103 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8380fee-8ae8-406d-8eb5-2682461a2902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:53.161385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8380fee-8ae8-406d-8eb5-2682461a2902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:53.163629 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8380fee-8ae8-406d-8eb5-2682461a2902 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:53.173003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1358/2749] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:53.177489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031c44b-9174-4e63-ad54-415b37896ea9 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:53.187660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031c44b-9174-4e63-ad54-415b37896ea9 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:53.192394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd460f-6ca3-4b17-9c47-891351b89245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:53.193045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd460f-6ca3-4b17-9c47-891351b89245 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:53.193361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd460f-6ca3-4b17-9c47-891351b89245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:53.193642 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd460f-6ca3-4b17-9c47-891351b89245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:53.194369 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd460f-6ca3-4b17-9c47-891351b89245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:53.195961 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd460f-6ca3-4b17-9c47-891351b89245 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:53.205951 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1392/2750] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:20:53.209988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8380fee-8ae8-406d-8eb5-2682461a2902 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:53.219802 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8380fee-8ae8-406d-8eb5-2682461a2902 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:53.225345 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b98927-97f2-4a3b-b95e-bb93f64b8db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:53.230529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b98927-97f2-4a3b-b95e-bb93f64b8db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:53.230529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b98927-97f2-4a3b-b95e-bb93f64b8db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:53.230529 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b98927-97f2-4a3b-b95e-bb93f64b8db4 admin admin] PATH_INFO: `/v3/projects/810a153f99914b7686ae1eb028f5fe38/users/b90e7258574e4b0da39fc309db873a89/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:53.242375 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b98927-97f2-4a3b-b95e-bb93f64b8db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=810a153f99914b7686ae1eb028f5fe38, user_id=b90e7258574e4b0da39fc309db873a89, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:53.245083 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b98927-97f2-4a3b-b95e-bb93f64b8db4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:53.316501 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1359/2751] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:20:53 2022] PUT /identity/v3/projects/810a153f99914b7686ae1eb028f5fe38/users/b90e7258574e4b0da39fc309db873a89/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:20:53.327947 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536c8d5-0cf0-40a4-a938-7a39c635f5d8 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:53.328234 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536c8d5-0cf0-40a4-a938-7a39c635f5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:53.328536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536c8d5-0cf0-40a4-a938-7a39c635f5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:53.355244 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-1536c8d5-0cf0-40a4-a938-7a39c635f5d8 None None] MFA Rules not processed for user `b90e7258574e4b0da39fc309db873a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:20:53.356472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1536c8d5-0cf0-40a4-a938-7a39c635f5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:53.431116 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1393/2752] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:20:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:20:53.443406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b98927-97f2-4a3b-b95e-bb93f64b8db4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:20:53.445130 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f7b98927-97f2-4a3b-b95e-bb93f64b8db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:20:53.499784 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b98927-97f2-4a3b-b95e-bb93f64b8db4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:20:53.503514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04347dc8-fd04-4793-aacb-a10f734c3cf6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42cd381cf5c745de9dac8f77a8cea554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:20:53.504240 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04347dc8-fd04-4793-aacb-a10f734c3cf6 service glance] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:20:53.518155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04347dc8-fd04-4793-aacb-a10f734c3cf6 service glance] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:20:53.518155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04347dc8-fd04-4793-aacb-a10f734c3cf6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:20:53.518155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04347dc8-fd04-4793-aacb-a10f734c3cf6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:20:53.518155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04347dc8-fd04-4793-aacb-a10f734c3cf6 service glance] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:20:53.525663 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1360/2753] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:20:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:21:09.668450 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536c8d5-0cf0-40a4-a938-7a39c635f5d8 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:09.669969 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1536c8d5-0cf0-40a4-a938-7a39c635f5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:09.732667 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536c8d5-0cf0-40a4-a938-7a39c635f5d8 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:09.737264 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80821daa-dd1c-4f29-927a-364d27ca03b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:09.738128 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80821daa-dd1c-4f29-927a-364d27ca03b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:09.738409 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80821daa-dd1c-4f29-927a-364d27ca03b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:09.738681 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80821daa-dd1c-4f29-927a-364d27ca03b2 admin admin] PATH_INFO: `/v3/users/c32c5484c01b4bce85c20628724e4f54` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:09.740399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80821daa-dd1c-4f29-927a-364d27ca03b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32c5484c01b4bce85c20628724e4f54)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:09.742343 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80821daa-dd1c-4f29-927a-364d27ca03b2 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:09.889290 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-80821daa-dd1c-4f29-927a-364d27ca03b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32c5484c01b4bce85c20628724e4f54'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:09.889868 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-80821daa-dd1c-4f29-927a-364d27ca03b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32c5484c01b4bce85c20628724e4f54'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:09.890480 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-80821daa-dd1c-4f29-927a-364d27ca03b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32c5484c01b4bce85c20628724e4f54'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:09.901859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-80821daa-dd1c-4f29-927a-364d27ca03b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32c5484c01b4bce85c20628724e4f54'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:09.908560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-80821daa-dd1c-4f29-927a-364d27ca03b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32c5484c01b4bce85c20628724e4f54'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:09.956226 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1394/2754] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:21:09 2022] DELETE /identity/v3/users/c32c5484c01b4bce85c20628724e4f54 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:21:09.961391 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6bbce-0503-45ea-9e3e-fc717b92293f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:09.961902 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6bbce-0503-45ea-9e3e-fc717b92293f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:09.962011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6bbce-0503-45ea-9e3e-fc717b92293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:09.978602 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-61d6bbce-0503-45ea-9e3e-fc717b92293f None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:09.979792 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-61d6bbce-0503-45ea-9e3e-fc717b92293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:10.034536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1361/2755] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:21:10.044387 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80821daa-dd1c-4f29-927a-364d27ca03b2 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:10.045886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-80821daa-dd1c-4f29-927a-364d27ca03b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:10.113399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80821daa-dd1c-4f29-927a-364d27ca03b2 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:10.117669 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb41508-07f7-4499-b161-3fb1cdd2d643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:10.118323 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb41508-07f7-4499-b161-3fb1cdd2d643 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:10.118608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb41508-07f7-4499-b161-3fb1cdd2d643 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:10.118887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb41508-07f7-4499-b161-3fb1cdd2d643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:10.128057 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb41508-07f7-4499-b161-3fb1cdd2d643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:10.129642 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb41508-07f7-4499-b161-3fb1cdd2d643 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:10.146077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1395/2756] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:21:10.568963 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6bbce-0503-45ea-9e3e-fc717b92293f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:10.570455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-61d6bbce-0503-45ea-9e3e-fc717b92293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:10.582435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6bbce-0503-45ea-9e3e-fc717b92293f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:10.587638 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:10.588554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:10.588834 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:10.589132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] PATH_INFO: `/v3/projects/481479146f3248bb842bd48e207d92c7` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:10.590320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] RBAC: Authorizing `identity:delete_project(project_id=481479146f3248bb842bd48e207d92c7)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:10.592392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:10.767120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481479146f3248bb842bd48e207d92c7', 'request_id': 'req-4927d2c8-4c32-4df4-875c-6ebbc055656f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:10.773622 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481479146f3248bb842bd48e207d92c7', 'request_id': 'req-4927d2c8-4c32-4df4-875c-6ebbc055656f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:10.778760 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481479146f3248bb842bd48e207d92c7', 'request_id': 'req-4927d2c8-4c32-4df4-875c-6ebbc055656f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:10.846551 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] The token cache is being invalidate because project 481479146f3248bb842bd48e207d92c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:21:10.846837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:10.847499 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:10.849773 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1362/2757] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:21:10 2022] DELETE /identity/v3/projects/481479146f3248bb842bd48e207d92c7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:21:10.853728 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb41508-07f7-4499-b161-3fb1cdd2d643 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:10.863249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb41508-07f7-4499-b161-3fb1cdd2d643 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:10.916878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80821d4a-bc33-4d5a-a5ba-8cbe20bab6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:10.917802 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80821d4a-bc33-4d5a-a5ba-8cbe20bab6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:10.918122 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80821d4a-bc33-4d5a-a5ba-8cbe20bab6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:10.918401 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80821d4a-bc33-4d5a-a5ba-8cbe20bab6f9 admin admin] PATH_INFO: `/v3/users/c0d1453df3ca44d4bb19daa90321ca9c` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:10.919582 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80821d4a-bc33-4d5a-a5ba-8cbe20bab6f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d1453df3ca44d4bb19daa90321ca9c)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:10.921543 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80821d4a-bc33-4d5a-a5ba-8cbe20bab6f9 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:11.106154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-80821d4a-bc33-4d5a-a5ba-8cbe20bab6f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d1453df3ca44d4bb19daa90321ca9c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:11.106806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-80821d4a-bc33-4d5a-a5ba-8cbe20bab6f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d1453df3ca44d4bb19daa90321ca9c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:11.107404 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-80821d4a-bc33-4d5a-a5ba-8cbe20bab6f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d1453df3ca44d4bb19daa90321ca9c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:11.120589 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-80821d4a-bc33-4d5a-a5ba-8cbe20bab6f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d1453df3ca44d4bb19daa90321ca9c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:11.128188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-80821d4a-bc33-4d5a-a5ba-8cbe20bab6f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d1453df3ca44d4bb19daa90321ca9c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:11.202028 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1396/2758] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:21:10 2022] DELETE /identity/v3/users/c0d1453df3ca44d4bb19daa90321ca9c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:21:11.603825 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:11.605376 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:11.620695 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927d2c8-4c32-4df4-875c-6ebbc055656f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:11.679890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb95bb-a1de-401c-986e-1e7e7eeb732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:11.680813 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb95bb-a1de-401c-986e-1e7e7eeb732f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:11.681126 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb95bb-a1de-401c-986e-1e7e7eeb732f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:11.683096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb95bb-a1de-401c-986e-1e7e7eeb732f admin admin] PATH_INFO: `/v3/projects/2c9f8dbf061d4b029ad5103fb096208b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:11.683096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb95bb-a1de-401c-986e-1e7e7eeb732f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9f8dbf061d4b029ad5103fb096208b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:11.684594 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb95bb-a1de-401c-986e-1e7e7eeb732f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:11.778532 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-61eb95bb-a1de-401c-986e-1e7e7eeb732f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9f8dbf061d4b029ad5103fb096208b', 'request_id': 'req-61eb95bb-a1de-401c-986e-1e7e7eeb732f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:11.784463 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-61eb95bb-a1de-401c-986e-1e7e7eeb732f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9f8dbf061d4b029ad5103fb096208b', 'request_id': 'req-61eb95bb-a1de-401c-986e-1e7e7eeb732f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:11.789715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-61eb95bb-a1de-401c-986e-1e7e7eeb732f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9f8dbf061d4b029ad5103fb096208b', 'request_id': 'req-61eb95bb-a1de-401c-986e-1e7e7eeb732f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:11.835161 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-61eb95bb-a1de-401c-986e-1e7e7eeb732f admin admin] The token cache is being invalidate because project 2c9f8dbf061d4b029ad5103fb096208b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:21:11.835448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-61eb95bb-a1de-401c-986e-1e7e7eeb732f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:11.836070 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-61eb95bb-a1de-401c-986e-1e7e7eeb732f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:11.837643 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1363/2759] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:21:11 2022] DELETE /identity/v3/projects/2c9f8dbf061d4b029ad5103fb096208b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:21:11.842767 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcef580-0c63-4f75-bc36-76c36f6e673d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:11.843056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcef580-0c63-4f75-bc36-76c36f6e673d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:11.843336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcef580-0c63-4f75-bc36-76c36f6e673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:11.861561 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-1fcef580-0c63-4f75-bc36-76c36f6e673d None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:11.862689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1fcef580-0c63-4f75-bc36-76c36f6e673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:11.920040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1397/2760] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:21:11.927920 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ebcfc-e1d1-4f27-88a6-0a52bb21e80a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:11.928212 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ebcfc-e1d1-4f27-88a6-0a52bb21e80a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:11.928490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ebcfc-e1d1-4f27-88a6-0a52bb21e80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:11.946853 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c24ebcfc-e1d1-4f27-88a6-0a52bb21e80a None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:11.948116 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c24ebcfc-e1d1-4f27-88a6-0a52bb21e80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:11.956095 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1364/2761] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:21:11.960749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcef580-0c63-4f75-bc36-76c36f6e673d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:11.970336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcef580-0c63-4f75-bc36-76c36f6e673d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:11.975121 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5851d-2426-4d14-b6a3-33d879244941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:11.975776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5851d-2426-4d14-b6a3-33d879244941 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:11.976057 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5851d-2426-4d14-b6a3-33d879244941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:11.976358 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5851d-2426-4d14-b6a3-33d879244941 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:11.977112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5851d-2426-4d14-b6a3-33d879244941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:21:11.977425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5851d-2426-4d14-b6a3-33d879244941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:11.979087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5851d-2426-4d14-b6a3-33d879244941 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:11.991155 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1398/2762] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:21:11.995362 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ebcfc-e1d1-4f27-88a6-0a52bb21e80a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:12.004310 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ebcfc-e1d1-4f27-88a6-0a52bb21e80a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:12.009464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336257-7804-4462-94ff-8cf0486bf4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:12.010098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336257-7804-4462-94ff-8cf0486bf4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:12.010374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336257-7804-4462-94ff-8cf0486bf4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:12.010645 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336257-7804-4462-94ff-8cf0486bf4d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:12.011326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05336257-7804-4462-94ff-8cf0486bf4d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:12.013357 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05336257-7804-4462-94ff-8cf0486bf4d0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:12.099604 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1365/2763] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:21:11 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:21:12.103679 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5851d-2426-4d14-b6a3-33d879244941 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:12.113738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5851d-2426-4d14-b6a3-33d879244941 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:12.168199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9ced7-1c17-4a5d-879a-1fde5efeedbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:12.168869 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9ced7-1c17-4a5d-879a-1fde5efeedbe admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:12.169183 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9ced7-1c17-4a5d-879a-1fde5efeedbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:12.169461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9ced7-1c17-4a5d-879a-1fde5efeedbe admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:12.170140 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9ced7-1c17-4a5d-879a-1fde5efeedbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:12.172045 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9ced7-1c17-4a5d-879a-1fde5efeedbe admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:12.230528 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1399/2764] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:21:12 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:21:12.234630 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336257-7804-4462-94ff-8cf0486bf4d0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:12.245508 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336257-7804-4462-94ff-8cf0486bf4d0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:12.250249 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa124d33-eaf5-4f6f-9b3b-e9a07515eb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:12.250887 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa124d33-eaf5-4f6f-9b3b-e9a07515eb41 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:12.251164 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa124d33-eaf5-4f6f-9b3b-e9a07515eb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:12.251435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa124d33-eaf5-4f6f-9b3b-e9a07515eb41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:12.252256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa124d33-eaf5-4f6f-9b3b-e9a07515eb41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:12.253938 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa124d33-eaf5-4f6f-9b3b-e9a07515eb41 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:12.264554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1366/2765] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:21:12.268385 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9ced7-1c17-4a5d-879a-1fde5efeedbe admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:12.278332 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9ced7-1c17-4a5d-879a-1fde5efeedbe admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:12.282948 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106aeb6-0fec-4e91-81ea-0155f8558429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:12.283602 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106aeb6-0fec-4e91-81ea-0155f8558429 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:12.283886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106aeb6-0fec-4e91-81ea-0155f8558429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:12.284163 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106aeb6-0fec-4e91-81ea-0155f8558429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:12.284883 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106aeb6-0fec-4e91-81ea-0155f8558429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:12.286507 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106aeb6-0fec-4e91-81ea-0155f8558429 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:12.296415 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1400/2766] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:21:12.300419 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa124d33-eaf5-4f6f-9b3b-e9a07515eb41 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:12.310714 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa124d33-eaf5-4f6f-9b3b-e9a07515eb41 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:12.315374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc9c2c-d165-48dd-b940-224c5c4aa9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:12.316229 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9c2c-d165-48dd-b940-224c5c4aa9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:12.316509 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9c2c-d165-48dd-b940-224c5c4aa9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:12.316782 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9c2c-d165-48dd-b940-224c5c4aa9e5 admin admin] PATH_INFO: `/v3/projects/6b02898c590e46eabed616906ff7c3b8/users/4452821cc583400b92b21824480e8705/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:12.331197 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc9c2c-d165-48dd-b940-224c5c4aa9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b02898c590e46eabed616906ff7c3b8, user_id=4452821cc583400b92b21824480e8705, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:12.333888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc9c2c-d165-48dd-b940-224c5c4aa9e5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:12.392266 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1367/2767] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:21:12 2022] PUT /identity/v3/projects/6b02898c590e46eabed616906ff7c3b8/users/4452821cc583400b92b21824480e8705/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:21:12.405663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82550a2-936c-462c-84cd-efece60e54b5 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:12.405663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82550a2-936c-462c-84cd-efece60e54b5 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:12.405663 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82550a2-936c-462c-84cd-efece60e54b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:12.433881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-f82550a2-936c-462c-84cd-efece60e54b5 None None] MFA Rules not processed for user `4452821cc583400b92b21824480e8705`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:12.435099 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f82550a2-936c-462c-84cd-efece60e54b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:12.498625 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1401/2768] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:21:12.510364 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc9c2c-d165-48dd-b940-224c5c4aa9e5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:12.512069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-33dc9c2c-d165-48dd-b940-224c5c4aa9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:12.568927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc9c2c-d165-48dd-b940-224c5c4aa9e5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:12.572644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413cab3-620c-4064-9382-d5368cf5f51b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:12.573298 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413cab3-620c-4064-9382-d5368cf5f51b service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:12.573581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413cab3-620c-4064-9382-d5368cf5f51b service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:12.573896 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413cab3-620c-4064-9382-d5368cf5f51b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:12.582048 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413cab3-620c-4064-9382-d5368cf5f51b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:12.583561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413cab3-620c-4064-9382-d5368cf5f51b service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:12.592774 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1368/2769] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:21:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:21:12.612782 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82550a2-936c-462c-84cd-efece60e54b5 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:12.677484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82550a2-936c-462c-84cd-efece60e54b5 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:12.682465 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b05c2b-8fa8-4b4b-86fc-6dfedd7e111d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:12.688197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b05c2b-8fa8-4b4b-86fc-6dfedd7e111d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:12.688197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b05c2b-8fa8-4b4b-86fc-6dfedd7e111d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:12.688197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b05c2b-8fa8-4b4b-86fc-6dfedd7e111d admin admin] PATH_INFO: `/v3/users/4452821cc583400b92b21824480e8705` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:12.688197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b05c2b-8fa8-4b4b-86fc-6dfedd7e111d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4452821cc583400b92b21824480e8705)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:12.688197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b05c2b-8fa8-4b4b-86fc-6dfedd7e111d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:12.848953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-64b05c2b-8fa8-4b4b-86fc-6dfedd7e111d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4452821cc583400b92b21824480e8705'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:12.849677 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-64b05c2b-8fa8-4b4b-86fc-6dfedd7e111d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4452821cc583400b92b21824480e8705'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:12.850304 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-64b05c2b-8fa8-4b4b-86fc-6dfedd7e111d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4452821cc583400b92b21824480e8705'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:12.862029 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-64b05c2b-8fa8-4b4b-86fc-6dfedd7e111d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4452821cc583400b92b21824480e8705'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:12.869100 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-64b05c2b-8fa8-4b4b-86fc-6dfedd7e111d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4452821cc583400b92b21824480e8705'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:12.921606 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1402/2770] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:21:12 2022] DELETE /identity/v3/users/4452821cc583400b92b21824480e8705 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:21:12.926467 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fca78-1262-4c1b-b684-03c2a39640d1 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:12.926927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fca78-1262-4c1b-b684-03c2a39640d1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:12.927124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fca78-1262-4c1b-b684-03c2a39640d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:12.944837 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-478fca78-1262-4c1b-b684-03c2a39640d1 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:12.946156 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-478fca78-1262-4c1b-b684-03c2a39640d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:13.004143 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1369/2771] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:21:13.014523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b05c2b-8fa8-4b4b-86fc-6dfedd7e111d admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:13.016009 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-64b05c2b-8fa8-4b4b-86fc-6dfedd7e111d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:13.072341 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b05c2b-8fa8-4b4b-86fc-6dfedd7e111d admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:13.076017 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc43ea-c563-4ffd-869b-27e0a3636753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:13.076656 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc43ea-c563-4ffd-869b-27e0a3636753 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:13.076939 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc43ea-c563-4ffd-869b-27e0a3636753 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:13.077244 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc43ea-c563-4ffd-869b-27e0a3636753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:13.086323 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc43ea-c563-4ffd-869b-27e0a3636753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:13.087747 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc43ea-c563-4ffd-869b-27e0a3636753 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:13.097282 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1403/2772] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:21:13.449326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fca78-1262-4c1b-b684-03c2a39640d1 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:13.450751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-478fca78-1262-4c1b-b684-03c2a39640d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:13.463661 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fca78-1262-4c1b-b684-03c2a39640d1 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:13.468261 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:13.469649 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:13.470100 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:13.470466 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] PATH_INFO: `/v3/projects/6b02898c590e46eabed616906ff7c3b8` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:13.471623 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b02898c590e46eabed616906ff7c3b8)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:13.473655 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:13.560721 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b02898c590e46eabed616906ff7c3b8', 'request_id': 'req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:13.566640 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b02898c590e46eabed616906ff7c3b8', 'request_id': 'req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:13.571821 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b02898c590e46eabed616906ff7c3b8', 'request_id': 'req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:13.640868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] The token cache is being invalidate because project 6b02898c590e46eabed616906ff7c3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:21:13.641182 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:13.641797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:13.643315 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1370/2773] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:21:13 2022] DELETE /identity/v3/projects/6b02898c590e46eabed616906ff7c3b8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:21:13.649957 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665b940-55de-4b98-91d4-d2b37942ef74 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:13.650336 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665b940-55de-4b98-91d4-d2b37942ef74 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:13.650678 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665b940-55de-4b98-91d4-d2b37942ef74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:13.672612 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-f665b940-55de-4b98-91d4-d2b37942ef74 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:13.673881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f665b940-55de-4b98-91d4-d2b37942ef74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:13.680067 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:13.681684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:13.735580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1404/2774] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:21:13.744446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ed70b-19a3-467e-8d92-683c10746f22 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:13.744733 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ed70b-19a3-467e-8d92-683c10746f22 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:13.745008 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ed70b-19a3-467e-8d92-683c10746f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:13.748190 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44d8c4-d5b8-4ea4-9d0b-d1209d2f6e3b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:13.752870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bcd1e-116d-4a54-8646-9cdfeef517d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:13.753786 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bcd1e-116d-4a54-8646-9cdfeef517d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:13.754067 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bcd1e-116d-4a54-8646-9cdfeef517d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:13.754373 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bcd1e-116d-4a54-8646-9cdfeef517d2 admin admin] PATH_INFO: `/v3/users/10294300f2e1491aa9269a3791583227` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:13.755561 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bcd1e-116d-4a54-8646-9cdfeef517d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10294300f2e1491aa9269a3791583227)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:13.757714 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bcd1e-116d-4a54-8646-9cdfeef517d2 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:13.762481 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7b7ed70b-19a3-467e-8d92-683c10746f22 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:13.763777 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7b7ed70b-19a3-467e-8d92-683c10746f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:13.772427 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1405/2775] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:21:13.776532 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ed70b-19a3-467e-8d92-683c10746f22 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:13.785418 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ed70b-19a3-467e-8d92-683c10746f22 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:13.790613 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef740ab6-182e-42c0-a5f9-059d7b06da35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:13.794778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef740ab6-182e-42c0-a5f9-059d7b06da35 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:13.794778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef740ab6-182e-42c0-a5f9-059d7b06da35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:13.794778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef740ab6-182e-42c0-a5f9-059d7b06da35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:13.794778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef740ab6-182e-42c0-a5f9-059d7b06da35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:21:13.794778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef740ab6-182e-42c0-a5f9-059d7b06da35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:13.794778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef740ab6-182e-42c0-a5f9-059d7b06da35 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:13.805644 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1406/2776] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 11:21:13.810106 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef740ab6-182e-42c0-a5f9-059d7b06da35 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:13.819860 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef740ab6-182e-42c0-a5f9-059d7b06da35 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:13.824354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6267f-65c9-4894-a744-3e587e147189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:13.824938 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6267f-65c9-4894-a744-3e587e147189 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:13.825249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6267f-65c9-4894-a744-3e587e147189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:13.825521 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6267f-65c9-4894-a744-3e587e147189 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:13.826188 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6267f-65c9-4894-a744-3e587e147189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:13.828019 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6267f-65c9-4894-a744-3e587e147189 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:13.923073 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1407/2777] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:21:13 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:21:13.927044 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6267f-65c9-4894-a744-3e587e147189 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:13.934522 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7b2bcd1e-116d-4a54-8646-9cdfeef517d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10294300f2e1491aa9269a3791583227'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:13.935379 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7b2bcd1e-116d-4a54-8646-9cdfeef517d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10294300f2e1491aa9269a3791583227'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:13.935989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7b2bcd1e-116d-4a54-8646-9cdfeef517d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10294300f2e1491aa9269a3791583227'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:13.985820 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6267f-65c9-4894-a744-3e587e147189 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:13.990406 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568be11a-a87e-41da-8443-569aa3f66b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:13.991056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568be11a-a87e-41da-8443-569aa3f66b02 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:13.991340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568be11a-a87e-41da-8443-569aa3f66b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:13.991618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568be11a-a87e-41da-8443-569aa3f66b02 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:13.992294 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568be11a-a87e-41da-8443-569aa3f66b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:13.994238 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568be11a-a87e-41da-8443-569aa3f66b02 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:14.007904 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7b2bcd1e-116d-4a54-8646-9cdfeef517d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10294300f2e1491aa9269a3791583227'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:14.020744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7b2bcd1e-116d-4a54-8646-9cdfeef517d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10294300f2e1491aa9269a3791583227'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:14.033291 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1371/2778] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:21:13 2022] DELETE /identity/v3/users/10294300f2e1491aa9269a3791583227 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:21:14.037772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f168c5e-bd61-4e3c-9179-9ff6c874b9b4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:14.038061 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f168c5e-bd61-4e3c-9179-9ff6c874b9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:14.038336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f168c5e-bd61-4e3c-9179-9ff6c874b9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:14.054850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2f168c5e-bd61-4e3c-9179-9ff6c874b9b4 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:14.056064 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2f168c5e-bd61-4e3c-9179-9ff6c874b9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:14.096279 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1408/2779] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:21:13 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:21:14.097633 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568be11a-a87e-41da-8443-569aa3f66b02 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:14.099361 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-568be11a-a87e-41da-8443-569aa3f66b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:14.110901 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568be11a-a87e-41da-8443-569aa3f66b02 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:14.115969 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1372/2780] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:21:14.116101 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ea318-f927-431d-93c7-cf7a8e692b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:14.116101 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ea318-f927-431d-93c7-cf7a8e692b83 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:14.116370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ea318-f927-431d-93c7-cf7a8e692b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:14.116643 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ea318-f927-431d-93c7-cf7a8e692b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:14.117394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ea318-f927-431d-93c7-cf7a8e692b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:14.118972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ea318-f927-431d-93c7-cf7a8e692b83 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:14.124179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f168c5e-bd61-4e3c-9179-9ff6c874b9b4 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:14.125546 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2f168c5e-bd61-4e3c-9179-9ff6c874b9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:14.129266 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1409/2781] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:21:14.133521 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ea318-f927-431d-93c7-cf7a8e692b83 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:14.142904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ea318-f927-431d-93c7-cf7a8e692b83 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:14.148126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8aa4e3-9276-4335-8654-129a4224c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:14.148761 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aa4e3-9276-4335-8654-129a4224c6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:14.149040 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aa4e3-9276-4335-8654-129a4224c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:14.149337 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aa4e3-9276-4335-8654-129a4224c6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:14.150041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8aa4e3-9276-4335-8654-129a4224c6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:14.151597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8aa4e3-9276-4335-8654-129a4224c6e0 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:14.164277 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1410/2782] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 11:21:14.165276 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8aa4e3-9276-4335-8654-129a4224c6e0 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:14.174688 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8aa4e3-9276-4335-8654-129a4224c6e0 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:14.179229 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4f479-cb70-4a5b-b5f3-ae23d14214cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:14.180154 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4f479-cb70-4a5b-b5f3-ae23d14214cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:14.180355 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4f479-cb70-4a5b-b5f3-ae23d14214cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:14.180627 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4f479-cb70-4a5b-b5f3-ae23d14214cd admin admin] PATH_INFO: `/v3/projects/228ce5fb39b746459557caa1ee18daff/users/b727078a46bf4c9b9eebbba43d895042/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:14.181146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f168c5e-bd61-4e3c-9179-9ff6c874b9b4 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:14.184732 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac03633-634c-49ed-ae13-6e5139de13c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:14.185391 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac03633-634c-49ed-ae13-6e5139de13c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:14.185673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac03633-634c-49ed-ae13-6e5139de13c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:14.185948 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac03633-634c-49ed-ae13-6e5139de13c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:14.195212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4f479-cb70-4a5b-b5f3-ae23d14214cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=228ce5fb39b746459557caa1ee18daff, user_id=b727078a46bf4c9b9eebbba43d895042, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:14.195539 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac03633-634c-49ed-ae13-6e5139de13c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:14.197003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac03633-634c-49ed-ae13-6e5139de13c6 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:14.197893 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4f479-cb70-4a5b-b5f3-ae23d14214cd admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:14.206392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1373/2783] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:21:14.260501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1411/2784] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:21:14 2022] PUT /identity/v3/projects/228ce5fb39b746459557caa1ee18daff/users/b727078a46bf4c9b9eebbba43d895042/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:21:14.265693 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d45ad-43fe-40cf-80a2-732818664c99 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:14.265984 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d45ad-43fe-40cf-80a2-732818664c99 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:14.266289 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d45ad-43fe-40cf-80a2-732818664c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:14.286381 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-571d45ad-43fe-40cf-80a2-732818664c99 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:14.287501 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-571d45ad-43fe-40cf-80a2-732818664c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:14.346435 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1374/2785] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:21:14.356145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4f479-cb70-4a5b-b5f3-ae23d14214cd admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:14.413174 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4f479-cb70-4a5b-b5f3-ae23d14214cd admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:14.417205 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c9bd1-c042-4334-b560-ab17ea7b5ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:14.417859 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c9bd1-c042-4334-b560-ab17ea7b5ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:14.418145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c9bd1-c042-4334-b560-ab17ea7b5ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:14.418807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c9bd1-c042-4334-b560-ab17ea7b5ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:14.429715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c9bd1-c042-4334-b560-ab17ea7b5ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:14.435673 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c9bd1-c042-4334-b560-ab17ea7b5ae3 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:14.442903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1412/2786] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:21:14.605171 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d45ad-43fe-40cf-80a2-732818664c99 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:14.606707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-571d45ad-43fe-40cf-80a2-732818664c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:14.619300 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d45ad-43fe-40cf-80a2-732818664c99 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:14.624162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be62af-6d9f-489d-8adc-30dc9a6497a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:14.625000 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be62af-6d9f-489d-8adc-30dc9a6497a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:14.625385 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be62af-6d9f-489d-8adc-30dc9a6497a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:14.625615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be62af-6d9f-489d-8adc-30dc9a6497a5 admin admin] PATH_INFO: `/v3/projects/e0c7911afdc44fc1b5ca7ebde8807f1c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:14.626845 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be62af-6d9f-489d-8adc-30dc9a6497a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c7911afdc44fc1b5ca7ebde8807f1c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:14.628888 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be62af-6d9f-489d-8adc-30dc9a6497a5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:14.717707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16be62af-6d9f-489d-8adc-30dc9a6497a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c7911afdc44fc1b5ca7ebde8807f1c', 'request_id': 'req-16be62af-6d9f-489d-8adc-30dc9a6497a5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:14.725139 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16be62af-6d9f-489d-8adc-30dc9a6497a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c7911afdc44fc1b5ca7ebde8807f1c', 'request_id': 'req-16be62af-6d9f-489d-8adc-30dc9a6497a5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:14.730752 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16be62af-6d9f-489d-8adc-30dc9a6497a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c7911afdc44fc1b5ca7ebde8807f1c', 'request_id': 'req-16be62af-6d9f-489d-8adc-30dc9a6497a5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:14.801405 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16be62af-6d9f-489d-8adc-30dc9a6497a5 admin admin] The token cache is being invalidate because project e0c7911afdc44fc1b5ca7ebde8807f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:21:14.804406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16be62af-6d9f-489d-8adc-30dc9a6497a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:14.804406 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16be62af-6d9f-489d-8adc-30dc9a6497a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:14.804596 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1375/2787] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:21:14 2022] DELETE /identity/v3/projects/e0c7911afdc44fc1b5ca7ebde8807f1c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:21:14.809375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea51f08-571d-41fa-a75b-0ef15e24c782 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:14.809666 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea51f08-571d-41fa-a75b-0ef15e24c782 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:14.809942 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea51f08-571d-41fa-a75b-0ef15e24c782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:14.827849 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-aea51f08-571d-41fa-a75b-0ef15e24c782 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:14.829077 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-aea51f08-571d-41fa-a75b-0ef15e24c782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:14.886857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1413/2788] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:21:14.894937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dde40b-f027-4a99-af45-a5b0dc35fc39 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:14.895226 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dde40b-f027-4a99-af45-a5b0dc35fc39 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:14.895500 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dde40b-f027-4a99-af45-a5b0dc35fc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:14.914285 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d2dde40b-f027-4a99-af45-a5b0dc35fc39 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:14.915498 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d2dde40b-f027-4a99-af45-a5b0dc35fc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:14.923747 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1376/2789] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:21:14.928627 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea51f08-571d-41fa-a75b-0ef15e24c782 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:14.939166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea51f08-571d-41fa-a75b-0ef15e24c782 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:14.944387 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42412c-98e6-4841-bca9-97bc6e77eba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:14.945170 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42412c-98e6-4841-bca9-97bc6e77eba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:14.945459 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42412c-98e6-4841-bca9-97bc6e77eba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:14.945738 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42412c-98e6-4841-bca9-97bc6e77eba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:14.946472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42412c-98e6-4841-bca9-97bc6e77eba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:21:14.946786 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42412c-98e6-4841-bca9-97bc6e77eba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:14.948617 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42412c-98e6-4841-bca9-97bc6e77eba1 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:14.961240 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1414/2790] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:21:14.965622 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dde40b-f027-4a99-af45-a5b0dc35fc39 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:14.975720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dde40b-f027-4a99-af45-a5b0dc35fc39 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:14.980631 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2710a-7414-4521-8886-861e61f0ea96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:14.981346 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2710a-7414-4521-8886-861e61f0ea96 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:14.981627 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2710a-7414-4521-8886-861e61f0ea96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:14.981897 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2710a-7414-4521-8886-861e61f0ea96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:14.982625 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2710a-7414-4521-8886-861e61f0ea96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:14.984660 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2710a-7414-4521-8886-861e61f0ea96 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:15.072372 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1377/2791] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:21:14 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:21:15.076484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42412c-98e6-4841-bca9-97bc6e77eba1 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:15.087013 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42412c-98e6-4841-bca9-97bc6e77eba1 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:15.143792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9737b-74d2-4ba4-814b-ddaa3448eb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:15.144625 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9737b-74d2-4ba4-814b-ddaa3448eb3e admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:15.144920 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9737b-74d2-4ba4-814b-ddaa3448eb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:15.145237 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9737b-74d2-4ba4-814b-ddaa3448eb3e admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:15.145931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9737b-74d2-4ba4-814b-ddaa3448eb3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:15.148396 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9737b-74d2-4ba4-814b-ddaa3448eb3e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:15.250809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1415/2792] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:21:15 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:21:15.252013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2710a-7414-4521-8886-861e61f0ea96 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:15.262619 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2710a-7414-4521-8886-861e61f0ea96 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:15.267248 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9c559-8504-4669-a905-4af9f979fd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:15.267895 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9c559-8504-4669-a905-4af9f979fd33 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:15.268176 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9c559-8504-4669-a905-4af9f979fd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:15.268455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9c559-8504-4669-a905-4af9f979fd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:15.269260 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f9c559-8504-4669-a905-4af9f979fd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:15.270886 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f9c559-8504-4669-a905-4af9f979fd33 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:15.281505 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1378/2793] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:21:15.285228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9737b-74d2-4ba4-814b-ddaa3448eb3e admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:15.296109 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9737b-74d2-4ba4-814b-ddaa3448eb3e admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:15.301221 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc8a88-388a-4571-84b4-6a9e52083eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:15.301884 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc8a88-388a-4571-84b4-6a9e52083eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:15.302169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc8a88-388a-4571-84b4-6a9e52083eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:15.302443 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc8a88-388a-4571-84b4-6a9e52083eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:15.303192 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc8a88-388a-4571-84b4-6a9e52083eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:15.304780 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc8a88-388a-4571-84b4-6a9e52083eb2 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:15.319668 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1416/2794] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:21:15.320711 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9c559-8504-4669-a905-4af9f979fd33 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:15.331025 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9c559-8504-4669-a905-4af9f979fd33 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:15.337031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a65e4-aa3a-4b96-b259-228dac2ac51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:15.337961 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a65e4-aa3a-4b96-b259-228dac2ac51b admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:15.338251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a65e4-aa3a-4b96-b259-228dac2ac51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:15.338686 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a65e4-aa3a-4b96-b259-228dac2ac51b admin admin] PATH_INFO: `/v3/projects/2fb98a0637ef4dde8ca896834b10be9d/users/429110b58f8946e4ba51df006cd31c89/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:15.361694 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a65e4-aa3a-4b96-b259-228dac2ac51b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb98a0637ef4dde8ca896834b10be9d, user_id=429110b58f8946e4ba51df006cd31c89, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:15.365269 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a65e4-aa3a-4b96-b259-228dac2ac51b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:15.425220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1379/2795] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:21:15 2022] PUT /identity/v3/projects/2fb98a0637ef4dde8ca896834b10be9d/users/429110b58f8946e4ba51df006cd31c89/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:21:15.436588 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338beb3-9dbd-4dc4-8369-82576e44e211 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:15.436878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338beb3-9dbd-4dc4-8369-82576e44e211 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:15.437197 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338beb3-9dbd-4dc4-8369-82576e44e211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:15.464342 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0338beb3-9dbd-4dc4-8369-82576e44e211 None None] MFA Rules not processed for user `429110b58f8946e4ba51df006cd31c89`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:15.465580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0338beb3-9dbd-4dc4-8369-82576e44e211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:15.534401 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1417/2796] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:21:15.544702 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a65e4-aa3a-4b96-b259-228dac2ac51b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:15.546541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-444a65e4-aa3a-4b96-b259-228dac2ac51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:15.568060 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9614e-212f-4d1a-bcbe-327bed95bd86 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:15.569789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9614e-212f-4d1a-bcbe-327bed95bd86 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:15.569789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9614e-212f-4d1a-bcbe-327bed95bd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:15.599452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-01d9614e-212f-4d1a-bcbe-327bed95bd86 None None] MFA Rules not processed for user `b727078a46bf4c9b9eebbba43d895042`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:15.600854 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-01d9614e-212f-4d1a-bcbe-327bed95bd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:15.616646 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a65e4-aa3a-4b96-b259-228dac2ac51b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:15.622163 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b59bd-8c57-40c1-9d6a-69ce11db6ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:15.622926 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b59bd-8c57-40c1-9d6a-69ce11db6ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:15.623737 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b59bd-8c57-40c1-9d6a-69ce11db6ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:15.624118 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b59bd-8c57-40c1-9d6a-69ce11db6ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:15.633609 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b59bd-8c57-40c1-9d6a-69ce11db6ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:15.635227 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b59bd-8c57-40c1-9d6a-69ce11db6ca9 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:15.644803 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1380/2797] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:21:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:21:15.677506 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1418/2798] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:21:15.686405 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b59bd-8c57-40c1-9d6a-69ce11db6ca9 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:15.688138 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-539b59bd-8c57-40c1-9d6a-69ce11db6ca9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:15.701285 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b59bd-8c57-40c1-9d6a-69ce11db6ca9 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:15.705148 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63635b3-9a65-45ac-9849-e328be5ba3c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:15.705790 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63635b3-9a65-45ac-9849-e328be5ba3c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:15.706074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63635b3-9a65-45ac-9849-e328be5ba3c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:15.706349 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63635b3-9a65-45ac-9849-e328be5ba3c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:15.716167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63635b3-9a65-45ac-9849-e328be5ba3c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:15.717779 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63635b3-9a65-45ac-9849-e328be5ba3c4 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:15.726786 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1381/2799] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:21:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:21:18.420455 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e0348-acd6-4c2a-9e38-060cdff693fb None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:18.421026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e0348-acd6-4c2a-9e38-060cdff693fb None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:18.421026 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e0348-acd6-4c2a-9e38-060cdff693fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:18.440343 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d35e0348-acd6-4c2a-9e38-060cdff693fb None None] MFA Rules not processed for user `b727078a46bf4c9b9eebbba43d895042`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:18.441640 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d35e0348-acd6-4c2a-9e38-060cdff693fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:18.448674 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1419/2800] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:21:18.689198 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63635b3-9a65-45ac-9849-e328be5ba3c4 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:18.690784 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a63635b3-9a65-45ac-9849-e328be5ba3c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:18.747067 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63635b3-9a65-45ac-9849-e328be5ba3c4 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:18.751189 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695874f-3f40-4c6c-99cd-7fa68c18c7e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:18.751827 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695874f-3f40-4c6c-99cd-7fa68c18c7e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:18.752107 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695874f-3f40-4c6c-99cd-7fa68c18c7e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:18.752379 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695874f-3f40-4c6c-99cd-7fa68c18c7e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:18.754147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d695874f-3f40-4c6c-99cd-7fa68c18c7e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:18.764168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695874f-3f40-4c6c-99cd-7fa68c18c7e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:18.765656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695874f-3f40-4c6c-99cd-7fa68c18c7e5 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:18.773642 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1382/2801] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:21:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:21:19.160229 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e0348-acd6-4c2a-9e38-060cdff693fb None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:19.161691 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d35e0348-acd6-4c2a-9e38-060cdff693fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:19.230882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e0348-acd6-4c2a-9e38-060cdff693fb None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:19.235857 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6795ab-4319-4da2-aeb0-02f36f29edae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd095449a5b44c6b1c9aca712edc11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:19.236499 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6795ab-4319-4da2-aeb0-02f36f29edae service placement] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:19.236778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6795ab-4319-4da2-aeb0-02f36f29edae service placement] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:19.237075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6795ab-4319-4da2-aeb0-02f36f29edae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:19.239166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7a6795ab-4319-4da2-aeb0-02f36f29edae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:19.251002 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6795ab-4319-4da2-aeb0-02f36f29edae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:19.252560 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6795ab-4319-4da2-aeb0-02f36f29edae service placement] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:19.262325 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1420/2802] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:21:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:21:42.184496 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695874f-3f40-4c6c-99cd-7fa68c18c7e5 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:42.186087 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d695874f-3f40-4c6c-99cd-7fa68c18c7e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:42.268748 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695874f-3f40-4c6c-99cd-7fa68c18c7e5 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:42.275928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88494412-1fa7-47ca-9301-d522f84460c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:42.276660 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88494412-1fa7-47ca-9301-d522f84460c7 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:42.276985 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88494412-1fa7-47ca-9301-d522f84460c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:42.278002 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88494412-1fa7-47ca-9301-d522f84460c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:42.279820 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-88494412-1fa7-47ca-9301-d522f84460c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:42.293380 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88494412-1fa7-47ca-9301-d522f84460c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:42.295013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88494412-1fa7-47ca-9301-d522f84460c7 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:42.307067 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1383/2803] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:21:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:21:46.888789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6795ab-4319-4da2-aeb0-02f36f29edae service placement] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:46.949486 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6795ab-4319-4da2-aeb0-02f36f29edae service placement] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:46.954148 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2ce79-e833-42c7-8340-08cf9ed0111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:46.955025 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2ce79-e833-42c7-8340-08cf9ed0111a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:46.955305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2ce79-e833-42c7-8340-08cf9ed0111a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:46.955708 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2ce79-e833-42c7-8340-08cf9ed0111a admin admin] PATH_INFO: `/v3/users/429110b58f8946e4ba51df006cd31c89` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:46.956753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2ce79-e833-42c7-8340-08cf9ed0111a admin admin] RBAC: Authorizing `identity:delete_user(user_id=429110b58f8946e4ba51df006cd31c89)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:46.958685 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2ce79-e833-42c7-8340-08cf9ed0111a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:47.094314 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4ec2ce79-e833-42c7-8340-08cf9ed0111a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429110b58f8946e4ba51df006cd31c89'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:47.094996 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4ec2ce79-e833-42c7-8340-08cf9ed0111a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429110b58f8946e4ba51df006cd31c89'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:47.095812 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4ec2ce79-e833-42c7-8340-08cf9ed0111a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429110b58f8946e4ba51df006cd31c89'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:47.108043 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4ec2ce79-e833-42c7-8340-08cf9ed0111a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429110b58f8946e4ba51df006cd31c89'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:47.115029 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4ec2ce79-e833-42c7-8340-08cf9ed0111a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429110b58f8946e4ba51df006cd31c89'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:47.179684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1421/2804] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:21:46 2022] DELETE /identity/v3/users/429110b58f8946e4ba51df006cd31c89 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:21:47.184577 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0686aaa-c5c8-48ef-bd73-700e66c45ebb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:47.185039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0686aaa-c5c8-48ef-bd73-700e66c45ebb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:47.185162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0686aaa-c5c8-48ef-bd73-700e66c45ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:47.201959 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f0686aaa-c5c8-48ef-bd73-700e66c45ebb None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:21:47.203231 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f0686aaa-c5c8-48ef-bd73-700e66c45ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:47.263968 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1384/2805] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:21:47.275181 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2ce79-e833-42c7-8340-08cf9ed0111a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:47.276633 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4ec2ce79-e833-42c7-8340-08cf9ed0111a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:47.338216 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2ce79-e833-42c7-8340-08cf9ed0111a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:47.342109 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91f3eb-d3f3-4180-9c13-b27501853f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:47.343008 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f3eb-d3f3-4180-9c13-b27501853f21 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:47.343478 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f3eb-d3f3-4180-9c13-b27501853f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:47.343755 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f3eb-d3f3-4180-9c13-b27501853f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:47.353897 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91f3eb-d3f3-4180-9c13-b27501853f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:47.355390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91f3eb-d3f3-4180-9c13-b27501853f21 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:47.366627 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1422/2806] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:21:47.854037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0686aaa-c5c8-48ef-bd73-700e66c45ebb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:47.855490 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f0686aaa-c5c8-48ef-bd73-700e66c45ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:47.869911 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0686aaa-c5c8-48ef-bd73-700e66c45ebb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:47.875743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:47.876477 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:47.876728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:47.877004 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28 admin admin] PATH_INFO: `/v3/projects/2fb98a0637ef4dde8ca896834b10be9d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:47.878271 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb98a0637ef4dde8ca896834b10be9d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:47.880124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:21:47.972598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb98a0637ef4dde8ca896834b10be9d', 'request_id': 'req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:47.978596 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb98a0637ef4dde8ca896834b10be9d', 'request_id': 'req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:47.983786 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb98a0637ef4dde8ca896834b10be9d', 'request_id': 'req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:48.046606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28 admin admin] The token cache is being invalidate because project 2fb98a0637ef4dde8ca896834b10be9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:21:48.046889 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:48.047580 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-10c130ec-2d5f-4ec6-92d8-f51453ee0d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:21:48.049140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1385/2807] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:21:47 2022] DELETE /identity/v3/projects/2fb98a0637ef4dde8ca896834b10be9d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:21:59.903091 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91f3eb-d3f3-4180-9c13-b27501853f21 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:21:59.904595 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7a91f3eb-d3f3-4180-9c13-b27501853f21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:21:59.918525 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91f3eb-d3f3-4180-9c13-b27501853f21 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:21:59.974235 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc179f01-5276-4d80-bb8c-a3611f921c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:21:59.975112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc179f01-5276-4d80-bb8c-a3611f921c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:21:59.975395 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc179f01-5276-4d80-bb8c-a3611f921c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:21:59.975673 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc179f01-5276-4d80-bb8c-a3611f921c0d admin admin] PATH_INFO: `/v3/users/b90e7258574e4b0da39fc309db873a89` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:21:59.976852 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc179f01-5276-4d80-bb8c-a3611f921c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90e7258574e4b0da39fc309db873a89)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:21:59.979425 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc179f01-5276-4d80-bb8c-a3611f921c0d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:00.174429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-dc179f01-5276-4d80-bb8c-a3611f921c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90e7258574e4b0da39fc309db873a89'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:22:00.175094 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-dc179f01-5276-4d80-bb8c-a3611f921c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90e7258574e4b0da39fc309db873a89'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:22:00.175706 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-dc179f01-5276-4d80-bb8c-a3611f921c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90e7258574e4b0da39fc309db873a89'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:22:00.187689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-dc179f01-5276-4d80-bb8c-a3611f921c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90e7258574e4b0da39fc309db873a89'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:22:00.194398 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-dc179f01-5276-4d80-bb8c-a3611f921c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90e7258574e4b0da39fc309db873a89'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:22:00.243268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1423/2808] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:21:59 2022] DELETE /identity/v3/users/b90e7258574e4b0da39fc309db873a89 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:22:00.244864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5776ed-8449-4055-a278-60a0e5e4136c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:00.248130 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5776ed-8449-4055-a278-60a0e5e4136c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:00.248130 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5776ed-8449-4055-a278-60a0e5e4136c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:00.267696 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-cf5776ed-8449-4055-a278-60a0e5e4136c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:22:00.268896 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-cf5776ed-8449-4055-a278-60a0e5e4136c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:00.326952 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1386/2809] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:22:00.336400 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc179f01-5276-4d80-bb8c-a3611f921c0d admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:00.337878 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-dc179f01-5276-4d80-bb8c-a3611f921c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:00.394009 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc179f01-5276-4d80-bb8c-a3611f921c0d admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:00.397669 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b42084-4de1-4580-a7ea-e92fe96d8913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:00.398314 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b42084-4de1-4580-a7ea-e92fe96d8913 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:00.398600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b42084-4de1-4580-a7ea-e92fe96d8913 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:00.398875 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b42084-4de1-4580-a7ea-e92fe96d8913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:00.408446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b42084-4de1-4580-a7ea-e92fe96d8913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:00.409902 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b42084-4de1-4580-a7ea-e92fe96d8913 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:00.419447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1424/2810] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:22:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:22:00.958714 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5776ed-8449-4055-a278-60a0e5e4136c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:00.961088 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-cf5776ed-8449-4055-a278-60a0e5e4136c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:00.972848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5776ed-8449-4055-a278-60a0e5e4136c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:00.978439 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3f684-4a6c-4c02-a87b-167b489f7c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:00.979930 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3f684-4a6c-4c02-a87b-167b489f7c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:00.980099 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3f684-4a6c-4c02-a87b-167b489f7c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:00.980555 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3f684-4a6c-4c02-a87b-167b489f7c85 admin admin] PATH_INFO: `/v3/projects/810a153f99914b7686ae1eb028f5fe38` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:00.981524 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3f684-4a6c-4c02-a87b-167b489f7c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=810a153f99914b7686ae1eb028f5fe38)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:00.984457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3f684-4a6c-4c02-a87b-167b489f7c85 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:01.080958 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ebb3f684-4a6c-4c02-a87b-167b489f7c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '810a153f99914b7686ae1eb028f5fe38', 'request_id': 'req-ebb3f684-4a6c-4c02-a87b-167b489f7c85'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:22:01.087077 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ebb3f684-4a6c-4c02-a87b-167b489f7c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '810a153f99914b7686ae1eb028f5fe38', 'request_id': 'req-ebb3f684-4a6c-4c02-a87b-167b489f7c85'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:22:01.092656 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ebb3f684-4a6c-4c02-a87b-167b489f7c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '810a153f99914b7686ae1eb028f5fe38', 'request_id': 'req-ebb3f684-4a6c-4c02-a87b-167b489f7c85'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:22:01.160530 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ebb3f684-4a6c-4c02-a87b-167b489f7c85 admin admin] The token cache is being invalidate because project 810a153f99914b7686ae1eb028f5fe38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:22:01.160818 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ebb3f684-4a6c-4c02-a87b-167b489f7c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:22:01.161499 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ebb3f684-4a6c-4c02-a87b-167b489f7c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:22:01.163053 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1387/2811] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:22:00 2022] DELETE /identity/v3/projects/810a153f99914b7686ae1eb028f5fe38 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:22:01.169003 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59bed7-5cd4-403e-8bee-e028f59518ba None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:01.169580 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59bed7-5cd4-403e-8bee-e028f59518ba None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:01.169809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59bed7-5cd4-403e-8bee-e028f59518ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:01.188032 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-be59bed7-5cd4-403e-8bee-e028f59518ba None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:22:01.189272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-be59bed7-5cd4-403e-8bee-e028f59518ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:01.246375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1425/2812] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:22:01.254429 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84c784-3127-4231-a75d-616a865ba1aa None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:01.254913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84c784-3127-4231-a75d-616a865ba1aa None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:01.255172 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84c784-3127-4231-a75d-616a865ba1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:01.273833 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ca84c784-3127-4231-a75d-616a865ba1aa None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:22:01.275062 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ca84c784-3127-4231-a75d-616a865ba1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:01.286620 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1388/2813] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:22:01.291904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59bed7-5cd4-403e-8bee-e028f59518ba None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:01.303251 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59bed7-5cd4-403e-8bee-e028f59518ba None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:01.308525 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7eeb06-9b57-4a47-9893-4a9dafb900d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:01.309217 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eeb06-9b57-4a47-9893-4a9dafb900d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:01.309501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eeb06-9b57-4a47-9893-4a9dafb900d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:01.309776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eeb06-9b57-4a47-9893-4a9dafb900d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:01.310502 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7eeb06-9b57-4a47-9893-4a9dafb900d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:22:01.310809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7eeb06-9b57-4a47-9893-4a9dafb900d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:01.312434 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7eeb06-9b57-4a47-9893-4a9dafb900d6 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:01.323807 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1426/2814] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:22:01.328589 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84c784-3127-4231-a75d-616a865ba1aa None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:01.337757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84c784-3127-4231-a75d-616a865ba1aa None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:01.342911 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbce467-0ba0-42ee-9988-19602e1cc375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:01.343553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbce467-0ba0-42ee-9988-19602e1cc375 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:01.343835 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbce467-0ba0-42ee-9988-19602e1cc375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:01.344112 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbce467-0ba0-42ee-9988-19602e1cc375 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:01.344810 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbce467-0ba0-42ee-9988-19602e1cc375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:01.347039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbce467-0ba0-42ee-9988-19602e1cc375 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:01.445540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1389/2815] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:22:01 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:22:01.446689 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7eeb06-9b57-4a47-9893-4a9dafb900d6 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:01.457107 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7eeb06-9b57-4a47-9893-4a9dafb900d6 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:01.510448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df371af-f593-4850-8e54-1df627e6f966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:01.511112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df371af-f593-4850-8e54-1df627e6f966 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:01.511395 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df371af-f593-4850-8e54-1df627e6f966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:01.511671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df371af-f593-4850-8e54-1df627e6f966 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:01.512365 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df371af-f593-4850-8e54-1df627e6f966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:01.514372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df371af-f593-4850-8e54-1df627e6f966 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:01.601458 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1427/2816] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:22:01 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:22:01.607911 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbce467-0ba0-42ee-9988-19602e1cc375 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:01.620127 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbce467-0ba0-42ee-9988-19602e1cc375 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:01.626772 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa44aa9-e9db-4088-b5d5-effa12aacd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:01.627434 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa44aa9-e9db-4088-b5d5-effa12aacd37 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:01.627729 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa44aa9-e9db-4088-b5d5-effa12aacd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:01.627980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa44aa9-e9db-4088-b5d5-effa12aacd37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:01.631092 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa44aa9-e9db-4088-b5d5-effa12aacd37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:01.633794 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa44aa9-e9db-4088-b5d5-effa12aacd37 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:01.643747 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1390/2817] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:22:01.647926 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df371af-f593-4850-8e54-1df627e6f966 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:01.658765 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df371af-f593-4850-8e54-1df627e6f966 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:01.663462 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b9da3-383e-47d1-98cf-dc2f60aa47e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:01.668272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9da3-383e-47d1-98cf-dc2f60aa47e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:01.668272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9da3-383e-47d1-98cf-dc2f60aa47e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:01.668272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9da3-383e-47d1-98cf-dc2f60aa47e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:01.668272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b9da3-383e-47d1-98cf-dc2f60aa47e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:01.668272 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b9da3-383e-47d1-98cf-dc2f60aa47e2 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:01.681910 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1428/2818] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:22:01.683194 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa44aa9-e9db-4088-b5d5-effa12aacd37 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:01.694547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa44aa9-e9db-4088-b5d5-effa12aacd37 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:01.699450 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df73427-6d7a-4c72-9dab-95daef077bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:01.700326 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df73427-6d7a-4c72-9dab-95daef077bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:01.700603 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df73427-6d7a-4c72-9dab-95daef077bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:01.700874 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df73427-6d7a-4c72-9dab-95daef077bf3 admin admin] PATH_INFO: `/v3/projects/13d5d442d5ce480f95e106d1889fa687/users/b174e6fdf8284bb6a7f4a2d27f2f8020/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:01.715918 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df73427-6d7a-4c72-9dab-95daef077bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d5d442d5ce480f95e106d1889fa687, user_id=b174e6fdf8284bb6a7f4a2d27f2f8020, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:01.718764 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df73427-6d7a-4c72-9dab-95daef077bf3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:01.801155 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1391/2819] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:22:01 2022] PUT /identity/v3/projects/13d5d442d5ce480f95e106d1889fa687/users/b174e6fdf8284bb6a7f4a2d27f2f8020/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:22:01.806268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204de3d-b7c6-44ce-acca-4bbbbac67e20 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:01.806631 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204de3d-b7c6-44ce-acca-4bbbbac67e20 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:01.806981 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204de3d-b7c6-44ce-acca-4bbbbac67e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:01.825553 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a204de3d-b7c6-44ce-acca-4bbbbac67e20 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:22:01.826467 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a204de3d-b7c6-44ce-acca-4bbbbac67e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:01.882826 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1429/2820] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:22:01.892720 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df73427-6d7a-4c72-9dab-95daef077bf3 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:01.894507 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6df73427-6d7a-4c72-9dab-95daef077bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:01.952673 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df73427-6d7a-4c72-9dab-95daef077bf3 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:01.956483 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe1625-27f7-407b-87bf-881c1892e6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:01.957154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe1625-27f7-407b-87bf-881c1892e6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:01.957439 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe1625-27f7-407b-87bf-881c1892e6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:01.957714 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe1625-27f7-407b-87bf-881c1892e6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:01.967180 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe1625-27f7-407b-87bf-881c1892e6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:01.968641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe1625-27f7-407b-87bf-881c1892e6d4 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:01.978029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1392/2821] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:22:03.666700 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204de3d-b7c6-44ce-acca-4bbbbac67e20 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:03.672029 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a204de3d-b7c6-44ce-acca-4bbbbac67e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:03.787824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204de3d-b7c6-44ce-acca-4bbbbac67e20 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:03.793484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91608082-4718-4590-891d-7809865ce2f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd095449a5b44c6b1c9aca712edc11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:03.794537 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91608082-4718-4590-891d-7809865ce2f3 service placement] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:03.794537 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91608082-4718-4590-891d-7809865ce2f3 service placement] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:03.794779 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91608082-4718-4590-891d-7809865ce2f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:03.796574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-91608082-4718-4590-891d-7809865ce2f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:03.809669 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91608082-4718-4590-891d-7809865ce2f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:03.811395 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91608082-4718-4590-891d-7809865ce2f3 service placement] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:03.822256 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1430/2822] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:22:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:22:06.300345 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe1625-27f7-407b-87bf-881c1892e6d4 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:06.301873 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0ffe1625-27f7-407b-87bf-881c1892e6d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:06.313213 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe1625-27f7-407b-87bf-881c1892e6d4 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:06.317863 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2d373-021c-4e1d-a28b-293cb7171c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:06.318644 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2d373-021c-4e1d-a28b-293cb7171c32 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:06.318927 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2d373-021c-4e1d-a28b-293cb7171c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:06.319198 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2d373-021c-4e1d-a28b-293cb7171c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:06.320974 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4ac2d373-021c-4e1d-a28b-293cb7171c32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:06.332030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2d373-021c-4e1d-a28b-293cb7171c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:06.333624 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2d373-021c-4e1d-a28b-293cb7171c32 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:06.344593 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1393/2823] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:22:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:22:06.536735 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91608082-4718-4590-891d-7809865ce2f3 service placement] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:06.546618 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91608082-4718-4590-891d-7809865ce2f3 service placement] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:06.551024 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24beac0b-436a-43a4-a093-672fb7c6850c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:06.552215 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beac0b-436a-43a4-a093-672fb7c6850c service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:06.552718 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beac0b-436a-43a4-a093-672fb7c6850c service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:06.553195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beac0b-436a-43a4-a093-672fb7c6850c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:06.555100 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-24beac0b-436a-43a4-a093-672fb7c6850c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:06.634216 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24beac0b-436a-43a4-a093-672fb7c6850c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:06.636483 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24beac0b-436a-43a4-a093-672fb7c6850c service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:06.649591 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1431/2824] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:22:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:22:07.771460 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5177631-9a4a-4238-aa87-bac2834a40d0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:07.771961 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5177631-9a4a-4238-aa87-bac2834a40d0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:07.772074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5177631-9a4a-4238-aa87-bac2834a40d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:07.800763 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c5177631-9a4a-4238-aa87-bac2834a40d0 None None] MFA Rules not processed for user `b174e6fdf8284bb6a7f4a2d27f2f8020`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:22:07.802016 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c5177631-9a4a-4238-aa87-bac2834a40d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:07.868467 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1394/2825] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:22:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:22:07.870335 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24beac0b-436a-43a4-a093-672fb7c6850c service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:07.880758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24beac0b-436a-43a4-a093-672fb7c6850c service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:07.885780 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7998e-6dd6-44b2-bf87-f09020cab680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:07.886449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7998e-6dd6-44b2-bf87-f09020cab680 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:07.886734 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7998e-6dd6-44b2-bf87-f09020cab680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:07.887088 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7998e-6dd6-44b2-bf87-f09020cab680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:07.887717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7998e-6dd6-44b2-bf87-f09020cab680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:07.889789 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7998e-6dd6-44b2-bf87-f09020cab680 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:07.968502 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1432/2826] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:22:07 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:22:07.972475 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5177631-9a4a-4238-aa87-bac2834a40d0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:07.983795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5177631-9a4a-4238-aa87-bac2834a40d0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:08.038388 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a05db-462b-4266-a851-340980a9060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:08.039109 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a05db-462b-4266-a851-340980a9060b admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:08.039343 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a05db-462b-4266-a851-340980a9060b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:08.039618 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a05db-462b-4266-a851-340980a9060b admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:08.040312 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a05db-462b-4266-a851-340980a9060b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:08.043039 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a05db-462b-4266-a851-340980a9060b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:08.149867 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1395/2827] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:22:07 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:22:08.153867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7998e-6dd6-44b2-bf87-f09020cab680 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:08.163975 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7998e-6dd6-44b2-bf87-f09020cab680 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:08.168884 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea37799-b187-425a-b712-35855d99a0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:08.169629 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37799-b187-425a-b712-35855d99a0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:08.169913 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37799-b187-425a-b712-35855d99a0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:08.170190 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37799-b187-425a-b712-35855d99a0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:08.170915 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37799-b187-425a-b712-35855d99a0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:08.172497 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37799-b187-425a-b712-35855d99a0a9 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:08.183452 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1433/2828] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:22:08.196151 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a05db-462b-4266-a851-340980a9060b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:08.206636 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a05db-462b-4266-a851-340980a9060b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:08.211250 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2020ae-c657-4f27-89a9-d920f4ab888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:08.216413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2020ae-c657-4f27-89a9-d920f4ab888d admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:08.216413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2020ae-c657-4f27-89a9-d920f4ab888d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:08.216413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2020ae-c657-4f27-89a9-d920f4ab888d admin admin] PATH_INFO: `/v3/projects/b1395205e472422fa5d105961d6d0c52/users/1cb042ecee30457da10ef35f6d94538a/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:08.228209 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2020ae-c657-4f27-89a9-d920f4ab888d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1395205e472422fa5d105961d6d0c52, user_id=1cb042ecee30457da10ef35f6d94538a, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:08.231636 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2020ae-c657-4f27-89a9-d920f4ab888d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:08.321875 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1396/2829] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:22:08 2022] PUT /identity/v3/projects/b1395205e472422fa5d105961d6d0c52/users/1cb042ecee30457da10ef35f6d94538a/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:22:08.325899 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea37799-b187-425a-b712-35855d99a0a9 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:08.336462 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea37799-b187-425a-b712-35855d99a0a9 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:08.394445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db312598-46ab-40ef-9818-fde252196b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:08.395210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db312598-46ab-40ef-9818-fde252196b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:08.395493 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db312598-46ab-40ef-9818-fde252196b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:08.395766 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db312598-46ab-40ef-9818-fde252196b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:08.396487 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db312598-46ab-40ef-9818-fde252196b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:08.398111 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db312598-46ab-40ef-9818-fde252196b30 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:08.409207 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1434/2830] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:22:08.413471 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2020ae-c657-4f27-89a9-d920f4ab888d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:08.424965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2020ae-c657-4f27-89a9-d920f4ab888d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:08.430093 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12827fa7-61fc-456f-8057-3027036ad967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:08.430989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12827fa7-61fc-456f-8057-3027036ad967 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:08.431276 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12827fa7-61fc-456f-8057-3027036ad967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:08.431556 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12827fa7-61fc-456f-8057-3027036ad967 admin admin] PATH_INFO: `/v3/projects/b1395205e472422fa5d105961d6d0c52/users/1cb042ecee30457da10ef35f6d94538a/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:08.434297 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12827fa7-61fc-456f-8057-3027036ad967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1395205e472422fa5d105961d6d0c52, user_id=1cb042ecee30457da10ef35f6d94538a, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:08.437003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12827fa7-61fc-456f-8057-3027036ad967 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:08.448870 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1397/2831] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:22:08 2022] PUT /identity/v3/projects/b1395205e472422fa5d105961d6d0c52/users/1cb042ecee30457da10ef35f6d94538a/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:22:14.454717 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bacb1-c0d1-40ea-8a77-924ada79f8f9 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:14.455305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bacb1-c0d1-40ea-8a77-924ada79f8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:14.455305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bacb1-c0d1-40ea-8a77-924ada79f8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:14.483574 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5c8bacb1-c0d1-40ea-8a77-924ada79f8f9 None None] MFA Rules not processed for user `1cb042ecee30457da10ef35f6d94538a`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:22:14.485370 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5c8bacb1-c0d1-40ea-8a77-924ada79f8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:14.558073 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1435/2832] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:22:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:22:14.569560 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12827fa7-61fc-456f-8057-3027036ad967 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:14.571280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-12827fa7-61fc-456f-8057-3027036ad967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:14.669635 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12827fa7-61fc-456f-8057-3027036ad967 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:14.675417 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f517af-9317-4fc6-9090-d79fbbfb73a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:14.676111 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f517af-9317-4fc6-9090-d79fbbfb73a5 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:14.676399 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f517af-9317-4fc6-9090-d79fbbfb73a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:14.676751 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f517af-9317-4fc6-9090-d79fbbfb73a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:14.735130 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f517af-9317-4fc6-9090-d79fbbfb73a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:14.736780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f517af-9317-4fc6-9090-d79fbbfb73a5 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:14.746991 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1398/2833] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:22:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:22:50.611474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61288c-aead-432a-909e-26fa63758ce7 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:50.612015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61288c-aead-432a-909e-26fa63758ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:50.612015 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61288c-aead-432a-909e-26fa63758ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:50.629784 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7c61288c-aead-432a-909e-26fa63758ce7 None None] MFA Rules not processed for user `b174e6fdf8284bb6a7f4a2d27f2f8020`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:22:50.630978 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7c61288c-aead-432a-909e-26fa63758ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:50.638054 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1436/2834] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:22:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:22:50.943486 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f517af-9317-4fc6-9090-d79fbbfb73a5 service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:22:50.996680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f517af-9317-4fc6-9090-d79fbbfb73a5 service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:22:51.000288 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a4d86-3e99-42da-9fde-7158c1c0d506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:22:51.000913 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a4d86-3e99-42da-9fde-7158c1c0d506 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:22:51.001225 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a4d86-3e99-42da-9fde-7158c1c0d506 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:22:51.001498 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a4d86-3e99-42da-9fde-7158c1c0d506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:22:51.003257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a36a4d86-3e99-42da-9fde-7158c1c0d506 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:22:51.012365 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a4d86-3e99-42da-9fde-7158c1c0d506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:22:51.013864 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a4d86-3e99-42da-9fde-7158c1c0d506 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:22:51.021618 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1399/2835] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:22:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:23:07.108715 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d111-1238-4c65-b6ab-94a953a90964 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:23:07.109304 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d111-1238-4c65-b6ab-94a953a90964 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:23:07.109430 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d111-1238-4c65-b6ab-94a953a90964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:23:07.126409 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-41e4d111-1238-4c65-b6ab-94a953a90964 None None] MFA Rules not processed for user `b727078a46bf4c9b9eebbba43d895042`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:23:07.127597 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-41e4d111-1238-4c65-b6ab-94a953a90964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:23:07.181269 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1437/2836] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:23:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:23:17.739878 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a4d86-3e99-42da-9fde-7158c1c0d506 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:23:17.748638 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a4d86-3e99-42da-9fde-7158c1c0d506 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:23:17.752282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78140d6f-9a56-4ec3-b151-3212bb44a154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:23:17.752912 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78140d6f-9a56-4ec3-b151-3212bb44a154 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:23:17.753238 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78140d6f-9a56-4ec3-b151-3212bb44a154 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:23:17.753515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78140d6f-9a56-4ec3-b151-3212bb44a154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:23:17.762818 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78140d6f-9a56-4ec3-b151-3212bb44a154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:23:17.764273 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78140d6f-9a56-4ec3-b151-3212bb44a154 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:23:17.773582 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1400/2837] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:23:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:23:19.214128 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4d111-1238-4c65-b6ab-94a953a90964 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:23:19.224611 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4d111-1238-4c65-b6ab-94a953a90964 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:23:19.228268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f807e-9fdb-45e3-b19c-931ff39f0781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:23:19.228916 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f807e-9fdb-45e3-b19c-931ff39f0781 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:23:19.229249 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f807e-9fdb-45e3-b19c-931ff39f0781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:23:19.229529 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f807e-9fdb-45e3-b19c-931ff39f0781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:23:19.231331 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-091f807e-9fdb-45e3-b19c-931ff39f0781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:23:19.264536 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f807e-9fdb-45e3-b19c-931ff39f0781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:23:19.266007 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f807e-9fdb-45e3-b19c-931ff39f0781 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:23:19.286847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1438/2838] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:23:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:23:21.644017 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78140d6f-9a56-4ec3-b151-3212bb44a154 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:23:21.652787 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78140d6f-9a56-4ec3-b151-3212bb44a154 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:23:21.656569 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c07a5-bc7c-4aa7-9a49-8b4561933e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:23:21.657252 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c07a5-bc7c-4aa7-9a49-8b4561933e2d service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:23:21.657569 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c07a5-bc7c-4aa7-9a49-8b4561933e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:23:21.657848 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c07a5-bc7c-4aa7-9a49-8b4561933e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:23:21.659618 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-900c07a5-bc7c-4aa7-9a49-8b4561933e2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:23:21.673500 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c07a5-bc7c-4aa7-9a49-8b4561933e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:23:21.675124 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c07a5-bc7c-4aa7-9a49-8b4561933e2d service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:23:21.686553 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1401/2839] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:23:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:24:20.326813 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f807e-9fdb-45e3-b19c-931ff39f0781 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:20.326813 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-091f807e-9fdb-45e3-b19c-931ff39f0781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:20.391678 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f807e-9fdb-45e3-b19c-931ff39f0781 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:20.396206 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4839d5-5655-4f10-90cc-c21fadf18f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:20.397781 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4839d5-5655-4f10-90cc-c21fadf18f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:20.398065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4839d5-5655-4f10-90cc-c21fadf18f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:20.398340 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4839d5-5655-4f10-90cc-c21fadf18f57 admin admin] PATH_INFO: `/v3/users/b727078a46bf4c9b9eebbba43d895042` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:20.399518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4839d5-5655-4f10-90cc-c21fadf18f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b727078a46bf4c9b9eebbba43d895042)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:20.401476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4839d5-5655-4f10-90cc-c21fadf18f57 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:20.542555 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7a4839d5-5655-4f10-90cc-c21fadf18f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b727078a46bf4c9b9eebbba43d895042'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:20.543306 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7a4839d5-5655-4f10-90cc-c21fadf18f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b727078a46bf4c9b9eebbba43d895042'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:20.543954 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7a4839d5-5655-4f10-90cc-c21fadf18f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b727078a46bf4c9b9eebbba43d895042'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:20.558710 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7a4839d5-5655-4f10-90cc-c21fadf18f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b727078a46bf4c9b9eebbba43d895042'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:20.566110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-7a4839d5-5655-4f10-90cc-c21fadf18f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b727078a46bf4c9b9eebbba43d895042'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:20.633214 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1439/2840] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:24:20 2022] DELETE /identity/v3/users/b727078a46bf4c9b9eebbba43d895042 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:24:20.886797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c07a5-bc7c-4aa7-9a49-8b4561933e2d service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:20.899743 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c07a5-bc7c-4aa7-9a49-8b4561933e2d service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:20.959137 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25827441-fd39-463f-ae80-557e298eb6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:20.959988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25827441-fd39-463f-ae80-557e298eb6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:20.960269 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25827441-fd39-463f-ae80-557e298eb6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:20.960540 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25827441-fd39-463f-ae80-557e298eb6e8 admin admin] PATH_INFO: `/v3/projects/228ce5fb39b746459557caa1ee18daff` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:20.961722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25827441-fd39-463f-ae80-557e298eb6e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=228ce5fb39b746459557caa1ee18daff)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:20.963705 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25827441-fd39-463f-ae80-557e298eb6e8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:21.060605 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-25827441-fd39-463f-ae80-557e298eb6e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228ce5fb39b746459557caa1ee18daff', 'request_id': 'req-25827441-fd39-463f-ae80-557e298eb6e8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:21.066476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-25827441-fd39-463f-ae80-557e298eb6e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228ce5fb39b746459557caa1ee18daff', 'request_id': 'req-25827441-fd39-463f-ae80-557e298eb6e8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:21.071675 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-25827441-fd39-463f-ae80-557e298eb6e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228ce5fb39b746459557caa1ee18daff', 'request_id': 'req-25827441-fd39-463f-ae80-557e298eb6e8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:21.146245 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-25827441-fd39-463f-ae80-557e298eb6e8 admin admin] The token cache is being invalidate because project 228ce5fb39b746459557caa1ee18daff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:24:21.146455 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-25827441-fd39-463f-ae80-557e298eb6e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:21.147069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-25827441-fd39-463f-ae80-557e298eb6e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:21.148680 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1402/2841] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:24:20 2022] DELETE /identity/v3/projects/228ce5fb39b746459557caa1ee18daff => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:24:21.153582 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaba42b-7134-477e-ae40-20a34d522844 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:21.153872 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaba42b-7134-477e-ae40-20a34d522844 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:21.154155 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaba42b-7134-477e-ae40-20a34d522844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:21.172660 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-bfaba42b-7134-477e-ae40-20a34d522844 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:24:21.173881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-bfaba42b-7134-477e-ae40-20a34d522844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:21.242448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1440/2842] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:24:21.250165 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702512a-c4d9-414a-93f3-52b45924722c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:21.250457 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702512a-c4d9-414a-93f3-52b45924722c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:21.250740 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702512a-c4d9-414a-93f3-52b45924722c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:21.268744 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5702512a-c4d9-414a-93f3-52b45924722c None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:24:21.270038 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5702512a-c4d9-414a-93f3-52b45924722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:21.278476 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1403/2843] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:24:21.282645 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaba42b-7134-477e-ae40-20a34d522844 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:21.293126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaba42b-7134-477e-ae40-20a34d522844 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:21.299360 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb9748-001c-4e05-a1de-35d920bd1de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:21.300029 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb9748-001c-4e05-a1de-35d920bd1de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:21.300307 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb9748-001c-4e05-a1de-35d920bd1de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:21.300583 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb9748-001c-4e05-a1de-35d920bd1de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:21.301324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb9748-001c-4e05-a1de-35d920bd1de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:24:21.301628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb9748-001c-4e05-a1de-35d920bd1de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:21.303204 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb9748-001c-4e05-a1de-35d920bd1de3 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:21.314572 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1441/2844] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 11:24:21.318615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702512a-c4d9-414a-93f3-52b45924722c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:21.327926 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702512a-c4d9-414a-93f3-52b45924722c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:21.332602 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd8a84-90bf-41d4-875d-c22ca2b9960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:21.333267 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd8a84-90bf-41d4-875d-c22ca2b9960d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:21.333554 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd8a84-90bf-41d4-875d-c22ca2b9960d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:21.333831 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd8a84-90bf-41d4-875d-c22ca2b9960d admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:21.335006 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd8a84-90bf-41d4-875d-c22ca2b9960d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:21.337011 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd8a84-90bf-41d4-875d-c22ca2b9960d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:21.417650 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1404/2845] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:24:21 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:24:21.421637 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb9748-001c-4e05-a1de-35d920bd1de3 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:21.431684 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb9748-001c-4e05-a1de-35d920bd1de3 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:21.488193 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420b2a3-5475-4bf9-9b2a-c611a94c1396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:21.488867 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420b2a3-5475-4bf9-9b2a-c611a94c1396 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:21.489194 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420b2a3-5475-4bf9-9b2a-c611a94c1396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:21.489475 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420b2a3-5475-4bf9-9b2a-c611a94c1396 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:21.490178 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420b2a3-5475-4bf9-9b2a-c611a94c1396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:21.492092 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420b2a3-5475-4bf9-9b2a-c611a94c1396 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:21.560939 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1442/2846] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:24:21 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:24:21.565098 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd8a84-90bf-41d4-875d-c22ca2b9960d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:21.575600 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd8a84-90bf-41d4-875d-c22ca2b9960d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:21.580370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0e1c7-44b7-4c20-b47b-7293596f361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:21.581031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0e1c7-44b7-4c20-b47b-7293596f361f admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:21.581370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0e1c7-44b7-4c20-b47b-7293596f361f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:21.581629 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0e1c7-44b7-4c20-b47b-7293596f361f admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:21.582351 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0e1c7-44b7-4c20-b47b-7293596f361f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:21.583991 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0e1c7-44b7-4c20-b47b-7293596f361f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:21.594748 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1405/2847] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:24:21.598903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420b2a3-5475-4bf9-9b2a-c611a94c1396 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:21.609588 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420b2a3-5475-4bf9-9b2a-c611a94c1396 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:21.614166 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791b317-fc84-49f3-8700-878c758c1bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:21.614823 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b317-fc84-49f3-8700-878c758c1bba admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:21.615102 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b317-fc84-49f3-8700-878c758c1bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:21.615372 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b317-fc84-49f3-8700-878c758c1bba admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:21.616112 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791b317-fc84-49f3-8700-878c758c1bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:21.617800 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791b317-fc84-49f3-8700-878c758c1bba admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:21.627460 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1443/2848] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:24:21.632104 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0e1c7-44b7-4c20-b47b-7293596f361f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:21.641982 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0e1c7-44b7-4c20-b47b-7293596f361f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:21.646956 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ad907-e80a-4de0-9529-12b55854eae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:21.648943 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ad907-e80a-4de0-9529-12b55854eae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:21.649257 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ad907-e80a-4de0-9529-12b55854eae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:21.649525 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ad907-e80a-4de0-9529-12b55854eae4 admin admin] PATH_INFO: `/v3/projects/b2174603ab0a4977ba7df933e7062f50/users/3d908381ac044a87944f38579d10c6f1/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:21.663937 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ad907-e80a-4de0-9529-12b55854eae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2174603ab0a4977ba7df933e7062f50, user_id=3d908381ac044a87944f38579d10c6f1, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:21.666907 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ad907-e80a-4de0-9529-12b55854eae4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:21.753357 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1406/2849] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:24:21 2022] PUT /identity/v3/projects/b2174603ab0a4977ba7df933e7062f50/users/3d908381ac044a87944f38579d10c6f1/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:24:21.764020 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc7541-0dd4-4c08-8861-7de0b25f24e8 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:21.764512 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc7541-0dd4-4c08-8861-7de0b25f24e8 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:21.764905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc7541-0dd4-4c08-8861-7de0b25f24e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:21.792159 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-83fc7541-0dd4-4c08-8861-7de0b25f24e8 None None] MFA Rules not processed for user `3d908381ac044a87944f38579d10c6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:24:21.793429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-83fc7541-0dd4-4c08-8861-7de0b25f24e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:21.854100 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1444/2850] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:24:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:24:21.865444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ad907-e80a-4de0-9529-12b55854eae4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:21.867392 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9e1ad907-e80a-4de0-9529-12b55854eae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:21.929031 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ad907-e80a-4de0-9529-12b55854eae4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:21.932801 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a92bc-42ca-4f93-a5bd-52dd602739da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:21.933478 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a92bc-42ca-4f93-a5bd-52dd602739da service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:21.933757 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a92bc-42ca-4f93-a5bd-52dd602739da service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:21.934032 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a92bc-42ca-4f93-a5bd-52dd602739da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:21.944627 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a92bc-42ca-4f93-a5bd-52dd602739da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:21.945570 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a92bc-42ca-4f93-a5bd-52dd602739da service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:21.954876 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1407/2851] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:24:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:24:22.646956 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc7541-0dd4-4c08-8861-7de0b25f24e8 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:22.648474 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-83fc7541-0dd4-4c08-8861-7de0b25f24e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:22.709069 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc7541-0dd4-4c08-8861-7de0b25f24e8 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:22.712855 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c4f5b-ef14-44d6-b69c-f8c936c1e0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:22.713542 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4f5b-ef14-44d6-b69c-f8c936c1e0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:22.715167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4f5b-ef14-44d6-b69c-f8c936c1e0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:22.715167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4f5b-ef14-44d6-b69c-f8c936c1e0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:22.715905 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8e1c4f5b-ef14-44d6-b69c-f8c936c1e0e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:22.774539 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c4f5b-ef14-44d6-b69c-f8c936c1e0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:22.775969 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c4f5b-ef14-44d6-b69c-f8c936c1e0e5 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:22.785189 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1445/2852] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:24:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:24:23.897836 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a92bc-42ca-4f93-a5bd-52dd602739da service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:23.899920 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a56a92bc-42ca-4f93-a5bd-52dd602739da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:24.001232 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a92bc-42ca-4f93-a5bd-52dd602739da service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:24.012877 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39905585-05f1-466a-a432-be47aaf44142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:24.013586 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39905585-05f1-466a-a432-be47aaf44142 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:24.013851 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39905585-05f1-466a-a432-be47aaf44142 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:24.014132 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39905585-05f1-466a-a432-be47aaf44142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:24.016105 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-39905585-05f1-466a-a432-be47aaf44142 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:24.032262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39905585-05f1-466a-a432-be47aaf44142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:24.033488 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39905585-05f1-466a-a432-be47aaf44142 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:24.046154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1408/2853] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:24:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:24:24.151122 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c4f5b-ef14-44d6-b69c-f8c936c1e0e5 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:24.152745 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8e1c4f5b-ef14-44d6-b69c-f8c936c1e0e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:24.164656 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c4f5b-ef14-44d6-b69c-f8c936c1e0e5 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:24.168400 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26091c77-004d-4932-8be5-8ca4e20f2c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:24.169114 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26091c77-004d-4932-8be5-8ca4e20f2c0f service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:24.169399 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26091c77-004d-4932-8be5-8ca4e20f2c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:24.169674 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26091c77-004d-4932-8be5-8ca4e20f2c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:24.171423 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-26091c77-004d-4932-8be5-8ca4e20f2c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:24.181971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26091c77-004d-4932-8be5-8ca4e20f2c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:24.183391 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26091c77-004d-4932-8be5-8ca4e20f2c0f service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:24.192356 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1446/2854] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:24:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:24:31.581477 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39905585-05f1-466a-a432-be47aaf44142 service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:31.641282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39905585-05f1-466a-a432-be47aaf44142 service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:31.646016 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ce789-9f57-49fd-87a0-00d9e1972b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:31.646871 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ce789-9f57-49fd-87a0-00d9e1972b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:31.647146 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ce789-9f57-49fd-87a0-00d9e1972b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:31.647415 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ce789-9f57-49fd-87a0-00d9e1972b28 admin admin] PATH_INFO: `/v3/users/3d908381ac044a87944f38579d10c6f1` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:31.649147 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ce789-9f57-49fd-87a0-00d9e1972b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d908381ac044a87944f38579d10c6f1)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:31.651727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ce789-9f57-49fd-87a0-00d9e1972b28 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:31.845357 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-938ce789-9f57-49fd-87a0-00d9e1972b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d908381ac044a87944f38579d10c6f1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:31.845916 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-938ce789-9f57-49fd-87a0-00d9e1972b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d908381ac044a87944f38579d10c6f1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:31.846512 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-938ce789-9f57-49fd-87a0-00d9e1972b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d908381ac044a87944f38579d10c6f1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:31.901900 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-938ce789-9f57-49fd-87a0-00d9e1972b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d908381ac044a87944f38579d10c6f1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:31.916065 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-938ce789-9f57-49fd-87a0-00d9e1972b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d908381ac044a87944f38579d10c6f1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:31.928881 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1409/2855] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:24:31 2022] DELETE /identity/v3/users/3d908381ac044a87944f38579d10c6f1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:24:31.934105 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43474e42-f602-4f92-be2c-29add769cedc None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:31.934605 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43474e42-f602-4f92-be2c-29add769cedc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:31.934711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43474e42-f602-4f92-be2c-29add769cedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:31.952655 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-43474e42-f602-4f92-be2c-29add769cedc None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:24:31.953953 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-43474e42-f602-4f92-be2c-29add769cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:32.009498 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1447/2856] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:24:32.019116 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ce789-9f57-49fd-87a0-00d9e1972b28 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:32.020536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-938ce789-9f57-49fd-87a0-00d9e1972b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:32.074607 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ce789-9f57-49fd-87a0-00d9e1972b28 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:32.078186 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e297b-a86b-494c-806f-e41caa32a028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:32.078808 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e297b-a86b-494c-806f-e41caa32a028 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:32.079086 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e297b-a86b-494c-806f-e41caa32a028 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:32.079359 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e297b-a86b-494c-806f-e41caa32a028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:32.088115 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e297b-a86b-494c-806f-e41caa32a028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:32.089602 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e297b-a86b-494c-806f-e41caa32a028 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:32.098777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1410/2857] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:24:32.473881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43474e42-f602-4f92-be2c-29add769cedc None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:32.473881 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-43474e42-f602-4f92-be2c-29add769cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:32.482919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43474e42-f602-4f92-be2c-29add769cedc None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:32.487841 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6cb6a-99c5-41ae-876f-196666b48542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:32.488712 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6cb6a-99c5-41ae-876f-196666b48542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:32.489187 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6cb6a-99c5-41ae-876f-196666b48542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:32.489473 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6cb6a-99c5-41ae-876f-196666b48542 admin admin] PATH_INFO: `/v3/projects/b2174603ab0a4977ba7df933e7062f50` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:32.490787 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6cb6a-99c5-41ae-876f-196666b48542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2174603ab0a4977ba7df933e7062f50)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:32.494887 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6cb6a-99c5-41ae-876f-196666b48542 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:32.605121 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-13e6cb6a-99c5-41ae-876f-196666b48542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2174603ab0a4977ba7df933e7062f50', 'request_id': 'req-13e6cb6a-99c5-41ae-876f-196666b48542'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:32.672654 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-13e6cb6a-99c5-41ae-876f-196666b48542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2174603ab0a4977ba7df933e7062f50', 'request_id': 'req-13e6cb6a-99c5-41ae-876f-196666b48542'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:32.679726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-13e6cb6a-99c5-41ae-876f-196666b48542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2174603ab0a4977ba7df933e7062f50', 'request_id': 'req-13e6cb6a-99c5-41ae-876f-196666b48542'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:32.689784 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-13e6cb6a-99c5-41ae-876f-196666b48542 admin admin] The token cache is being invalidate because project b2174603ab0a4977ba7df933e7062f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:24:32.690075 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-13e6cb6a-99c5-41ae-876f-196666b48542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:32.690726 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-13e6cb6a-99c5-41ae-876f-196666b48542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:32.692270 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1448/2858] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:24:32 2022] DELETE /identity/v3/projects/b2174603ab0a4977ba7df933e7062f50 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:24:32.697615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b879fd-84e4-426f-b87b-72432e4822b4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:32.698087 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b879fd-84e4-426f-b87b-72432e4822b4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:32.698211 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b879fd-84e4-426f-b87b-72432e4822b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:32.716106 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-22b879fd-84e4-426f-b87b-72432e4822b4 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:24:32.717301 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-22b879fd-84e4-426f-b87b-72432e4822b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:32.781512 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1411/2859] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:24:32.842891 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d763af3-b918-487a-b8a7-24739ba598e5 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:32.843352 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d763af3-b918-487a-b8a7-24739ba598e5 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:32.843503 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d763af3-b918-487a-b8a7-24739ba598e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:32.862915 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-3d763af3-b918-487a-b8a7-24739ba598e5 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:24:32.864130 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3d763af3-b918-487a-b8a7-24739ba598e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:32.872235 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1449/2860] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:24:32.873703 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b879fd-84e4-426f-b87b-72432e4822b4 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:32.875081 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-22b879fd-84e4-426f-b87b-72432e4822b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:32.876447 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d763af3-b918-487a-b8a7-24739ba598e5 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:32.886457 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d763af3-b918-487a-b8a7-24739ba598e5 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:32.891176 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692bcce-eebf-4b7a-b404-c4e6cb106eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:32.891815 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692bcce-eebf-4b7a-b404-c4e6cb106eca admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:32.892100 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692bcce-eebf-4b7a-b404-c4e6cb106eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:32.892373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692bcce-eebf-4b7a-b404-c4e6cb106eca admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:32.893561 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692bcce-eebf-4b7a-b404-c4e6cb106eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 11:24:32.893882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692bcce-eebf-4b7a-b404-c4e6cb106eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:32.895476 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692bcce-eebf-4b7a-b404-c4e6cb106eca admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:32.907813 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1450/2861] 10.222.0.62 () {58 vars in 1152 bytes} [Wed Apr 6 11:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 11:24:32.911849 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692bcce-eebf-4b7a-b404-c4e6cb106eca admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:32.921671 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692bcce-eebf-4b7a-b404-c4e6cb106eca admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:32.926417 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ca43e-018b-4ff2-bdf1-17d8b8bb8140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:32.927046 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca43e-018b-4ff2-bdf1-17d8b8bb8140 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:32.927324 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca43e-018b-4ff2-bdf1-17d8b8bb8140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:32.927600 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca43e-018b-4ff2-bdf1-17d8b8bb8140 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:32.928274 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ca43e-018b-4ff2-bdf1-17d8b8bb8140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:32.930210 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ca43e-018b-4ff2-bdf1-17d8b8bb8140 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:32.932980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b879fd-84e4-426f-b87b-72432e4822b4 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:32.936598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d51d82-2032-4b95-b118-c1266be17d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:32.937291 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d51d82-2032-4b95-b118-c1266be17d3f service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:32.937574 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d51d82-2032-4b95-b118-c1266be17d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:32.937850 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d51d82-2032-4b95-b118-c1266be17d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:32.939641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c4d51d82-2032-4b95-b118-c1266be17d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:32.952183 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d51d82-2032-4b95-b118-c1266be17d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:32.957303 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d51d82-2032-4b95-b118-c1266be17d3f service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:32.963934 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1412/2862] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:24:33.008568 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1451/2863] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:24:32 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 11:24:33.010840 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d51d82-2032-4b95-b118-c1266be17d3f service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:33.020382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d51d82-2032-4b95-b118-c1266be17d3f service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:33.075366 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80e18-a7a2-4f35-98dd-8c83151e2154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:33.076029 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80e18-a7a2-4f35-98dd-8c83151e2154 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:33.076306 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80e18-a7a2-4f35-98dd-8c83151e2154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:33.076581 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80e18-a7a2-4f35-98dd-8c83151e2154 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:33.077308 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80e18-a7a2-4f35-98dd-8c83151e2154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:33.079256 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80e18-a7a2-4f35-98dd-8c83151e2154 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:33.181500 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1413/2864] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:24:33 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:24:33.185809 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ca43e-018b-4ff2-bdf1-17d8b8bb8140 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:33.197504 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ca43e-018b-4ff2-bdf1-17d8b8bb8140 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:33.202180 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c422377-d312-4439-a738-0e18f9f4d1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:33.202843 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c422377-d312-4439-a738-0e18f9f4d1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:33.203122 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c422377-d312-4439-a738-0e18f9f4d1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:33.203396 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c422377-d312-4439-a738-0e18f9f4d1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:33.204121 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c422377-d312-4439-a738-0e18f9f4d1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:33.206017 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c422377-d312-4439-a738-0e18f9f4d1f9 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:33.216512 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1452/2865] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:24:33.220448 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80e18-a7a2-4f35-98dd-8c83151e2154 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:33.230964 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80e18-a7a2-4f35-98dd-8c83151e2154 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:33.235789 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccafc9-63cf-4176-8b29-5cce139dc471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:33.236445 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccafc9-63cf-4176-8b29-5cce139dc471 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:33.236727 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccafc9-63cf-4176-8b29-5cce139dc471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:33.237003 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccafc9-63cf-4176-8b29-5cce139dc471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:33.237780 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccafc9-63cf-4176-8b29-5cce139dc471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:33.239444 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccafc9-63cf-4176-8b29-5cce139dc471 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:33.250168 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1414/2866] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:24:33.254390 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c422377-d312-4439-a738-0e18f9f4d1f9 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:33.265089 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c422377-d312-4439-a738-0e18f9f4d1f9 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:33.270847 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91565dff-30f2-4ba2-8ad0-55b92f1bec05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:33.271852 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91565dff-30f2-4ba2-8ad0-55b92f1bec05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:33.272145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91565dff-30f2-4ba2-8ad0-55b92f1bec05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:33.272443 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91565dff-30f2-4ba2-8ad0-55b92f1bec05 admin admin] PATH_INFO: `/v3/projects/2cdc93c8c7954215bc5d1521f0865e4c/users/543ab8546bf04956b47066e3171ebf23/roles/519c87ee2e424f1d81ce0c136c4b2d25` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:33.286922 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91565dff-30f2-4ba2-8ad0-55b92f1bec05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cdc93c8c7954215bc5d1521f0865e4c, user_id=543ab8546bf04956b47066e3171ebf23, role_id=519c87ee2e424f1d81ce0c136c4b2d25)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:33.289903 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91565dff-30f2-4ba2-8ad0-55b92f1bec05 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:33.352749 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1453/2867] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:24:33 2022] PUT /identity/v3/projects/2cdc93c8c7954215bc5d1521f0865e4c/users/543ab8546bf04956b47066e3171ebf23/roles/519c87ee2e424f1d81ce0c136c4b2d25 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:24:33.357849 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76ca69-24ae-4730-89fa-874349d2ac65 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:33.358144 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76ca69-24ae-4730-89fa-874349d2ac65 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:33.358426 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76ca69-24ae-4730-89fa-874349d2ac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:33.376293 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2a76ca69-24ae-4730-89fa-874349d2ac65 None None] MFA Rules not processed for user `2081d2092d1f43b39f058ddf8338a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:24:33.377541 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2a76ca69-24ae-4730-89fa-874349d2ac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:33.436352 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1415/2868] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:24:33.446911 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91565dff-30f2-4ba2-8ad0-55b92f1bec05 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:33.448724 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-91565dff-30f2-4ba2-8ad0-55b92f1bec05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:33.505286 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91565dff-30f2-4ba2-8ad0-55b92f1bec05 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:33.509641 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a2061-5e82-4c5b-8b60-60e2a6eda05b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:33.510286 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a2061-5e82-4c5b-8b60-60e2a6eda05b service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:33.510567 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a2061-5e82-4c5b-8b60-60e2a6eda05b service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:33.510841 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a2061-5e82-4c5b-8b60-60e2a6eda05b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:33.520005 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a2061-5e82-4c5b-8b60-60e2a6eda05b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:33.521410 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a2061-5e82-4c5b-8b60-60e2a6eda05b service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:33.531169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1454/2869] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:24:39.115119 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6274137-ca45-47c6-8625-7aaf4c5e4645 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:39.115611 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6274137-ca45-47c6-8625-7aaf4c5e4645 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:39.115960 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6274137-ca45-47c6-8625-7aaf4c5e4645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:39.151647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b6274137-ca45-47c6-8625-7aaf4c5e4645 None None] MFA Rules not processed for user `543ab8546bf04956b47066e3171ebf23`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:24:39.153091 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b6274137-ca45-47c6-8625-7aaf4c5e4645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:39.256936 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1416/2870] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:24:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:24:39.261016 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a2061-5e82-4c5b-8b60-60e2a6eda05b service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:39.271066 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a2061-5e82-4c5b-8b60-60e2a6eda05b service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:39.276581 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969852e-1b23-4883-81a0-e0750bf5fa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:39.277449 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969852e-1b23-4883-81a0-e0750bf5fa27 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:39.277830 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969852e-1b23-4883-81a0-e0750bf5fa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:39.278228 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969852e-1b23-4883-81a0-e0750bf5fa27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:39.279039 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969852e-1b23-4883-81a0-e0750bf5fa27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:39.281213 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969852e-1b23-4883-81a0-e0750bf5fa27 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:39.384363 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1455/2871] 10.222.0.62 () {60 vars in 1152 bytes} [Wed Apr 6 11:24:39 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:24:39.388647 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6274137-ca45-47c6-8625-7aaf4c5e4645 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:39.410030 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6274137-ca45-47c6-8625-7aaf4c5e4645 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:39.496001 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58520814-ebed-464b-bdb5-7ca0efa35ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:39.497087 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58520814-ebed-464b-bdb5-7ca0efa35ddb admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:39.497470 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58520814-ebed-464b-bdb5-7ca0efa35ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:39.497856 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58520814-ebed-464b-bdb5-7ca0efa35ddb admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:39.498788 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58520814-ebed-464b-bdb5-7ca0efa35ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:39.501198 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58520814-ebed-464b-bdb5-7ca0efa35ddb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:39.582469 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1417/2872] 10.222.0.62 () {60 vars in 1143 bytes} [Wed Apr 6 11:24:39 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 11:24:39.586642 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969852e-1b23-4883-81a0-e0750bf5fa27 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:39.597890 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969852e-1b23-4883-81a0-e0750bf5fa27 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:39.604087 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f0c3d-3c2d-4afd-8b84-403193e08d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:39.605041 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f0c3d-3c2d-4afd-8b84-403193e08d20 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:39.605520 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f0c3d-3c2d-4afd-8b84-403193e08d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:39.605971 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f0c3d-3c2d-4afd-8b84-403193e08d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:39.606882 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f0c3d-3c2d-4afd-8b84-403193e08d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:39.608608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f0c3d-3c2d-4afd-8b84-403193e08d20 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:39.620413 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1456/2873] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:24:39.625871 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58520814-ebed-464b-bdb5-7ca0efa35ddb admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:39.637567 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58520814-ebed-464b-bdb5-7ca0efa35ddb admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:39.644705 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e78b-f8d8-4b9d-8be9-9e8a96babe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:39.645865 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e78b-f8d8-4b9d-8be9-9e8a96babe5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:39.646202 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e78b-f8d8-4b9d-8be9-9e8a96babe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:39.649173 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e78b-f8d8-4b9d-8be9-9e8a96babe5e admin admin] PATH_INFO: `/v3/projects/455bc7eb5d8c478b86826db523a28bd3/users/0d43375ef92549ff8bf69a75d2e9f952/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:39.664251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8e78b-f8d8-4b9d-8be9-9e8a96babe5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=455bc7eb5d8c478b86826db523a28bd3, user_id=0d43375ef92549ff8bf69a75d2e9f952, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:39.668636 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8e78b-f8d8-4b9d-8be9-9e8a96babe5e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:39.729042 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1418/2874] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:24:39 2022] PUT /identity/v3/projects/455bc7eb5d8c478b86826db523a28bd3/users/0d43375ef92549ff8bf69a75d2e9f952/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:24:39.730833 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f0c3d-3c2d-4afd-8b84-403193e08d20 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:39.746494 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f0c3d-3c2d-4afd-8b84-403193e08d20 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:39.812010 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d77a1b-6139-43a9-a761-63228f547aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:39.812747 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d77a1b-6139-43a9-a761-63228f547aad admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:39.813126 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d77a1b-6139-43a9-a761-63228f547aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:39.813465 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d77a1b-6139-43a9-a761-63228f547aad admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:39.814363 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d77a1b-6139-43a9-a761-63228f547aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:39.815994 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d77a1b-6139-43a9-a761-63228f547aad admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:39.830504 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1457/2875] 10.222.0.62 () {58 vars in 1121 bytes} [Wed Apr 6 11:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 11:24:39.831710 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e78b-f8d8-4b9d-8be9-9e8a96babe5e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:39.843317 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e78b-f8d8-4b9d-8be9-9e8a96babe5e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:39.848102 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46749442-1f93-40da-81bd-6189d3eb54c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:39.849071 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46749442-1f93-40da-81bd-6189d3eb54c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:39.849348 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46749442-1f93-40da-81bd-6189d3eb54c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:39.849641 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46749442-1f93-40da-81bd-6189d3eb54c3 admin admin] PATH_INFO: `/v3/projects/455bc7eb5d8c478b86826db523a28bd3/users/0d43375ef92549ff8bf69a75d2e9f952/roles/090ba4d1ae32495289276665920d4a2c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:39.852238 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46749442-1f93-40da-81bd-6189d3eb54c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=455bc7eb5d8c478b86826db523a28bd3, user_id=0d43375ef92549ff8bf69a75d2e9f952, role_id=090ba4d1ae32495289276665920d4a2c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:39.855074 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46749442-1f93-40da-81bd-6189d3eb54c3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:39.867536 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1419/2876] 10.222.0.62 () {60 vars in 1482 bytes} [Wed Apr 6 11:24:39 2022] PUT /identity/v3/projects/455bc7eb5d8c478b86826db523a28bd3/users/0d43375ef92549ff8bf69a75d2e9f952/roles/090ba4d1ae32495289276665920d4a2c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:24:41.539972 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d77a1b-6139-43a9-a761-63228f547aad admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:41.542575 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-63d77a1b-6139-43a9-a761-63228f547aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:41.588463 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d77a1b-6139-43a9-a761-63228f547aad admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:41.714247 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aedb5f-fc4e-4dab-833c-9bd7598c2d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:41.715461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aedb5f-fc4e-4dab-833c-9bd7598c2d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:41.715906 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aedb5f-fc4e-4dab-833c-9bd7598c2d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:41.716362 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aedb5f-fc4e-4dab-833c-9bd7598c2d89 admin admin] PATH_INFO: `/v3/users/c20d98c8be114c6e87e109f74cb62fdc` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:41.718376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aedb5f-fc4e-4dab-833c-9bd7598c2d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c20d98c8be114c6e87e109f74cb62fdc)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:41.721022 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aedb5f-fc4e-4dab-833c-9bd7598c2d89 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:41.999792 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-60aedb5f-fc4e-4dab-833c-9bd7598c2d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c20d98c8be114c6e87e109f74cb62fdc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:42.000778 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-60aedb5f-fc4e-4dab-833c-9bd7598c2d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c20d98c8be114c6e87e109f74cb62fdc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:42.001588 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-60aedb5f-fc4e-4dab-833c-9bd7598c2d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c20d98c8be114c6e87e109f74cb62fdc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:42.015100 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-60aedb5f-fc4e-4dab-833c-9bd7598c2d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c20d98c8be114c6e87e109f74cb62fdc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:42.024945 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-60aedb5f-fc4e-4dab-833c-9bd7598c2d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c20d98c8be114c6e87e109f74cb62fdc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:42.097556 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1458/2877] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:24:41 2022] DELETE /identity/v3/users/c20d98c8be114c6e87e109f74cb62fdc => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:24:42.428906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46749442-1f93-40da-81bd-6189d3eb54c3 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:42.437400 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-46749442-1f93-40da-81bd-6189d3eb54c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:42.462835 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46749442-1f93-40da-81bd-6189d3eb54c3 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:42.540181 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:42.541120 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:42.541408 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:42.541684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] PATH_INFO: `/v3/projects/89551c23f02f4ee7a29f7ba8e8b63dc1` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:42.542910 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89551c23f02f4ee7a29f7ba8e8b63dc1)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:42.546037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:42.677205 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89551c23f02f4ee7a29f7ba8e8b63dc1', 'request_id': 'req-58c46877-776d-4a45-a83a-63d3ba515ca9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:42.684742 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89551c23f02f4ee7a29f7ba8e8b63dc1', 'request_id': 'req-58c46877-776d-4a45-a83a-63d3ba515ca9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:42.691922 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89551c23f02f4ee7a29f7ba8e8b63dc1', 'request_id': 'req-58c46877-776d-4a45-a83a-63d3ba515ca9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:42.785304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] The token cache is being invalidate because project 89551c23f02f4ee7a29f7ba8e8b63dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:24:42.785697 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:42.786591 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:42.793167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1420/2878] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:24:42 2022] DELETE /identity/v3/projects/89551c23f02f4ee7a29f7ba8e8b63dc1 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:24:42.797501 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aedb5f-fc4e-4dab-833c-9bd7598c2d89 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:42.808917 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aedb5f-fc4e-4dab-833c-9bd7598c2d89 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:42.883366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf849f-6495-453d-b844-a5c99f169ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:42.884479 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf849f-6495-453d-b844-a5c99f169ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:42.884864 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf849f-6495-453d-b844-a5c99f169ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:42.885394 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf849f-6495-453d-b844-a5c99f169ced admin admin] PATH_INFO: `/v3/users/5f5b24c4d4e34fb8a81c4523610a48cc` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:42.886862 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf849f-6495-453d-b844-a5c99f169ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f5b24c4d4e34fb8a81c4523610a48cc)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:42.889100 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf849f-6495-453d-b844-a5c99f169ced admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:43.061665 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3fdf849f-6495-453d-b844-a5c99f169ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f5b24c4d4e34fb8a81c4523610a48cc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:43.062518 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3fdf849f-6495-453d-b844-a5c99f169ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f5b24c4d4e34fb8a81c4523610a48cc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:43.063362 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3fdf849f-6495-453d-b844-a5c99f169ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f5b24c4d4e34fb8a81c4523610a48cc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:43.088484 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3fdf849f-6495-453d-b844-a5c99f169ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f5b24c4d4e34fb8a81c4523610a48cc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:43.098523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-3fdf849f-6495-453d-b844-a5c99f169ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f5b24c4d4e34fb8a81c4523610a48cc'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:43.172831 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1459/2879] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:24:42 2022] DELETE /identity/v3/users/5f5b24c4d4e34fb8a81c4523610a48cc => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 11:24:43.541215 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:43.546408 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:43.584965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c46877-776d-4a45-a83a-63d3ba515ca9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:43.664295 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:43.665809 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:43.666278 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:43.666718 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] PATH_INFO: `/v3/projects/a3ae17cdfbf1451b94bcf9387d4003ec` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:43.671446 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ae17cdfbf1451b94bcf9387d4003ec)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:43.671997 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:43.794959 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ae17cdfbf1451b94bcf9387d4003ec', 'request_id': 'req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:43.803341 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ae17cdfbf1451b94bcf9387d4003ec', 'request_id': 'req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:43.813916 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ae17cdfbf1451b94bcf9387d4003ec', 'request_id': 'req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:43.891627 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] The token cache is being invalidate because project a3ae17cdfbf1451b94bcf9387d4003ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:24:43.892387 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:43.895728 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:24:43.897464 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1421/2880] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:24:43 2022] DELETE /identity/v3/projects/a3ae17cdfbf1451b94bcf9387d4003ec => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:24:45.770199 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea03d1-5cf8-4a55-902b-a439598497cb None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:45.770753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea03d1-5cf8-4a55-902b-a439598497cb None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:45.770753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea03d1-5cf8-4a55-902b-a439598497cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:45.798338 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-93ea03d1-5cf8-4a55-902b-a439598497cb None None] MFA Rules not processed for user `0d43375ef92549ff8bf69a75d2e9f952`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:24:45.799651 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-93ea03d1-5cf8-4a55-902b-a439598497cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:45.886254 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1460/2881] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:24:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:24:45.899526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:45.901140 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:45.984324 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb0ee5-9e75-4bd5-b0da-aa5b3035d6cc admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:45.988066 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b3b7a-278b-4ba7-9fe9-e84063fd303b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42cd381cf5c745de9dac8f77a8cea554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:45.988713 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b3b7a-278b-4ba7-9fe9-e84063fd303b service glance] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:45.988994 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b3b7a-278b-4ba7-9fe9-e84063fd303b service glance] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:45.989301 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b3b7a-278b-4ba7-9fe9-e84063fd303b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:45.991094 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9f3b3b7a-278b-4ba7-9fe9-e84063fd303b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:46.049906 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b3b7a-278b-4ba7-9fe9-e84063fd303b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:46.051398 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b3b7a-278b-4ba7-9fe9-e84063fd303b service glance] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:46.061564 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1422/2882] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:24:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:24:46.347786 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48442113-2343-4303-a66b-e5b41c136d65 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:46.348083 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48442113-2343-4303-a66b-e5b41c136d65 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:46.348366 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48442113-2343-4303-a66b-e5b41c136d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:46.412079 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-48442113-2343-4303-a66b-e5b41c136d65 None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:24:46.413498 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-48442113-2343-4303-a66b-e5b41c136d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:46.480294 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1461/2883] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:24:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:24:46.613605 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b3b7a-278b-4ba7-9fe9-e84063fd303b service glance] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:24:46.615037 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9f3b3b7a-278b-4ba7-9fe9-e84063fd303b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:46.711857 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b3b7a-278b-4ba7-9fe9-e84063fd303b service glance] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:24:46.717281 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8e389-dce6-4707-8de3-aab518a4321f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:24:46.717970 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8e389-dce6-4707-8de3-aab518a4321f service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:46.721154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8e389-dce6-4707-8de3-aab518a4321f service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:46.721154 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8e389-dce6-4707-8de3-aab518a4321f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:46.727509 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8e389-dce6-4707-8de3-aab518a4321f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:24:46.729263 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8e389-dce6-4707-8de3-aab518a4321f service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:24:46.737926 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1423/2884] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:24:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 11:24:58.012224 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02751cd6-03e8-4eb7-945c-01c7ba9ab8c4 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:24:58.012774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02751cd6-03e8-4eb7-945c-01c7ba9ab8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:24:58.012774 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02751cd6-03e8-4eb7-945c-01c7ba9ab8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:24:58.029961 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-02751cd6-03e8-4eb7-945c-01c7ba9ab8c4 None None] MFA Rules not processed for user `543ab8546bf04956b47066e3171ebf23`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:24:58.031160 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-02751cd6-03e8-4eb7-945c-01c7ba9ab8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:24:58.038056 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1462/2885] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:24:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:25:01.251615 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56305b74-caf2-4a1b-a8e1-22dd6845838b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:25:01.252179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56305b74-caf2-4a1b-a8e1-22dd6845838b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:25:01.252179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56305b74-caf2-4a1b-a8e1-22dd6845838b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:25:01.270096 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-56305b74-caf2-4a1b-a8e1-22dd6845838b None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:25:01.270905 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-56305b74-caf2-4a1b-a8e1-22dd6845838b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:25:01.278858 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1424/2886] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Apr 6 11:25:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:25:01.292381 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02751cd6-03e8-4eb7-945c-01c7ba9ab8c4 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:25:01.305252 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02751cd6-03e8-4eb7-945c-01c7ba9ab8c4 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:25:01.310628 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475aa6b-962e-442e-a831-0edc64987c0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:25:01.311344 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475aa6b-962e-442e-a831-0edc64987c0e service swift] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:25:01.311632 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475aa6b-962e-442e-a831-0edc64987c0e service swift] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:25:01.311916 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475aa6b-962e-442e-a831-0edc64987c0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:25:01.322446 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475aa6b-962e-442e-a831-0edc64987c0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:25:01.324047 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475aa6b-962e-442e-a831-0edc64987c0e service swift] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:25:01.332647 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1463/2887] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:25:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 11:25:33.702737 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56305b74-caf2-4a1b-a8e1-22dd6845838b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:25:33.704307 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-56305b74-caf2-4a1b-a8e1-22dd6845838b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:25:33.761206 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56305b74-caf2-4a1b-a8e1-22dd6845838b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:25:33.764806 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e821f-ba1d-49f5-8b79-05afec81eb9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:25:33.765515 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e821f-ba1d-49f5-8b79-05afec81eb9d service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:25:33.765796 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e821f-ba1d-49f5-8b79-05afec81eb9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:25:33.766068 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e821f-ba1d-49f5-8b79-05afec81eb9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:25:33.774928 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e821f-ba1d-49f5-8b79-05afec81eb9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:25:33.776423 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e821f-ba1d-49f5-8b79-05afec81eb9d service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:25:33.785899 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1425/2888] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:25:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:25:35.881502 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475aa6b-962e-442e-a831-0edc64987c0e service swift] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:25:35.883052 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7475aa6b-962e-442e-a831-0edc64987c0e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:25:35.956523 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475aa6b-962e-442e-a831-0edc64987c0e service swift] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:25:35.962339 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996325ea-b348-4bf3-a3eb-65f5e300c514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:25:35.963770 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996325ea-b348-4bf3-a3eb-65f5e300c514 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:25:35.964254 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996325ea-b348-4bf3-a3eb-65f5e300c514 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:25:35.964746 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996325ea-b348-4bf3-a3eb-65f5e300c514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:25:35.967305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-996325ea-b348-4bf3-a3eb-65f5e300c514 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:25:35.983263 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996325ea-b348-4bf3-a3eb-65f5e300c514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:25:35.987711 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996325ea-b348-4bf3-a3eb-65f5e300c514 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:25:35.997373 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1464/2889] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:25:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:26:01.858967 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213887ec-fd9c-4fa7-9cb6-afa332b962bb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:26:01.859493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213887ec-fd9c-4fa7-9cb6-afa332b962bb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:26:01.859493 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213887ec-fd9c-4fa7-9cb6-afa332b962bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:26:01.876990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-213887ec-fd9c-4fa7-9cb6-afa332b962bb None None] MFA Rules not processed for user `b174e6fdf8284bb6a7f4a2d27f2f8020`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:26:01.878217 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-213887ec-fd9c-4fa7-9cb6-afa332b962bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:26:01.931006 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1426/2890] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:26:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:27:31.513533 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996325ea-b348-4bf3-a3eb-65f5e300c514 service nova] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:27:31.514946 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-996325ea-b348-4bf3-a3eb-65f5e300c514 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:27:31.580848 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996325ea-b348-4bf3-a3eb-65f5e300c514 service nova] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:27:31.585822 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e310f-05ed-45b8-9803-b35c3081af25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd095449a5b44c6b1c9aca712edc11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:27:31.586461 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e310f-05ed-45b8-9803-b35c3081af25 service placement] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:27:31.586742 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e310f-05ed-45b8-9803-b35c3081af25 service placement] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:27:31.587021 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e310f-05ed-45b8-9803-b35c3081af25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:27:31.588758 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4d9e310f-05ed-45b8-9803-b35c3081af25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:27:31.600221 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e310f-05ed-45b8-9803-b35c3081af25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:27:31.601806 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e310f-05ed-45b8-9803-b35c3081af25 service placement] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:27:31.611540 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1465/2891] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:27:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:28:08.514767 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e68932-9e2a-4657-bf03-cbf808226407 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:28:08.515311 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e68932-9e2a-4657-bf03-cbf808226407 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:28:08.515413 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e68932-9e2a-4657-bf03-cbf808226407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:28:08.535627 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c6e68932-9e2a-4657-bf03-cbf808226407 None None] MFA Rules not processed for user `4daf4512881842a1bdf191e0d75139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:28:08.538020 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c6e68932-9e2a-4657-bf03-cbf808226407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:08.546722 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1427/2892] 10.222.0.62 () {58 vars in 967 bytes} [Wed Apr 6 11:28:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 11:28:08.598241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e310f-05ed-45b8-9803-b35c3081af25 service placement] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:28:08.600227 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e310f-05ed-45b8-9803-b35c3081af25 service placement] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:28:08.605241 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ee565-13ad-4c2e-819e-e31931b1f1b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89101c5ca3b048939a46b0bb246d2cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:28:08.605849 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ee565-13ad-4c2e-819e-e31931b1f1b4 service swift] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:28:08.606134 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ee565-13ad-4c2e-819e-e31931b1f1b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:28:08.606415 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ee565-13ad-4c2e-819e-e31931b1f1b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:28:08.614448 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ee565-13ad-4c2e-819e-e31931b1f1b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:28:08.616021 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ee565-13ad-4c2e-819e-e31931b1f1b4 service swift] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:28:08.624629 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1466/2893] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Apr 6 11:28:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 11:28:11.568681 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e68932-9e2a-4657-bf03-cbf808226407 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:28:11.570797 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c6e68932-9e2a-4657-bf03-cbf808226407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:11.645832 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e68932-9e2a-4657-bf03-cbf808226407 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:28:11.653908 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb02dd-9348-4fda-984f-aac39099fe2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:28:11.654687 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb02dd-9348-4fda-984f-aac39099fe2a service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:28:11.654971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb02dd-9348-4fda-984f-aac39099fe2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:28:11.655340 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb02dd-9348-4fda-984f-aac39099fe2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:28:11.658162 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8bdb02dd-9348-4fda-984f-aac39099fe2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:11.681287 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb02dd-9348-4fda-984f-aac39099fe2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:28:11.682972 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb02dd-9348-4fda-984f-aac39099fe2a service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:28:11.692370 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1428/2894] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:28:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:28:16.725244 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ee565-13ad-4c2e-819e-e31931b1f1b4 service swift] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:28:16.725244 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-089ee565-13ad-4c2e-819e-e31931b1f1b4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:16.792582 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ee565-13ad-4c2e-819e-e31931b1f1b4 service swift] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:28:16.799824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab2a50-7982-4f54-b3fc-e6e12bcfb08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:28:16.799824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2a50-7982-4f54-b3fc-e6e12bcfb08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:28:16.799824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2a50-7982-4f54-b3fc-e6e12bcfb08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:28:16.799824 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2a50-7982-4f54-b3fc-e6e12bcfb08a admin admin] PATH_INFO: `/v3/users/543ab8546bf04956b47066e3171ebf23` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:28:16.800283 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab2a50-7982-4f54-b3fc-e6e12bcfb08a admin admin] RBAC: Authorizing `identity:delete_user(user_id=543ab8546bf04956b47066e3171ebf23)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:28:16.801801 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab2a50-7982-4f54-b3fc-e6e12bcfb08a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:28:16.955212 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0cab2a50-7982-4f54-b3fc-e6e12bcfb08a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '543ab8546bf04956b47066e3171ebf23'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:16.955849 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0cab2a50-7982-4f54-b3fc-e6e12bcfb08a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '543ab8546bf04956b47066e3171ebf23'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:16.956465 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0cab2a50-7982-4f54-b3fc-e6e12bcfb08a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '543ab8546bf04956b47066e3171ebf23'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:16.968110 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0cab2a50-7982-4f54-b3fc-e6e12bcfb08a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '543ab8546bf04956b47066e3171ebf23'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:16.974704 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0cab2a50-7982-4f54-b3fc-e6e12bcfb08a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '543ab8546bf04956b47066e3171ebf23'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:17.045635 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1467/2895] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:28:16 2022] DELETE /identity/v3/users/543ab8546bf04956b47066e3171ebf23 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:28:17.284526 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb02dd-9348-4fda-984f-aac39099fe2a service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:28:17.297883 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb02dd-9348-4fda-984f-aac39099fe2a service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:28:17.364915 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:28:17.365808 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:28:17.366092 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:28:17.366371 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] PATH_INFO: `/v3/projects/2cdc93c8c7954215bc5d1521f0865e4c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:28:17.367547 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cdc93c8c7954215bc5d1521f0865e4c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:28:17.370160 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:28:17.463539 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cdc93c8c7954215bc5d1521f0865e4c', 'request_id': 'req-34f5d507-d311-43f9-bb17-343fda8c3c24'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:17.469481 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cdc93c8c7954215bc5d1521f0865e4c', 'request_id': 'req-34f5d507-d311-43f9-bb17-343fda8c3c24'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:17.474777 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cdc93c8c7954215bc5d1521f0865e4c', 'request_id': 'req-34f5d507-d311-43f9-bb17-343fda8c3c24'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:17.536880 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] The token cache is being invalidate because project 2cdc93c8c7954215bc5d1521f0865e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:28:17.537199 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:17.537812 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:17.539363 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1429/2896] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:28:17 2022] DELETE /identity/v3/projects/2cdc93c8c7954215bc5d1521f0865e4c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:28:17.543428 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab2a50-7982-4f54-b3fc-e6e12bcfb08a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:28:17.544838 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0cab2a50-7982-4f54-b3fc-e6e12bcfb08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:17.558382 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab2a50-7982-4f54-b3fc-e6e12bcfb08a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:28:17.613195 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463efa2-f6dc-43a7-a570-767cb06ea1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:28:17.618886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463efa2-f6dc-43a7-a570-767cb06ea1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:28:17.618886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463efa2-f6dc-43a7-a570-767cb06ea1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:28:17.618886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463efa2-f6dc-43a7-a570-767cb06ea1ca admin admin] PATH_INFO: `/v3/users/0d43375ef92549ff8bf69a75d2e9f952` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:28:17.618886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463efa2-f6dc-43a7-a570-767cb06ea1ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d43375ef92549ff8bf69a75d2e9f952)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:28:17.618886 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463efa2-f6dc-43a7-a570-767cb06ea1ca admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:28:17.791505 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0463efa2-f6dc-43a7-a570-767cb06ea1ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d43375ef92549ff8bf69a75d2e9f952'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:17.792185 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0463efa2-f6dc-43a7-a570-767cb06ea1ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d43375ef92549ff8bf69a75d2e9f952'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:17.792741 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0463efa2-f6dc-43a7-a570-767cb06ea1ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d43375ef92549ff8bf69a75d2e9f952'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:17.806586 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0463efa2-f6dc-43a7-a570-767cb06ea1ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d43375ef92549ff8bf69a75d2e9f952'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:17.813623 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-0463efa2-f6dc-43a7-a570-767cb06ea1ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d43375ef92549ff8bf69a75d2e9f952'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:17.892429 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1468/2897] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:28:17 2022] DELETE /identity/v3/users/0d43375ef92549ff8bf69a75d2e9f952 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:28:18.116167 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:28:18.117382 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:18.132897 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5d507-d311-43f9-bb17-343fda8c3c24 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:28:18.188191 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:28:18.189049 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:28:18.189355 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:28:18.190374 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] PATH_INFO: `/v3/projects/455bc7eb5d8c478b86826db523a28bd3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:28:18.190887 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=455bc7eb5d8c478b86826db523a28bd3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:28:18.192815 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:28:18.285740 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '455bc7eb5d8c478b86826db523a28bd3', 'request_id': 'req-16faab1d-a0be-4e51-bc48-7a42701885f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:18.292706 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '455bc7eb5d8c478b86826db523a28bd3', 'request_id': 'req-16faab1d-a0be-4e51-bc48-7a42701885f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:18.298013 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '455bc7eb5d8c478b86826db523a28bd3', 'request_id': 'req-16faab1d-a0be-4e51-bc48-7a42701885f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:18.382083 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] The token cache is being invalidate because project 455bc7eb5d8c478b86826db523a28bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:28:18.382304 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:18.382918 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:28:18.384474 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1430/2898] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:28:18 2022] DELETE /identity/v3/projects/455bc7eb5d8c478b86826db523a28bd3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:28:23.147217 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c51560-a0df-4265-af29-3e63537cb2de None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:28:23.147693 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c51560-a0df-4265-af29-3e63537cb2de None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:28:23.147811 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c51560-a0df-4265-af29-3e63537cb2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:28:23.165888 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-94c51560-a0df-4265-af29-3e63537cb2de None None] MFA Rules not processed for user `b174e6fdf8284bb6a7f4a2d27f2f8020`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 11:28:23.167091 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-94c51560-a0df-4265-af29-3e63537cb2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:23.219018 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1469/2899] 10.222.0.62 () {58 vars in 957 bytes} [Wed Apr 6 11:28:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 11:28:23.253318 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:28:23.254740 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:23.310965 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faab1d-a0be-4e51-bc48-7a42701885f9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:28:23.314514 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6031a-cfb6-4804-acec-b0c5e02c36dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d07bf80c4f741e68d14665b092edcff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:28:23.315179 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6031a-cfb6-4804-acec-b0c5e02c36dc service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:28:23.315460 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6031a-cfb6-4804-acec-b0c5e02c36dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:28:23.315737 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6031a-cfb6-4804-acec-b0c5e02c36dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:28:23.317530 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fbd6031a-cfb6-4804-acec-b0c5e02c36dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:23.385280 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6031a-cfb6-4804-acec-b0c5e02c36dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:28:23.386752 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6031a-cfb6-4804-acec-b0c5e02c36dc service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:28:23.397598 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1431/2900] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:28:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:28:23.696495 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c51560-a0df-4265-af29-3e63537cb2de None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:28:23.698030 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-94c51560-a0df-4265-af29-3e63537cb2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:23.753845 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c51560-a0df-4265-af29-3e63537cb2de None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:28:23.757608 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993aae3-60e5-4f21-b615-ddc4c34e7e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:28:23.758284 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993aae3-60e5-4f21-b615-ddc4c34e7e3b service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:28:23.759119 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993aae3-60e5-4f21-b615-ddc4c34e7e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:28:23.759472 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993aae3-60e5-4f21-b615-ddc4c34e7e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:28:23.761268 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b993aae3-60e5-4f21-b615-ddc4c34e7e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:23.770911 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993aae3-60e5-4f21-b615-ddc4c34e7e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:28:23.772375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993aae3-60e5-4f21-b615-ddc4c34e7e3b service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:28:23.781090 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1470/2901] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:28:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:28:24.499690 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6031a-cfb6-4804-acec-b0c5e02c36dc service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:28:24.501495 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fbd6031a-cfb6-4804-acec-b0c5e02c36dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:24.509700 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993aae3-60e5-4f21-b615-ddc4c34e7e3b service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:28:24.511169 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b993aae3-60e5-4f21-b615-ddc4c34e7e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:24.521174 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993aae3-60e5-4f21-b615-ddc4c34e7e3b service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:28:24.524904 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb4843-ee04-45ea-b1ab-6f6dddc242a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:28:24.525505 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb4843-ee04-45ea-b1ab-6f6dddc242a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:28:24.525781 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb4843-ee04-45ea-b1ab-6f6dddc242a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:28:24.526054 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb4843-ee04-45ea-b1ab-6f6dddc242a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:28:24.527753 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-eeeb4843-ee04-45ea-b1ab-6f6dddc242a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:24.542039 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb4843-ee04-45ea-b1ab-6f6dddc242a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:28:24.543454 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb4843-ee04-45ea-b1ab-6f6dddc242a3 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:28:24.554375 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1471/2902] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:28:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:28:24.569135 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6031a-cfb6-4804-acec-b0c5e02c36dc service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:28:24.574069 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d10d9-1c47-4b2a-846e-68a936ddd41c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd095449a5b44c6b1c9aca712edc11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:28:24.574712 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d10d9-1c47-4b2a-846e-68a936ddd41c service placement] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:28:24.574989 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d10d9-1c47-4b2a-846e-68a936ddd41c service placement] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:28:24.575262 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d10d9-1c47-4b2a-846e-68a936ddd41c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:28:24.576990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fa7d10d9-1c47-4b2a-846e-68a936ddd41c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:24.588689 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d10d9-1c47-4b2a-846e-68a936ddd41c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:28:24.590336 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d10d9-1c47-4b2a-846e-68a936ddd41c service placement] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:28:24.600742 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1432/2903] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:28:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:28:41.084643 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb4843-ee04-45ea-b1ab-6f6dddc242a3 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:28:41.088435 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-eeeb4843-ee04-45ea-b1ab-6f6dddc242a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:41.100916 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb4843-ee04-45ea-b1ab-6f6dddc242a3 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:28:41.106627 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d06ba-7d4a-4cb9-8f77-face23dd7ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:28:41.107263 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d06ba-7d4a-4cb9-8f77-face23dd7ae8 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:28:41.107548 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d06ba-7d4a-4cb9-8f77-face23dd7ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:28:41.107822 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d06ba-7d4a-4cb9-8f77-face23dd7ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:28:41.109626 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-845d06ba-7d4a-4cb9-8f77-face23dd7ae8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:41.121445 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d06ba-7d4a-4cb9-8f77-face23dd7ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:28:41.123003 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d06ba-7d4a-4cb9-8f77-face23dd7ae8 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:28:41.134226 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1472/2904] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:28:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:28:44.576950 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d10d9-1c47-4b2a-846e-68a936ddd41c service placement] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:28:44.586202 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d10d9-1c47-4b2a-846e-68a936ddd41c service placement] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:28:44.589795 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd565eb-5fef-4397-8e41-a0beae814725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:28:44.590425 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd565eb-5fef-4397-8e41-a0beae814725 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:28:44.590706 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd565eb-5fef-4397-8e41-a0beae814725 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:28:44.590982 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd565eb-5fef-4397-8e41-a0beae814725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:28:44.592769 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0bd565eb-5fef-4397-8e41-a0beae814725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:28:44.653320 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd565eb-5fef-4397-8e41-a0beae814725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:28:44.654803 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd565eb-5fef-4397-8e41-a0beae814725 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:28:44.664628 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1433/2905] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:28:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:29:30.185745 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d06ba-7d4a-4cb9-8f77-face23dd7ae8 service nova] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:29:30.195244 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d06ba-7d4a-4cb9-8f77-face23dd7ae8 service nova] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:29:30.198808 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c73434-88f5-4c59-b3e8-8965846808f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:29:30.199489 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73434-88f5-4c59-b3e8-8965846808f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:29:30.199776 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73434-88f5-4c59-b3e8-8965846808f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:29:30.200050 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73434-88f5-4c59-b3e8-8965846808f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:29:30.201841 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e0c73434-88f5-4c59-b3e8-8965846808f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:29:30.211786 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c73434-88f5-4c59-b3e8-8965846808f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:29:30.213265 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c73434-88f5-4c59-b3e8-8965846808f8 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:29:30.221261 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1473/2906] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:29:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:30:50.137753 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd565eb-5fef-4397-8e41-a0beae814725 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:30:50.139313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0bd565eb-5fef-4397-8e41-a0beae814725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:30:50.210621 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd565eb-5fef-4397-8e41-a0beae814725 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:30:50.216971 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87134ff-ac34-4ed0-8ab3-779c851a818a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650c5809116e4bcd808044236c06dcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:30:50.217653 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87134ff-ac34-4ed0-8ab3-779c851a818a service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:30:50.217988 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87134ff-ac34-4ed0-8ab3-779c851a818a service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:30:50.218266 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87134ff-ac34-4ed0-8ab3-779c851a818a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:30:50.220092 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a87134ff-ac34-4ed0-8ab3-779c851a818a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:30:50.232684 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87134ff-ac34-4ed0-8ab3-779c851a818a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:30:50.234282 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87134ff-ac34-4ed0-8ab3-779c851a818a service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:30:50.244890 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1434/2907] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:30:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 11:31:05.548588 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c73434-88f5-4c59-b3e8-8965846808f8 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:31:05.584145 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c73434-88f5-4c59-b3e8-8965846808f8 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:31:05.587833 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d3316-4bc0-4ffd-ba4a-08fdb57b7fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e078c6efaf054f7489f7164fdafce714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:31:05.588480 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d3316-4bc0-4ffd-ba4a-08fdb57b7fce service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:31:05.588763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d3316-4bc0-4ffd-ba4a-08fdb57b7fce service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:31:05.589044 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d3316-4bc0-4ffd-ba4a-08fdb57b7fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:31:05.590931 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-786d3316-4bc0-4ffd-ba4a-08fdb57b7fce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:31:05.671544 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d3316-4bc0-4ffd-ba4a-08fdb57b7fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:31:05.672969 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d3316-4bc0-4ffd-ba4a-08fdb57b7fce service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:31:05.691376 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1474/2908] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 11:31:12.649655 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87134ff-ac34-4ed0-8ab3-779c851a818a service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:31:12.651585 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a87134ff-ac34-4ed0-8ab3-779c851a818a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:31:12.667272 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87134ff-ac34-4ed0-8ab3-779c851a818a service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:31:12.672014 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317da10d-4c41-4d64-b874-fff0a3d77e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:31:12.672990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317da10d-4c41-4d64-b874-fff0a3d77e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:31:12.673313 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317da10d-4c41-4d64-b874-fff0a3d77e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:31:12.673592 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317da10d-4c41-4d64-b874-fff0a3d77e8c admin admin] PATH_INFO: `/v3/users/b174e6fdf8284bb6a7f4a2d27f2f8020` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:31:12.674793 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317da10d-4c41-4d64-b874-fff0a3d77e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b174e6fdf8284bb6a7f4a2d27f2f8020)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:31:12.676800 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317da10d-4c41-4d64-b874-fff0a3d77e8c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:31:12.867516 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-317da10d-4c41-4d64-b874-fff0a3d77e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b174e6fdf8284bb6a7f4a2d27f2f8020'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:12.868102 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-317da10d-4c41-4d64-b874-fff0a3d77e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b174e6fdf8284bb6a7f4a2d27f2f8020'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:12.868741 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-317da10d-4c41-4d64-b874-fff0a3d77e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b174e6fdf8284bb6a7f4a2d27f2f8020'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:12.934251 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-317da10d-4c41-4d64-b874-fff0a3d77e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b174e6fdf8284bb6a7f4a2d27f2f8020'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:12.946453 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-317da10d-4c41-4d64-b874-fff0a3d77e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b174e6fdf8284bb6a7f4a2d27f2f8020'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:12.958715 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1435/2909] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:31:12 2022] DELETE /identity/v3/users/b174e6fdf8284bb6a7f4a2d27f2f8020 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:31:13.172907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d3316-4bc0-4ffd-ba4a-08fdb57b7fce service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:31:13.184393 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d3316-4bc0-4ffd-ba4a-08fdb57b7fce service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:31:13.254331 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:31:13.255230 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:31:13.255516 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:31:13.255794 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] PATH_INFO: `/v3/projects/13d5d442d5ce480f95e106d1889fa687` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:31:13.256984 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d5d442d5ce480f95e106d1889fa687)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:31:13.258932 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:31:13.362947 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d5d442d5ce480f95e106d1889fa687', 'request_id': 'req-6805410d-a0d9-4075-b19d-fa342278f19d'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:13.402869 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d5d442d5ce480f95e106d1889fa687', 'request_id': 'req-6805410d-a0d9-4075-b19d-fa342278f19d'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:13.408977 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d5d442d5ce480f95e106d1889fa687', 'request_id': 'req-6805410d-a0d9-4075-b19d-fa342278f19d'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:13.419347 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] The token cache is being invalidate because project 13d5d442d5ce480f95e106d1889fa687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:31:13.419641 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:13.420760 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:13.422297 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1475/2910] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:31:13 2022] DELETE /identity/v3/projects/13d5d442d5ce480f95e106d1889fa687 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:31:13.426203 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317da10d-4c41-4d64-b874-fff0a3d77e8c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:31:13.427604 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-317da10d-4c41-4d64-b874-fff0a3d77e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:31:13.440828 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317da10d-4c41-4d64-b874-fff0a3d77e8c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:31:13.495839 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cd28a-3835-46dc-858a-9c40572caef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:31:13.496707 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd28a-3835-46dc-858a-9c40572caef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:31:13.496990 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd28a-3835-46dc-858a-9c40572caef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:31:13.497409 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd28a-3835-46dc-858a-9c40572caef7 admin admin] PATH_INFO: `/v3/users/1cb042ecee30457da10ef35f6d94538a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:31:13.498627 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cd28a-3835-46dc-858a-9c40572caef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cb042ecee30457da10ef35f6d94538a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:31:13.500627 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cd28a-3835-46dc-858a-9c40572caef7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:31:13.610566 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-031cd28a-3835-46dc-858a-9c40572caef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cb042ecee30457da10ef35f6d94538a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:13.611211 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-031cd28a-3835-46dc-858a-9c40572caef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cb042ecee30457da10ef35f6d94538a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:13.611829 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-031cd28a-3835-46dc-858a-9c40572caef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cb042ecee30457da10ef35f6d94538a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:13.642868 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-031cd28a-3835-46dc-858a-9c40572caef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cb042ecee30457da10ef35f6d94538a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:13.654740 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-031cd28a-3835-46dc-858a-9c40572caef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cb042ecee30457da10ef35f6d94538a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:13.666980 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1436/2911] 10.222.0.62 () {58 vars in 1223 bytes} [Wed Apr 6 11:31:13 2022] DELETE /identity/v3/users/1cb042ecee30457da10ef35f6d94538a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:31:13.913907 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:31:13.915494 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:31:13.928695 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805410d-a0d9-4075-b19d-fa342278f19d admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:31:13.985076 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081d2092d1f43b39f058ddf8338a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '279d4a89a1294ac096e396e32f9abd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:31:13.986065 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:31:13.986354 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:31:13.986632 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7 admin admin] PATH_INFO: `/v3/projects/b1395205e472422fa5d105961d6d0c52` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:31:13.987817 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1395205e472422fa5d105961d6d0c52)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:31:13.989763 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:31:14.071305 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1395205e472422fa5d105961d6d0c52', 'request_id': 'req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:14.111964 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1395205e472422fa5d105961d6d0c52', 'request_id': 'req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:14.118167 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1395205e472422fa5d105961d6d0c52', 'request_id': 'req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:14.128020 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7 admin admin] The token cache is being invalidate because project b1395205e472422fa5d105961d6d0c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 11:31:14.128303 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:14.128919 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ff8cca5f-3bd3-4a6e-a62c-6d4fef7fe6a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 11:31:14.130550 dv-cinder-836072-2-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1476/2912] 10.222.0.62 () {58 vars in 1232 bytes} [Wed Apr 6 11:31:13 2022] DELETE /identity/v3/projects/b1395205e472422fa5d105961d6d0c52 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 11:32:36.448763 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cd28a-3835-46dc-858a-9c40572caef7 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 11:32:36.450220 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-031cd28a-3835-46dc-858a-9c40572caef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:32:36.539169 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cd28a-3835-46dc-858a-9c40572caef7 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 11:32:36.594916 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6fce9-504c-4a5c-92c3-7864d9df55cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd095449a5b44c6b1c9aca712edc11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4306a6b12434cc495650e4f3b9afbde', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 11:32:36.596061 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6fce9-504c-4a5c-92c3-7864d9df55cd service placement] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 11:32:36.596337 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6fce9-504c-4a5c-92c3-7864d9df55cd service placement] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 11:32:36.596606 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6fce9-504c-4a5c-92c3-7864d9df55cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 11:32:36.598367 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-48f6fce9-504c-4a5c-92c3-7864d9df55cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 11:32:36.609123 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6fce9-504c-4a5c-92c3-7864d9df55cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 11:32:36.610761 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6fce9-504c-4a5c-92c3-7864d9df55cd service placement] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 11:32:36.620847 dv-cinder-836072-2-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1437/2913] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Apr 6 11:32:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)